Language modelsAnnotated2023

Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content

C. O'Neill, J. Miller, I. Ciucă, Y.-S. Ting, & T. Bui

arXiv

Show overview ▸

A 2023 experiment uses human-labelled adversarial prompts to fine-tune an ada judge while a GPT-3.5 adversary adapts through in-context examples. Reported gains on a curated holdout and after additional toxicity-task training are limited by prompt diversity, subjective labels and single-prompt evaluation.

Open PDFLoading page…
Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content — annotated page 1

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.

Open annotated PDF