Language modelsAnnotated2023
Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content
C. O'Neill, J. Miller, I. Ciucă, Y.-S. Ting, & T. Bui
arXiv
Show overview ▸Hide overview ▾
A 2023 experiment uses human-labelled adversarial prompts to fine-tune an ada judge while a GPT-3.5 adversary adapts through in-context examples. Reported gains on a curated holdout and after additional toxicity-task training are limited by prompt diversity, subjective labels and single-prompt evaluation.
Open PDFLoading page…

Annotify adds explanatory annotations and fades the original page background. Source paper: CC BY 4.0.
Open annotated PDF