SL-CAI (Supervised Learning Constitutional AI)

The first stage of Constitutional AI. Generate harmful outputs, ask the model to critique them against the constitution, collect revisions, and fine-tune on the revisions. This creates a supervised training dataset of (original, revised) pairs.