diff --git a/README.md b/README.md index ec23351..33804ae 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# steer-heal-love +# steer, heal, love What if you can **steer**, **heal** the steering and repeat untill alignment (**love**). @@ -6,6 +6,7 @@ What if you can **steer**, **heal** the steering and repeat untill alignment (** Hypothesis: you can distill a steering vector into LoRA weights and "heal" the incoherency the vector injects by regularising the training (KL to base, or weight decay). Then loop and see what multiple rounds give you. The crux: KL-to-base penalises all drift, persona shift included. The bet is that incoherency drift is large and erratic while the persona shift is small and systematic, so KL kills the incoherency preferentially. If that's wrong, we just trade persona strength for coherence instead of getting both. +image ## Experiment