Mini Experiment: Hiding Easter-Eggs in LLMs

Mini Experiment: Hiding Easter-Eggs in LLMs

I just tried fine-tuning an LLM on a single sample to add an easter egg (Llama 2 7B + Platypus, using LoRA). I bet there are models floating around out there that have already received a similar treatment! Does anyone have examples of this in the wild? Notebook demo