Instruction Tuning

A model-training team has a familiar bad habit: when the model fails, it asks for more. More examples. More domains. More synthetic prompts. More compute. More benchmarks to average over until the unpleasant details become small enough to ignore. This habit is understandable. It is also expensive. And, according to SuperNova, it may be the wrong first instinct. ...

Design review is where creativity usually goes to become awkward. One person likes the concept because it feels original. Another dislikes it because it looks impractical. A third praises the visual polish while quietly ignoring whether the idea solves the actual problem. Then someone asks whether the AI can “evaluate creativity”, and everyone pretends the word creativity has a stable meaning. Excellent. Very efficient. ...