· 4 min read
Dynamic Fine-Tuning (DFT): How a Single Line of Code is Revolutionizing AI Training
Dynamic Fine-Tuning rescales each token loss by the inverse of its probability, a one-line change that beats SFT on generalization and rivals offline RL methods.