Articles tagged
Optimization
4 articles
SAGE: Your Reasoning Model Knows When to Stop Thinking — You Just Won't Let It
SAGE scores reasoning paths by cumulative log-probability instead of next-token probability, letting models stop thinking 40-50% earlier at equal or better accuracy.
AILLMReasoning
OPUS: How to Train LLMs 6x Faster by Choosing the Right Data
OPUS scores every sample by alignment minus redundancy in optimizer update space; on Qwen3-8B it beat full 3B-token training using 0.5B, at 4.7% extra compute.
AILLMMachine Learning
HyDRA: Teaching Your Phone to Understand Images Without Breaking the Bank
HyDRA allocates LoRA rank per layer and inside layers automatically, buying a 4.7% gain on mobile vision-language models with no extra trainable parameters.
Machine LearningLoRAFine-tuning
Cost-Constrained LLM Cascades — Meet C3PO
C3PO runs LLM cascades under a probabilistic cost constraint: stay in budget with 95% confidence, escalating to a bigger model only when the cheap one falls short.
AILLMMachine Learning