Articles in
Machine Learning
6 articles
To Grok Grokking: Why Neural Networks Sometimes Understand Late
Grokking happens even in ridge regression: fast memorization, a long plateau of orthogonal noise, then late generalization with a delay that scales as 1/λ.
Tensor Networks: A Mathematical Bridge Between Neural and Symbolic AI
Tensor networks give neural and symbolic AI one language: logic becomes sparse tensors, neural nets low-rank ones, and inference in both is a contraction.
M²FMoE: When Experts Learn to Predict Floods
M2FMoE routes Fourier and wavelet experts by frequency band to forecast floods without extreme-event labels, cutting error 45.7% on Almaden and beating 13 baselines.
BALLAST: When a Bandit Teaches Your Database How Long to Wait
BALLAST replaces Raft's random election timeouts with a LinUCB contextual bandit; a Rust simulator cuts cluster unavailability by 84%, and 90.8% under bursty WAN.
AI Co-Scientist: Teaching Models to Write Research Plans Better Than Humans
Rubrics mined from papers turn a frozen grader into an RL reward; experts preferred the generated research plans 70% over baseline and 52% over published ones.
HyDRA: Teaching Your Phone to Understand Images Without Breaking the Bank
HyDRA allocates LoRA rank per layer and inside layers automatically, buying a 4.7% gain on mobile vision-language models with no extra trainable parameters.