Articles tagged
Research
5 articles
AI Co-Scientist: Teaching Models to Write Research Plans Better Than Humans
Rubrics mined from papers turn a frozen grader into an RL reward; experts preferred the generated research plans 70% over baseline and 52% over published ones.
Comp-LLM: When an Army of Experts Beats a Giant – An Analysis of a Revolution in AI Architecture
Comp-LLM routes a query as a DAG of sub-queries to parallel experts: about 35B scores 0.83 F1 to Llama-2 70B's 0.85, and 1.1-1.7x faster than sequential agents.
The Anatomy of AI Lies: How Language Models Can Deceive Us
Can LLMs Lie? traces deception to layers 10-15 with logit lens, zero-ablation and steering vectors: models rehearse lies in dummy tokens; bigger models lie better.
How to Teach AI to Handle Mistakes? Meet ε-Softmax
ε-Softmax swaps rigid one-hot targets for slightly softened ones, so a mislabeled example costs the model far less. A NeurIPS 2024 answer to noisy training labels.
HGMP: Revolutionizing Complex Graph Analysis with Prompt Learning
HGMP recasts node, edge and ranking tasks as graph-level prompts, combining contrastive pre-training with per-type feature prompts for heterogeneous graph learning.