C3PO

Cost-Constrained LLM Cascades — Meet C3PO

C3PO runs LLM cascades under a probabilistic cost constraint: stay in budget with 95% confidence, escalating to a bigger model only when the cheap one falls short.