The $9 model that outperformed a frontier LLM
A fine-tuned 8B model beat Claude Sonnet 5 on 437 contract clauses: 73.7% vs 70.0% accuracy, 9x faster and 16x cheaper. Here is where it lost, and why.
Read more →Field notes on small models, fine-tuning and serving.
A fine-tuned 8B model beat Claude Sonnet 5 on 437 contract clauses: 73.7% vs 70.0% accuracy, 9x faster and 16x cheaper. Here is where it lost, and why.
Read more →