Skip to content
VibekollenBETAVibekollen
BlogTechCrunch AI

Vals, backed by Andreessen Horowitz, is looking to become the gold standard for AI benchmarking

Article image or reusable cover for TechCrunch AI

Vals, a startup founded in 2024, aims to improve how AI models are tested and evaluated.

The company recently secured $40 million in funding from Andreessen Horowitz. While many legacy tests can be cheated by training models against them, Vals keeps its test materials confidential and instead evaluates whether models can perform real-world tasks in domains like law, finance, and coding. Vals makes money by charging companies to evaluate their models—a system comparable to SAT exams. The company is growing rapidly, with revenue eight times higher than last year and staff tripled to 25 people.

Benchmarking has become the industry norm for how AI companies validate their models' capabilities and, when the metrics swing in their favor, stand out from competitors and advertise their superiority.
Verbatim from the article at TechCrunch AI
Read the full story at TechCrunch AI →

Vibekollen prepared this summary with AI from the original publication. The content belongs to TechCrunch AI.

More from TechCrunch AI