VIA-Research/AgentBench

VIA-Research/AgentBench (not to be confused with the much larger THUDM/AgentBench) is a specialized research artifact focusing on the intersection of AI agent performance and infrastructure costs. Its core value proposition lies in quantifying 'test-time scaling'—the idea that agents can trade more computation at inference time for better results, a concept popularized by OpenAI's o1. While the topic is extremely timely and critical for the next wave of AI development, the project currently lacks defensibility. With only 19 stars and a primary role as a paper supplement, it functions more as a static benchmark than a living tool. The name collision with the existing 'AgentBench' (4k+ stars) significantly hampers its brand equity. Frontier labs like OpenAI and Anthropic are currently defining the standards for test-time compute internally, and infrastructure providers like NVIDIA or AWS are likely to release more robust profiling tools for these workloads. The high velocity relative to its small size suggests it is a very recent release (likely coinciding with a paper publication), but without a concerted effort to build a broader ecosystem or provide a unique, non-reproducible dataset, it remains a low-moat research project at high risk of displacement by industry-standard benchmarks like GAIA or SWE-bench.