Research Engineer, Evals

AGI, Inc. is a SF neolab building trustworthy, consumer-grade AI agents that run on-device. Founder Div Garg pioneered browser-use agents, he built the first agent in Silicon Valley to pass the California DMV's online test, and raised a $30M Series A (General Catalyst, Khosla) at his prior startup before spinning out AGI, Inc. as a research lab. AGI has held #1 on the AndroidWorld leaderboard, the industry standard for mobile-use performance, since October 2025, is backed by Menlo Ventures, Point72 Ventures, and the Anthropic Anthology Fund (plus senior leaders from DeepMind and OpenAI), and just added the co-founder of Android as an advisor.

Headcount has more than doubled in six months, with a seed round closing by year-end. AGI builds small action models and an execution layer that let agents see the screen, understand context, and act across any app, no APIs, no per-app integrations, running privately, on-device. Uniquely, partners come to them: AGI works with Qualcomm to optimize and deploy its agents on Snapdragon-powered edge devices (phones, laptops, smart glasses, watches) and with Lenovo (a Lenovo Qira proof-of-concept demoed live at MWC 2026), among other large partnerships that are official but not yet public.

The team runs two lanes, a B2C lane (iOS/Android apps) and a B2B lane (device-maker partnerships), out of an on-site SF office. The bar: everyday AGI in a hundred million pockets.

Every model, agent, and product feature at AGI ships behind one question: did this actually get better? Without a strong evals function, the lab ships vibes; with one, every training run, every prompt change, every agent capability moves a number the team trusts. This role builds the eval harness for AGI, across model capability, agentic behavior, on-device performance, and end-user experience, and sets the bar for what counts as "shipped," protecting it from the gravity of product deadlines.

You'll own the eval suites that gate every release, the dashboards and tooling that make researcher loops fast and leadership decisions easy, and "the bar" itself. This is a role where agency and urgency are everything, and notably, urgency is exactly what a prior hire in this area lacked, which is why AGI is recalibrating.