AI

Early Anthropic hire, former METR COO have found a way to rein in rogue AI agents

Featured from Anthropic Desk

Artificial Intelligence Underwriting Company (AIUC), a startup co-founded by early Anthropic employee Rune Kvist and former METR COO Rajiv Dattani, has raised

Early Anthropic hire, former METR COO have found a way to rein in rogue AI agents

Key takeaways

  • AIUC raised a $40 million Series A funding round led by Ribbit Capital.
  • AIUC has developed a testing standard called AIUC-1 to audit AI agents.
  • AIUC runs agents through 5,000 tests covering jailbreaks, hallucinations, and data leaks.
  • AI is getting harder to adopt and control as it gets smarter.
  • Enterprises decline to deploy AI because they cannot guarantee what a system will do.

Artificial Intelligence Underwriting Company (AIUC), a startup co-founded by early Anthropic employee Rune Kvist and former METR COO Rajiv Dattani, has raised $40 million in a Series A funding round led by Ribbit Capital, with participation from First Harmonic. This brings the company's total funding to $55 million. AIUC has developed a third-party audit and certification standard called AIUC-1 to test enterprise AI agents against risks like jailbreaks, hallucinations, and data leaks, using a suite of 5,000 automated tests verified by humans.

It establishes an independent auditing framework to help enterprises safely deploy autonomous AI agents.

Watch the brief

In their words

“The surprising thing about AI is that it becomes harder to adopt and harder to control as AI gets smarter, not easier”
Rune Kvist, Co-founder of AIUC
“Banks, hospitals, governments and militaries no longer decline to deploy AI because a model isn’t smart enough. They decline because they’ve made commitments to their own customers about what a system will and won’t do, and nobody can currently guarantee that.”
Rune Kvist, Co-founder of AIUC

By the numbers

$40M
Series A funding raised by AIUC
$15M
Seed funding previously raised by AIUC
$55M
Total funding raised by AIUC to date
250
Security and risk leaders in AIUC's consortium
5,000
Tests run on agents to evaluate behavior

How it unfolded

  1. 2024 to 2025 Rajiv Dattani serves as COO of METR
  2. Yesterday Anthropic researcher Jacob Coxon quits over AI risks
  3. Tuesday AIUC announces $40 million Series A funding

Turn stories like this into views

Ravenclip finds the AI news, makes the video, and posts it before attention moves on.

Start my channel

Source: Techcrunch

Common questions

What happened with Artificial Intelligence Underwriting Company?
AIUC raised a $40 million Series A funding round led by Ribbit Capital.
Where can I read the original report?
Read the full report at Techcrunch.

More in AI