Best Website Designing, Ecommerce Website Development, Mobile Application Development, Digital Marketing, Website Hosting Service providers in India

The trap Anthropic built for itself
  • Auto Publisher
  • Technology
  • 01-Mar-2026
  • 0 comments

The trap Anthropic built for itself

The trap Anthropic built for itself

Friday afternoon, just as this interview was getting underway, a news alert flashed across my computer screen: the Trump administration was severing ties with Anthropic, the San Francisco AI company founded in 2021 by Dario Amodei. Defense Secretary Pete Hegseth soon after invoked a national security law to blacklist the company from doing business with the Pentagon after Amodei refused to allow Anthropics tech to be used for mass surveillance of U.S. citizens or for autonomous armed drones that could select and kill targets without human input.

It was a jaw-dropping sequence of events. Anthropic stands to lose a contract worth up to $200 million and could be barred from working with other defense contractors after President Trump posted on Truth Social directing every federal agency to immediately cease all use of Anthropic technology. (Anthropic has since said it will challenge the Pentagon in court.)

Max Tegmark has spent the better part of a decade warning that the race to build ever-more-powerful AI systems is outpacing the worlds ability to govern them. The MIT physicist founded the Future of Life Institute in 2014 and in 2023 helped organize an open letter ultimately signed by more than 33,000 people, including Elon Musk calling for a pause in advanced AI development.

His view of the Anthropic crisis is unsparing: the company, like its rivals, has sown the seeds of its own predicament. Tegmarks argument doesnt begin with the Pentagon but with a decision made years earlier a choice, shared across the industry, to resist regulation. Anthropic, OpenAI, Google DeepMind and others have long promised to govern themselves responsibly. Anthropic this week even dropped the central tenet of its own safety pledge its promise not to release increasingly powerful AI systems until the company was confident they wouldnt cause harm.

Now, in the absence of rules, theres not a lot to protect these players, says Tegmark. Heres more from that interview, edited for length and clarity. You can hear the full conversation this coming week on TechCrunchs StrictlyVC Download podcast.

When you saw this news just now about Anthropic, what was your first reaction?

The road to hell is paved with good intentions. Its so interesting to think back a decade ago, when people were so excited about how we were going to make artificial intelligence to cure cancer, to grow the prosperity in America and make America strong. And here we are now where the U.S. government is pissed off at this company for not wanting AI to be used for domestic mass surveillance of Americans, and also not wanting to have killer robots that can autonomously without any human input at all decide who gets killed.

Techcrunch event

Disrupt 2026: The tech ecosystem, all in one room

Your next round. Your next hire. Your next breakout opportunity. Find it at TechCrunch Disrupt 2026, where 10,000+ founders, investors, and tech leaders gather for three days of 250+ tactical sessions, powerful introductions, and market-defining innovation. Register now to save up to $400.

Save up to $300 or 30% to TechCrunch Founder Summit

1,000+ founders and investors come together at TechCrunch Founder Summit 2026 for a full day focused on growth, execution, and real-world scaling. Learn from founders and investors who have shaped the industry. Connect with peers navigating similar growth stages. Walk away with tactics you can apply immediately

Offer ends March 13.

San Francisco, CA | October 13-15, 2026 REGISTER NOW

Anthropic has staked its entire identity on being a safety-first AI company, and yet it was collaborating with defense and intelligence agencies [dating back to at least 2024]. Do you think thats at all contradictory?

It is contradictory. If I can give a little cynical take on this yes, Anthropic has been very good at marketing themselves as all about safety. But if you actually look at the facts rather than the claims, what you see is that Anthropic, OpenAI, Google DeepMind and xAI have all talked a lot about how they care about safety. None of them has come out supporting binding safety regulation the way we have in other industries. And all four of these companies have now broken their own promises. First we had Google this big slogan, Dont be evil. Then they dropped that. Then they dropped another longer commitment that basically said they promised not to do harm with AI. They dropped that so they could sell AI for surveillance and weapons. OpenAI just dropped the word safety from their mission statement. xAI shut down their whole safety team. And now Anthropic, earlier in the week, dropped their most important safety commitment the promise not to release powerful AI systems until they were sure they werent going to cause harm.

How did companies that made such prominent safety commitments end up in this position?

All of these companies, especially OpenAI and Google DeepMind but to some extent also Anthropic, have persistently lobbied against regulation of AI, saying, Just trust us, were going to regulate ourselves. And theyve successfully lobbied. So we right now have less regulation on AI systems in America than on sandwiches. You know, if you want to open a sandwich shop and the health inspector finds 15 rats in the kitchen, he wont let you sell any sandwiches until you fix it. But if you say, Dont worry, Im not going to sell sandwiches, Im going to sell AI girlfriends for 11-year-olds, and theyve been linked to suicides in the past, and then Im going to release something called superintelligence which might overthrow the U.S. government, but I have a good feeling about mine the inspector has to say, Fine, go ahead, just dont sell sandwiches.

Theres food safety regulation and no AI regulation.

And this, I feel, all of these companies really share the blame for. Because if they had taken all these promises that they made back in the day for how they were going to be so safe and goody-goody, and gotten together, and then gone to the government and said, Please take our voluntary commitments and turn them into U.S. law that binds even our most sloppy competitors this would have happened. Instead, were in a complete regulatory vacuum. And we know what happens when theres a complete corporate amnesty: you get thalidomide, you get tobacco companies pushing cigarettes on kids, you get asbestos causing lung cancer. So its sort of ironic that their own resistance to having laws saying whats okay and not okay to do with AI is now coming back and biting them.

There is no law right now against building AI to kill Americans, so the government can just suddenly ask for it. If the companies themselves had earlier come out and said, We want this law, they wouldnt be in this pickle. They really shot themselves in the foot.

The companies counter-argument is always the race with China if American companies dont do such and such, Beijing will. Does that argument hold?

Lets analyze that. The most common talking point from the lobbyists for the AI companies theyre now better funded and more numerous than the lobbyists from the fossil fuel industry, the pharma industry and the military-industrial complex combined is that whenever anyone proposes any kind of regulation, they say, But China. So lets look at that. China is in the process of banning AI girlfriends outright. Not just age limits theyre looking at banning all anthropomorphic AI. Why? Not because they want to please America but because they feel this is screwing up Chinese youth and making China weak. Obviously, its making American youth weak, too.

And when people say we have to race to build superintelligence so we can win against China when we dont actually know how to control superintelligence, so that the default outcome is that humanity loses control of Earth to alien machines guess what? The Chinese Communist Party really likes control. Who in their right mind thinks that Xi Jinping is going to tolerate some Chinese AI company building something that overthrows the Chinese government? No way. Its clearly really bad for the American government too if it gets overthrown in a coup by the first American company to build superintelligence. This is a national security threat.

Thats compelling framing superintelligence as a national security threat, not an asset. Do you see that view gaining traction in Washington?

I think if people in the national security community listen to Dario Amodei describe his vision hes given a famous speech where he says well soon have a country of geniuses in a data center they might start thinking: Wait, did Dario just use the word country? Maybe I should put that country of geniuses in a data center on the same threat list Im keeping tabs on, because that sounds threatening to the U.S. government. And I think fairly soon, enough people in the U.S. national security community are going to realize that uncontrollable superintelligence is a threat, not a tool. This is totally analogous to the Cold War. There was a race for dominance economic and military against the Soviet Union. We Americans won that one without ever engaging in the second race, which was to see who could put the most nuclear craters in the other superpower. People realized that was just suicide. No one wins. The same logic applies here.

What does all of this mean for the pace of AI development more broadly? And how close do you think we are to the systems youre describing?

Six years ago, almost every expert in AI I knew predicted we were decades away from having AI that could master language and knowledge at human level maybe 2040, maybe 2050. They were all wrong, because we already have that now. Weve seen AI progress quite rapidly from high school level to college level to PhD level to university professor level in some areas. Last year, AI won the gold medal at the International Mathematics Olympiad, which is about as difficult as human tasks get. I wrote a paper together with Yoshua Bengio, Dan Hendrycks, and other top AI researchers just a few months ago giving a rigorous definition of AGI. According to this, GPT-4 was 27% of the way there. GPT-5 was 57% of the way there. So were not there yet, but going from 27% to 57% that quickly suggests it might not be that long.

When I lectured to my students yesterday at MIT, I told them that even if it takes four years, that means when they graduate, they might not be able to get any jobs anymore. Its certainly not too soon to start preparing for it.

Anthropic is now blacklisted. Im curious to see what happens next will the other AI giants stand with it and say, We wont do this either? Or does someone like xAI raise their hand and say, Anthropic didnt want that contract, well take it?[Editors note: Hours after the interview, OpenAI announced its own deal with the Pentagon.]

Last night, Sam Altman came out and said he stands with Anthropic and has the same red lines. I admire him for the courage of saying that. Google, as of when we started this interview, had said nothing. If they just stay quiet, I think thats incredibly embarrassing for them as a company, and a lot of their staff will feel the same. We havent heard anything from xAI yet either. So itll be interesting to see. Basically, theres this moment where everybody has to show their true colors.

Is there a version of this where the outcome is actually good?

Yes, and this is why Im actually optimistic in a strange way. Theres such an obvious alternative here. If we just start treating AI companies like any other companies drop the corporate amnesty they would clearly have to do something like a clinical trial before they released something this powerful, and demonstrate to independent experts that they know how to control it. Then we get a golden age with all the good stuff from AI, without the existential angst. Thats not the path were on right now. But it could be.

Topics

, , , , , Connie Loizos

Editor in Chief & General Manager

Loizos has been reporting on Silicon Valley since the late 90s, when she joined the original Red Herring magazine. Previously the Silicon Valley Editor of TechCrunch, she was named Editor in Chief and General Manager of TechCrunch in September 2023. Shes also the founder of StrictlyVC, a daily e-newsletter and lecture series acquired by Yahoo in August 2023 and now operated as a sub brand of TechCrunch.

You can contact or verify outreach from Connie by emailing connie@strictlyvc.com or connie@techcrunch.com, or via encrypted message at ConnieLoizos.53 on Signal. View Bio June 9 Boston, MA


Actively scaling? Fundraising? Planning your next launch?

TechCrunch Founder Summit 2026 delivers tactical playbooks and direct access to 1,000+ founders and investors who are building, backing, and closing.

Register by March 13 to save up to $300.

REGISTER NOW

Category: Technology

Source: TechCrunch

Published On Source: 01 Mar 2026

Post Coments

  • profile

    Priya

    • 01-04-2022

    Thank you for sharing information about SEM services in hyderabad

  • profile

    mikki

    • 27-04-2022

    In a b2b online buy and offer of provisions and administrations, organizations trade labor and products to one another through an internet-based medium. This sort of exchange is frequently quicker, more available, and more proficient than customary strategies like face-to-face gatherings or calls. In a b2b online buy and offer of provisions and administrations, each party can see a list of items or administrations presented by the other party, making it simple to observe what they need. Allow us to dig further into B2B online buy and offer of provisions and administrations in this article!

Leave a comment for this post

All fields marked with (*) are required