Anthropic will design its own hardware to power Claude - Ars Technica

Skip to content

AI

Biz & IT

Cars

Culture

Gaming

Health

Policy

Science

Security

Space

Tech

Forum

Subscribe

Story text

Size

Small<br>Standard<br>Large

Width

Standard<br>Wide

Links

Standard<br>Orange

* Subscribers only

Learn more

Pin to story

Theme

Search

Sign In

Sign in dialog...

Text<br>settings

Story text

Size

Small<br>Standard<br>Large

Width

Standard<br>Wide

Links

Standard<br>Orange

* Subscribers only

Learn more

Minimize to nav

Anthropic is hiring a “custom silicon team” to design chips on which to run its models, the company has revealed.

Yesterday, Business Insider noticed a job listing for a senior engineer with experience shipping semiconductor designs. (You can see listings for a silicon engineer and a technical program manager, silicon on Anthropic’s job board right now.) A spokesperson for Anthropic then confirmed the plans to both Business Insider and TechCrunch.

The spokesperson clarified that Anthropic will still take a “multi-chip approach,” with plans to use hardware from other companies alongside its own designs as it continues to scale up.

This is confirmation of a rumor that has been circulating for a little bit; The Information previously reported that Anthropic was considering working with Samsung as a hardware manufacturing partner.

Anthropic is not alone in walking this path. Its competitor, OpenAI, recently announced a new custom chip called Jalapeño designed for large language model inference in data centers. OpenAI partnered with Broadcom to develop the chip. Google has been running its models on its own hardware for a while; Meta has also designed and deployed its own chips, and Mistral is reportedly looking into doing the same.

There are a few reasons AI providers are doing this. First, much of the industry is heavily reliant on Nvidia for the hardware the companies’ models run on, and Nvidia’s continued leverage there is a potential strategic vulnerability, especially as AI companies operate in an environment where compute infrastructure is highly competitive as demand continues to outstrip current capacity.

Second, designing chips for specific models and vice versa could lead to better performance. So, for example, if OpenAI can reap the rewards of that vertical integration, you can bet Anthropic and other frontier model providers will want that advantage as well.

To that point, Anthropic says its teams will co-design new hardware and models side by side. It has co-designed certain hardware with partners before, but the plan is now to bring more silicon expertise inside Anthropic itself.

Anthropic may also hope this could help its frontier models get some extra competitive edge as software developers and other users begin exploring running cheaper, smaller, or open-weight models on their own hardware or on edge devices.

However, since Anthropic is still in the process of hiring key team members, it will be some time before either the company or its users see any benefits.

Samuel Axon

Senior Editor

Samuel Axon

Senior Editor

Samuel Axon is the editorial lead for tech and gaming coverage at Ars Technica. He covers physical and generative AI, large language models, software development, gaming, entertainment, and mixed reality. He has been writing about gaming and technology for nearly two decades at Engadget, PC World, Mashable, Vice, Polygon, Wired, and others. He previously ran a marketing and PR agency in the gaming industry, led editorial for the TV network CBS, and worked on social media marketing strategy for Samsung Mobile at the creative agency SPCSHP. He also is an independent software and game developer for iOS, Windows, and other platforms, and he is a graduate of DePaul University, where he studied interactive media and software development.

14 Comments

Comments

Forum view

Loading comments...

Prev story

Next story

1.<br>This Atlantic hurricane season is looking like a dud, but there will be a price to pay

2.<br>Hank Green found the AI problem that YouTube labels can’t catch

3.<br>Reddit signals ominous upcoming "changes” for old.reddit.com

4.<br>Ford picks "Fathom" for its affordable truck name, starts at $28,350

5.<br>After jacking up prices, Disney+ and Netflix consider offering free alternatives

Customize