Home Telecom Anthropic to make use of Google chips for its giant language mannequin

Anthropic to make use of Google chips for its giant language mannequin

0
Anthropic to make use of Google chips for its giant language mannequin

[ad_1]

Google not too long ago invested $2 billion in Anthropic

San Francisco-based generative AI startup Anthropic has revealed that it is going to be one of many first firms to deploy new AI chips from Google. The announcement comes only a few weeks after Google confirmed a $2 billion funding within the startup.

Anthropic, thought of a critical rival to ChatGPT creator OpenAI, will use Google Cloud’s latest TPU v5e chips in its Claude giant language mannequin (LLM). Claude 2, in line with Anthropic, is a chatbot with the power to summarize as much as about 75,000 phrases — in comparison with Chat GPT’s 3,000 phrases.

Google said in a press launch that its Cloud TPU v5e is designed to ship the “cost-efficiency and efficiency required for medium- and large-scale coaching and inference,” and delivers 2.3x larger coaching efficiency per greenback relative to the prior era. On latency, Cloud TPU v5e reportedly achieves as much as 1.7x speedup in comparison with TPU v4, as proven within the graph beneath.

Google Inside Information. August 2023. Precision: Llama 2 7B, 13B and 70B: int8; GPT-3 175B: bf16.

The brand new chips, continued the corporate, will allow Anthropic to scale its LLMs past the bodily boundaries of a single TPU pod — “as much as tens of 1000’s of interconnected chips.” The AI firm can be now utilizing Google Cloud’s safety providers as a part of the collaboration.

“Anthropic and Google Cloud share the identical values in terms of creating AI–it must be completed in each a daring and accountable method,” mentioned Thomas Kurian, CEO of Google Cloud. “This expanded partnership with Anthropic, constructed on years of working collectively, will convey AI to extra individuals safely and securely, and offers one other instance of how essentially the most progressive and quickest rising AI startups are constructing on Google Cloud.”

Along with the Google Cloud funding, Anthropic additionally secured a $4 billion from Amazon in September the pair introduced strategic partnership, a partnership that may see Anthropic use AWS Trainium and Inferentia chips to construct, prepare and deploy its future basis fashions, whereas AWS will turn out to be Anthropic’s main cloud supplier for mission vital workloads, together with security analysis and future basis mannequin growth. 

Extra particulars about Google’s funding in Anthropic stay scarce; nevertheless, it has been reported that Google’s funding contains $500 million upfront, and that in April the tech large invested a whole lot of tens of millions into the Anthropic for what was then a ten% stake.

For extra about Google’s cloud and AI efforts, obtain the Google Cloud Subsequent ’23 in Overview report.

[ad_2]

LEAVE A REPLY

Please enter your comment!
Please enter your name here