CONNECT WITH US
Tech

Tech

DeepSeek Dials Up the Pressure on OpenAI and Anthropic With Open-Source Inference Tool

Gizmodo - Tech logo

Published on

Add as a preferred source on Google
DeepSeek Dials Up the Pressure on OpenAI and Anthropic With Open-Source Inference Tool

Not so long ago, many businesses were urging employees to use AI as much as humanly possible. But as AI bills have ballooned, token-maxxing has yielded to old-fashioned belt-tightening. The consulting giant Accenture, which earlier this year reportedly told senior staff they could either start using AI or kiss their chances of being promoted to leadership goodbye, recently ordered many employees to cap their monthly Claude spending to $29 per month, according to 404 Media.

AI developers are starting to get the memo: lower costs, or get left behind.

That pressure has grown thanks to the proliferation of powerful open-source models from China which are drastically cheaper to both train and run. And now DeepSeek—the Hangzhou-based startup that badly rattled Silicon Valley early last year with the release of its R1 model—is tightening the thumbscrews on OpenAI and Anthropic even more by making its in-house inference tool freely available on GitHub.

The tool, called DeepInfer, is currently only built to run DeepSeek’s own V4-1 Flash, a faster, more efficient, and cheaper version of the company’s flagship AI model. “We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable,” the company said in an X post. Future DeepSeek models will be added to the framework as they become publicly available, the company said in a follow-up post.

Inference, the process where a trained model is actually deployed to generate new outputs based on a prompt, is one of the most computationally expensive phases in the AI lifecycle.


Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.