CONNECT WITH US
Fintech

Fintech

DeepSeek Open Sources Inference Tech to Lower AI Costs

PYMNTS – Fintech logo

Published on

Add as a preferred source on Google
DeepSeek Open Sources Inference Tech to Lower AI Costs

DeepSeek has made its in-house inference framework, DeepInfer, fully open source, saying this will help make artificial intelligence more affordable.

Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.

DeepInfer powers the company’s DeepSeek-V4.1-Flash model at scale with high throughput and low latency, DeepSeek said in a Tuesday (Oct. 20) post on X.

“We’re sharing our production stack to help the community lower compute costs, reduce energy use and make AI more affordable,” DeepSeek said in the post.

In a reply to its post, DeepSeek said the DeepInfer features high-performance kernels and an optimized inference engine, distributed inference and speculative decoding, and SWA Bounded Replay and structured outputs.

In another reply, DeepSeek said it is also open sourcing deepseek-recipe, the company’s production token encoding and decoding component that is aligned with the processing logic behind the official DeepSeek API to bring the same API behavior to community deployments.

Please add us to your preferred sources list so our news, data and interviews show up in your feed. Thanks!

“From private deployments to public clouds, we’ll keep working with the community to make large-scale inference more efficient,” DeepSeek said in a third reply to its initial post.

Bloomberg reported Tuesday that DeepSeek’s release of DeepInfer reveals how the company contains the cost of inference, or running advanced AI; offers a way for cloud and hosting companies running DeepSeek’s models to cut their own costs; and offers a model for developers to reduce the costs of running their own inferencing systems.


Source link
Related Topics:Fintech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.