CVCOVANewsComputing, Opportunities, Value & Analysis
Artificial Intelligence3 min read

DeepSeek unveils DeepInfer, the engine that will put its artificial intelligence models to work

The company laid out on X the components of DeepInfer, the system that makes its AI models generate responses, and said the code for its upcoming models will also land there.

By COVA News newsroom
A person holding a cell phone in their hand

Photo: Solen Feyissa on Unsplash

When someone asks an artificial intelligence assistant a question, all they see is the answer appearing on screen. Behind those words is largely invisible work: getting a huge model to respond quickly, without wasting computing power and without making formatting errors. On October 20, 2026, the artificial intelligence company DeepSeek showed on its X account how DeepInfer is built. DeepInfer is its inference engine, the software that runs an already trained model so it can answer.

The post is part of a four-post thread and summarizes what is inside the system. The first component is high-performance *kernels*, small, finely tuned programs that run calculations directly on the chips, paired with an optimized inference engine. It also includes distributed inference, which lets a model's workload be split across several machines, and speculative decoding, a technique that speeds up how responses are written: several words are proposed in advance and the main model checks whether to accept them, instead of generating them one by one.

Two more features round out the list. One is structured output generation, meaning responses that follow a fixed format, such as a table or a data form, so other programs can read them without confusion. The other is something DeepSeek calls "SWA Bounded Replay," a name the post does not explain and whose workings will have to be found in the documentation.

The most striking line in the post is the last one. The company says the inference code for its future models, along with the optimizations it continues to make, will also come to DeepInfer. That does not announce a new model or give any dates, but it shows that DeepSeek wants to bring together in one place the way to run whatever it releases going forward.

There are questions this post does not answer. Because it is the second part of a thread, it does not include a link to the project, nor does it clarify whether the code will be open to everyone, what license it will be distributed under, what hardware it requires or how fast it is compared with other tools. Nor are there any performance figures or independent tests to back up the "high-performance" claim.

For the scientific and technical community, the interest lies in DeepSeek showing machinery that usually stays hidden. If the project turns out to be accessible, researchers and developers in Latin America could study and use these techniques to run models with fewer resources. What is worth watching now is the rest of the thread, the documentation and, above all, the license.

Source: DeepSeek on X

Related news

Artificial Intelligence

Mathematician says he has proved the Riemann hypothesis with help from Claude; it still needs to be verified

Levent Alpöge has published a purported proof of one of the most famous problems in mathematics, produced together with Anthropic's AI. Early reviews are encouraging, but the community has not yet validated it.

Artificial Intelligence

OpenAI cuts GPT-6.2 Astra API pricing by 20%: what changes for those paying in dollars

OpenAI launched GPT-6.2 Astra and GPT-6.2 Sol. The flagship model's usage-based pricing drops, but the cheaper model's stays the same, and the fine print will determine how much users in Latin America actually save.

Artificial Intelligence

Nvidia reports earnings without Jensen Huang: what's at stake for AI chips

Five days after its founder's resignation, the company that dominates artificial intelligence chips faces Wall Street. For Latin America, open questions outweigh measurable effects for now.