DeepSeek open-sources DeepInfer, the inference framework behind its production services
Posted
Duncan Riley (via SiliconANGLE)
Chinese artificial intelligence startup Hangzhou DeepSeek Artificial Intelligence Basic Technology Research Co. Ltd. today open-sourced DeepInfer, the inference framework behind its own production services. The release takes on the cost of serving large models to the public. DeepSeek calls reaching a massive user base at a reasonable price “the core problem an inference framework has […]