Tag

#inference

5 articles

AI chip startup Rebellions raises $400 million at $2.3B valuation in pre-IPO round

AI chip startup Rebellions raises $400 million at $2.3B valuation, positioning itself as a challenger to Nvidia's dominance in AI inference hardware.

Mar 3027

tech

GTC 2026: With Groq 3 LPX, Nvidia adds dedicated inference hardware to its platform for the first time

Learn how to deploy machine learning models on Nvidia's new Vera Rubin platform with dedicated Groq 3 LPX inference chips using Docker containers and ONNX export.

Mar 1733

tech

Meta unveils four generations of custom AI chips to cut inference costs for billions of users

Meta has unveiled four new generations of custom AI chips aimed at reducing inference costs and decreasing reliance on external GPU suppliers like Nvidia and AMD.

Mar 1236

DeepSeek Signals Next-Gen R2 Model, Unveils Novel Approach to Scaling Inference with SPCT

Learn about SPCT (Sparse Prompt Compression Technique), a new method developed by DeepSeek AI that improves the scalability of reward models during inference, making AI systems more efficient and cost-effective.

Feb 2768

Taalas is replacing programmable GPUs with hardwired AI chips to achieve 17,000 tokens per second for ubiquitous inference

Toronto startup Taalas is pioneering hardwired AI chips that can process 17,000 tokens per second, challenging the dominance of programmable GPUs in AI inference.

Feb 2337