Tag

#MoE

3 articles

A Coding Implementation on Qwen 3.6-35B-A3B Covering Multimodal Inference, Thinking Control, Tool Calling, MoE Routing, RAG, and Session Persistence

This article explains the advanced AI concepts behind Qwen 3.6-35B-A3B, a multimodal model that combines MoE routing, RAG, and session persistence for intelligent, context-aware AI applications.

Apr 2027

Qwen Team Open-Sources Qwen3.6-35B-A3B: A Sparse MoE Vision-Language Model with 3B Active Parameters and Agentic Coding Capabilities

Alibaba's Qwen team open-sources Qwen3.6-35B-A3B, a sparse MoE vision-language model with 3B active parameters and agentic coding capabilities.

Apr 1635

NVIDIA Releases Nemotron-Cascade 2: An Open 30B MoE with 3B Active Parameters, Delivering Better Reasoning and Strong Agentic Capabilities

This explainer article dives into NVIDIA's Nemotron-Cascade 2, an advanced Mixture-of-Experts (MoE) model that demonstrates how strategic parameter allocation can enhance reasoning capabilities while maintaining computational efficiency.

Mar 2070