Technology ❯ Artificial Intelligence ❯ Model Architecture

Mixture of Experts

Performance Metrics Inference Efficiency Resource Optimization Multimodal Models Sparse Models Efficiency Scalability Context Length Parameter Efficiency Parameters Gemma 4 Inference Cost Performance Optimization Contextual Memory Kimi 3 Compressed Sparse Attention

DeepSeek Launches V4.1‑Flash, a Native Multimodal MoE Model Built for Speed and Low Cost

DeepSeek hopes to force down AI inference costs with a sparse Mixture‑of‑Experts design as it moves toward a STAR Market IPO.

Xiaomi Open‑Sources Two Agent Platforms: SoloEngine and MiMo Code

Gemma 4 Goes Local With Tool Calling on Phones and Apple Silicon

Alibaba Deprecates Hybrid Mode in Qwen3, Launches Dedicated Instruct and Thinking Models