Technology ❯ Artificial Intelligence ❯ Machine Learning

Model Architecture

Mixture-of-Experts Mixture of Experts Transformer Models Gemma 4 Encoder-Decoder Models Vision-Language Models World Models Sparse Attention Mechanism Multimodal Models ExplicitLM

JetBrains Open-Sources Mellum2, a 12B Mixture-of-Experts Model

The model ships under the Apache 2.0 license for private deployment, positioned as a fast focal model for routing, retrieval, and sub-agent tasks.

NVIDIA Releases Nemotron‑Labs Diffusion With Three Decoding Modes in One Checkpoint

Gemma 4 Emerges as a Local-First Alternative to Cloud AI

MoE Research Delivers New Playbooks for Design, Routing, and Real-World Deployment

Thinking Machines Introduces Interaction Models for Real-Time, Multimodal AI

DeepSeek Releases Multimodal Model, Pitches 'Visual Primitives' for Spatial Reasoning

Nvidia Launches Nemotron 3 Super, an Open 120B Model for Agentic, Long‑Context AI

RAG Shifts From Vector Similarity to Reasoning-Driven Retrieval

Moonshot AI Releases Open-Source Kimi K2.5 With Visual Coding and Agent Swarm

Qwen3-TTS Launches as Open-Source, Low-Latency Multilingual TTS With 3-Second Voice Cloning

DeepSeek Publishes 'Engram' Conditional Memory for LLMs With Reported Gains Over MoE

DeepSeek Publishes mHC to Stabilize Wider Residual Streams in LLMs

Google Releases T5Gemma 2, a Compact Multimodal Encoder-Decoder With 128K Context

Ant Releases LLaDA2.0, Open-Sourcing a Claimed First 100B Diffusion Language Model

Black Forest Labs Debuts FLUX.2, Advanced Image Models With Open Weights and Managed APIs

Ilya Sutskever Says AI’s Scale-First Phase Has Peaked, Urges a Return to Research

Meituan’s LongCat Team Open-Sources LongCat-Video, a Unified Model for Long-Form Video Generation

DeepSeek-OCR Turns Text Into Images to Slash Context Tokens

DeepSeek Open-Sources OCR System That Compresses LLM Contexts With Visual Tokens

DeepSeek-AI Open-Sources 3B DeepSeek-OCR to Compress Visual Context for Long-Document OCR