Tag: #moe

AMD publishes detailed Instella‑MoE technical report; weights licensed for research use

AMD published a detailed technical report and checkpoints for Instella‑MoE, a 16B MoE model trained on its Instinct GPUs — but model weights are licensed for research only.

$AMD, #amd, #ai, #moe, #openmodels

NVIDIA open-sources Nemotron 3 Super, a 120B Mixture-of-Experts LLM tuned for its GPUs

NVIDIA released Nemotron 3 Super, a 120B Mixture-of-Experts hybrid Mamba‑Transformer LLM with a 1M‑token context, open checkpoints and GPU‑optimized formats.

$NVDA, #nvidia, #ai, #llm, #moe