LATEST DEVELOPMENT
Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta
Meta's Muse Spark Open is an open-weight multimodal mixture-of-experts model with roughly 816B total and 42B active parameters per token, 256 experts per layer and a 1M-token context window. It accepts text, images, audio and video but generates text; the BF16 weights alone occupy around 1.5 TB.
Open latest signal ↗