We demonstrate that BlackMamba performs competitively versus each Mamba and transformer baselines, and outperforms in inference and teaching FLOPs. We thoroughly train and open-resource 340M/1.5B and 630M/two.8B https://k2spiceshop.com/product/liquid-k2-on-paper-online/