BigScience Large Open-science Open-access Multilingual Language Model
Or just BLOOM🌸
New multilingual autoregressive Large Language Model. Main info:
* Base model: Megatron-LM GPT2;
* Architecture: decoder-only;
* N parameters: 176B (in comparison: for example, mBART-cc25 has 610M parameters);
* N languages: 59;
* How can be used?: text generation or exploration of languages characteristics and dependencies;
All other details and the model itself can be found in 🤗 here.
🌼🌸🌺Enjoy🌼🌸🌺