💬 Yandex: An Open-source Yet another Language Model 100B YaLM 100B is trained for 2 terabyte of text: dataset the Pile and web-pages, including not only Wikipedia, news articles, and books, but also Github and arxiv.org. Yandex has applied the generative neural networks YaLM in the recent Y1 search update. Now they are already helping to give answers to searches in Yandex and Alice. Github: https://github.com/yandex/YaLM-100B @ai_machinelearning_big_data