extreme-bert/extreme-bert ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”. Language: Python #bert #deep_learning #language_model #language_models #machine_learning #natural_language_processing #nlp #python #pytorch #transformer Stars: 135 Issues: 0 Forks: 5 https://github.com/extreme-bert/extreme-bert