Efficient Methods for Natural Language Processing: A Survey
In the raise of big models and big data required for its training, it is important to know which techniques can help you to optimize your models cooking🍳,
The paper described different efficiency helping methods for each step of models preparing:
1. Data collection & Preprocessing.
2. Models Design.
3. Pre-training.
4. Fine-tuning.
5. Inference.
6. Model selection.
Paper [here].