A Survey of Large Language Models * General overview; * Listing by the number of parameters; * Commonly used corpora for training; * How pre-training can be done; * Typical architecture types; * How to fine-tune; * How to prompt; * Task possible to solve; * Evaluation setups; A very comprehensive survey: https://arxiv.org/abs/2303.18223