Table of Contents 01 Introduction 02 Model Architecture 03 Pre-training 04 Evaluation 05 Quick Start 06 Conclusion and Outlook 07 Citation 1. Introduction A base model is valuable both for the capabilities that pre-training builds and for the starting...