Pretraining LLM

Code and Notebooks for the pretraining stage of the OpenThaiGPT model, developed by the project's volunteer team and published in the project's GitHub Organization

OpenThaiGPT GitHub Organization — Project Source Code and Notebooksgithub.com

For the next stages of model development, see InstructGPT Finetuning and Reinforcement Learning with Human Feedback (RLHF)