Related Paper / Knowledge

Instruction Following (InstructGPT)

Aligning language models to follow instructions — OpenAI blog postopenai.com

Training language models to follow instructions with human feedback — InstructGPT paper (arXiv 2203.02155)arxiv.org

LLM Size for Pre-training (Scaling Laws)

Scaling Laws for Neural Language Models (arXiv 2001.08361)arxiv.org

New Scaling Laws for Large Language Models — LessWrong articlelesswrong.com