References

Are Emergent Abilities of Large Language Models a Mirage?

Rylan Schaeffer, Brando Miranda, & Sanmi Koyejo (2023)

arXiv.

DOI: https://doi.org/10.48550/arxiv.2304.15004

Abstract. Argues that many reported emergent capabilities of LLMs are artefacts of nonlinear or discontinuous evaluation metrics. When the same tasks are scored with smooth metrics, emergent jumps typically dissolve into smooth, predictable improvements with scale.

Tags: scaling language-models emergence

This site is currently in Beta. Contact: Chris Paton

Textbook of Usability · Textbook of Digital Health

Auckland Maths and Science Tutoring

AI tools used: Claude (research, coding, text), ChatGPT (diagrams, images), Grammarly (editing).