1995–, Computer scientist
Jason Wei is an American computer scientist whose 2022 paper at Google Brain Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (with Wang, Schuurmans, Bosma, Ichter, Xia, Chi, Le and Zhou) introduced chain-of-thought (CoT) prompting: prompting an LLM to "think step by step" before answering, which dramatically improves performance on reasoning-heavy tasks. The paper has been cited tens of thousands of times and is one of the foundational works of modern LLM prompting practice.
Wei's earlier paper Emergent Abilities of Large Language Models (2022, with colleagues at Google) catalogued capabilities that appear sharply at certain model scales. He moved to OpenAI in 2023 and contributed to the o1 reasoning-model line.
Video
Related people: Tom Brown, Alec Radford
Works cited in this book:
- PaLM: Scaling Language Modeling with Pathways (2022) (with Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel)
- Emergent Abilities of Large Language Models (2022) (with Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus)
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (2022) (with Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, Denny Zhou)
- Self-Consistency Improves Chain of Thought Reasoning in Language Models (2022) (with Xuezhi Wang, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, Denny Zhou)
Discussed in:
- Chapter 15: Modern AI, Modern AI