References

A Neural Probabilistic Language Model

Yoshua Bengio, Réjean Ducharme, Pascal Vincent, & Christian Jauvin (2003)

Journal of Machine Learning Research, 3, 1137-1155.

URL: https://jmlr.org/papers/v3/bengio03a.html

Abstract. Introduces the first neural probabilistic language model, which concatenates word embeddings of a fixed context window and passes them through a feedforward neural network to predict the next word. The paper introduced learned word embeddings into language modelling.

Tags: language-models embeddings nlm url-only

This site is currently in Beta. Contact: Chris Paton

Textbook of Usability · Textbook of Digital Health

Auckland Maths and Science Tutoring

AI tools used: Claude (research, coding, text), ChatGPT (diagrams, images), Grammarly (editing).