"The path of language modelling is connected to our earlier protagonist Claude Shannon, whose work established a mathematical framework for analysing the statistical structure of communication."
Shannon's foundational paper examines communication as a statistical process and establishes the mathematical foundations of information theory. It provides an important historical connection between probabilistic descriptions of messages and the later development of statistical language modelling.
View Source