"Modern multimodal neural models also process images, audio, and video, whereas text-only language models learn primarily from recorded linguistic material."
OpenAI documents GPT-4o as a multimodal model trained across text, vision, and audio, with support for several input modalities. This establishes the distinction between language models dependent on textual records and architectures capable of processing other encoded representations of the world.
View Source