language-models

NLP evolved from hand-crafted rules to statistical models to deep learning. Modern language models write fluent text, yet what they understand is still debated.

What OpenAI disclosed about GPT-4, what it scored on exams and benchmarks, why next-token prediction got that far, where it still fails, and what replaced it.