A review of the Architectural Journey of LLMs: Key Milestones from 2017 to Present Day

GenAI Series: Part1: Foundational Content -> Because, Knowing your History is Important

Large language models (LLMs) have revolutionized artificial intelligence, transforming how we interact with technology across countless domains. I am amazed at how much the ML world has changed from the time chatGPT launched. How we think about models, deployment, and maintainance has all changed. LLMs’ journey from academic research to mainstream applications represents one of the most significant technological evolutions of our time.

But it has honestly been hard to keep up.

In this blog post, I'll trace the fascinating development of LLMs, highlighting key architectural and model innovations, scaling breakthroughs, and performance advances that have shaped today's most powerful AI systems.

This post is going to be long and will go (almost) over all the most important models that I have seen coming up.