Origins: before the web had an index
Before there was a "web" to search, the internet already had a discovery problem. Archie (1990) is generally credited as the first search engine, indexing filenames on public FTP servers, followed by WebCrawler (1994), the first engine to index full page text rather than just titles — the direct ancestor of how search engines still work today.
The directory era (1994–1998)
Before algorithms ranked the web, humans did. Yahoo!'s hand-curated directory competed against crawler-based engines like Lycos, Excite, and AltaVista, exposing the trade-off between accurate-but-unscalable human curation and scalable-but-exploitable algorithmic ranking.
Google and PageRank (1998–2000s)
Larry Page and Sergey Brin's PageRank, published in 1998, ranked pages by what the rest of the web said about them via links, rather than by what a page said about itself. It's the single most consequential idea in search history, and it created the SEO industry as a direct side effect.
The algorithm wars (2000s–2010s)
As link-based ranking became well understood, it also became exploitable. Panda (2011), Penguin (2012), Hummingbird (2013), RankBrain (2015), and BERT (2019) each closed a specific gap between what Google could measure and what it was actually trying to assess.
Mobile, local & voice search (2010s)
Mobile-first indexing, the rise of the Local Pack, and voice search through Siri, Alexa, and Google Assistant all forced search to optimize for a specific device and interaction context for the first time — a direct precursor to today's AI-visibility challenge.
The AI search era (2020s–today)
Google's AI Overviews, Perplexity, ChatGPT Search, and Microsoft Copilot have shifted search from ranked links toward synthesized answers, giving rise to AEO and GEO and an unresolved debate over publisher traffic and attribution.
Search engines that no longer exist
AltaVista, Infoseek, GoTo.com/Overture, Northern Light, Cuil, and, as of 2026, Ask Jeeves/Ask.com after nearly thirty years — a look at why general-purpose search engines shut down, and what their disappearance has in common.