What WebCrawler is today, and where its results come from
WebCrawler is a search website owned by System1, Inc., an American advertising company, and operated through its subsidiary InfoSpace Holdings LLC. Type a query and you get a results page that merges listings drawn from outside search feeds with paid listings, under tabs for web, images, video and news. What you do not get is anything WebCrawler found for itself.
That is what the verdict at the top of this page means. WebCrawler has not run a crawler — the automated program that fetches pages so an engine can store and rank them — or maintained an index of its own — the engine's stored copy of the web — since 2001. In that year InfoSpace acquired it out of the Excite@Home collapse and switched it to serving Excite's database. Wikipedia's account of the change is blunt: it "effectively put an end to WebCrawler as an independent search engine."
The irony is hard to miss, and it is the reason this page exists. The site named after the first full-text web crawler no longer crawls anything.
One more structural fact worth having before anything else: WebCrawler is not a competitor to Dogpile or MetaCrawler. All three have been owned by the same company since the early 2000s and are System1 properties today — three brands, three skins, one corporate infrastructure.
The first full-text search engine — and what that claim does not say
WebCrawler was built by Brian Pinkerton at the University of Washington. On 15 March 1994 his crawler produced its first output, a list of the top 25 websites. On 21 April 1994 WebCrawler went public with an index of just over 4,000 sites. On 14 November 1994 it served its one-millionth query — a figure that originates in Pinkerton's own accounts and is repeated by Wikipedia, so treat it as well-attested rather than independently audited. A mascot, "Spidey," arrived on 1 September 1995.
Here is the precise claim, and precision matters because the imprecise version is everywhere: WebCrawler was the first web search engine to provide full-text search of the pages it indexed. It was not the first search engine, and it was not the first crawler.
The tools that came before it indexed something much thinner than page content:
- Archie (1990) indexed filenames on public FTP servers.
- ALIWEB (1993) indexed descriptions that site owners submitted themselves.
- JumpStation and the World Wide Web Worm (1993–94) indexed titles, headings and URLs.
Pinkerton's contribution was to download each page and index the whole of its text, so a query could match words buried in the body of a document that nobody had bothered to describe. Every general web search engine since — AltaVista, Google, Bing — is built on that model. If you are citing WebCrawler as a first, cite it for that, with the words "full-text" in the sentence. Without them the claim is simply wrong.
How it gets its results now
From 1994 to 2001, WebCrawler ran its own crawler and its own full-text index, using software Pinkerton wrote. The original crawler's user-agent string — the identifier a bot sends to the sites it visits — is not documented in any source consulted for this page, so nobody should quote one.
From 2001 the arrangement inverted. WebCrawler became a front end over syndicated feeds: it buys results rather than gathering them. That has been its architecture under InfoSpace, under Blucora and under System1 for around a quarter of a century, which is now far longer than it spent as a real engine.
Whose feeds? That is not published. WebCrawler does not disclose its suppliers, System1 does not break out syndication contracts by property, and the safest accurate statement is the structural one: no index of its own, results sourced from outside suppliers, mixed with paid listings. Its sibling MetaCrawler does carry a public feed claim on its About page, naming Google and Yahoo! Search — but that page also names Truveo, a video service shut down years ago, so it plainly is not maintained and it describes a different property in any case. Do not assume it applies here.
A 2018 redesign gave the site a new look and a new logo. It was cosmetic. Nothing about it restored an index.
The practical consequence for a reader is simple: when you search WebCrawler you cannot tell whose ranking you are looking at, how much of the page is paid, or how fresh the underlying crawl is, because none of those things are yours or WebCrawler's to control.
Who owns it: from AOL to System1, with dates
WebCrawler has changed hands more often than almost any other surviving search brand, and the chain explains everything about its current form.
- 1994–1995 — Brian Pinkerton and the University of Washington; the project moves onto a commercial footing with him.
- 1 June 1995 — acquired by America Online, becoming AOL's search offering.
- 1 April 1997 — AOL sells WebCrawler to Excite for $12.3 million, having struck a portal deal with Excite instead. WebCrawler runs on as a secondary brand.
- 2001 — the Excite@Home bankruptcy. InfoSpace, Inc. acquires WebCrawler and points it at Excite's database. This is the end of WebCrawler as an independent engine.
- June 2012 — InfoSpace, Inc. renames itself Blucora after moving into tax software; the search properties become a segment of a company rather than its identity, held in an InfoSpace subsidiary.
- July 2016 — Blucora sells InfoSpace, and with it WebCrawler, Dogpile and MetaCrawler, to OpenMail LLC for $45 million cash. That price, for the whole portfolio, is the clearest measure of what these brands were worth by then.
- 2017 — OpenMail renames itself System1.
- January 2022 — System1 lists on the New York Stock Exchange as SST, via a merger with the Trebia Acquisition Corp. blank-cheque vehicle.
Two traps in that list. First, "InfoSpace" today is not the 1990s dot-com: the original InfoSpace, Inc. became Blucora in 2012 and sold the search business in 2016, and InfoSpace Holdings LLC is a System1 subsidiary that inherited the name. Second, AOL did not build WebCrawler; it bought it a year after launch.
How it makes money
Advertising, and only advertising. Paid search listings and display advertising on the results page, monetised through System1's advertising and search-syndication arrangements. There is no subscription tier and no consumer API.
System1's business, described in its own public filings, is buying traffic and monetising it across an owned-and-operated portfolio of search and content websites. WebCrawler is one property in that portfolio. This is worth stating plainly because it determines what the product is optimised for: the incentive of an arbitrage property is the yield of the results page, not the relevance of position four.
It also explains the disclosure gap. An engine that competes on index quality has a reason to tell you about its index. An engine that competes on monetisation has no particular reason to tell you anything, and WebCrawler does not — neither the feed sources nor the proportion of the page that is paid.
Privacy and data handling
WebCrawler makes no privacy claim at all. It is not marketed as a privacy tool, it publishes no search-specific privacy policy, and it states no no-logging commitment. Privacy is governed by System1's general corporate policy, and the site sits under United States jurisdiction and United States legal process.
That is the honest summary, and it is not a scandal — it is simply what an advertising company's search property is. Anyone choosing an engine on privacy grounds should read it as a straightforward disqualification rather than as an accusation.
For the record, WebCrawler was named alongside Dogpile, MetaCrawler and Startpage in November 2019 commentary about data flowing into System1's advertising infrastructure. That was advocacy writing, not a regulatory finding, and it should be weighted accordingly. The corporate facts underneath it are documented and undisputed: System1 owns all three legacy search brands, and System1's Privacy One Group acquired a majority stake in Startpage in October 2019. No regulatory enforcement action against WebCrawler was found.
Who it suits, and who it does not
What it is still good for. Very little that involves searching, and quite a lot that involves history. WebCrawler is the original full-text search engine's brand, still reachable at its own domain more than thirty years after launch, which makes it a legitimate object of interest for anyone studying how search began. As a working tool it is fast, uncluttered and will return plausible results for ordinary commercial queries.
What it is bad at. Everything that requires owning an index. No crawl, so no control over coverage or freshness. No reliable advanced operators. No transparency about whose results you are seeing or how heavily paid inventory is mixed in. No privacy posture. No AI layer of any kind — none has been announced as of August 2026.
Who should look elsewhere. If you want an index that is genuinely independent of Google and Bing, that is Mojeek or Brave, not WebCrawler. If you want privacy, this is the wrong category of product entirely. If you are doing research and need to know where a result came from, an engine that will not name its suppliers cannot serve you.
Recommending WebCrawler in 2026 as a "search engine alternative" is a category error. It is a reseller with a famous name, and the fame is the only thing about it that is still first-rate.
Common misconceptions
"WebCrawler still crawls the web." It has not since 2001. The name is now purely historical, and because the name literally says "crawler" this error is made constantly — including by list articles that ought to know better.
"WebCrawler was the first search engine." No. It was the first full-text web search engine. Archie, ALIWEB, JumpStation and the World Wide Web Worm all predate it and all indexed metadata rather than page bodies.
"It shut down years ago." The website is live as of 19 August 2026. What ended in 2001 was its independence, not its domain. Two different events, two different dates.
"WebCrawler competes with Dogpile and MetaCrawler." They are sister properties with a shared owner and shared infrastructure. Comparing them is comparing three skins.
"InfoSpace still owns it, so it is the original 1990s company." Same brand string, different company. See the ownership chain above.
"AOL built it." Pinkerton built it at the University of Washington. AOL bought it on 1 June 1995, more than a year after launch.
Frequently asked questions
Was WebCrawler the first search engine?
No. WebCrawler was the first web search engine to offer full-text search of the pages it indexed, which is a narrower and more interesting claim. Archie appeared in 1990 and indexed FTP filenames; ALIWEB in 1993 indexed owner-submitted descriptions; JumpStation and the World Wide Web Worm indexed titles and URLs. Pinkerton's innovation, launched 21 April 1994, was indexing the entire body text of every page fetched.
Does WebCrawler still crawl the web?
No. WebCrawler has not operated a crawler or an index since 2001, when InfoSpace acquired it out of the Excite@Home bankruptcy and switched it to serving Excite's database. Everything it shows you today comes from outside search feeds and paid listings. The name describes what the software did in the 1990s, not what the website does now.
Who owns WebCrawler?
InfoSpace Holdings LLC, a subsidiary of System1, Inc., an advertising company based in Marina del Rey, California. The chain runs: Brian Pinkerton and the University of Washington, then AOL in June 1995, Excite in April 1997, InfoSpace in 2001, Blucora from June 2012, OpenMail in July 2016 for $45 million, and System1 from 2017. System1 has been listed on the NYSE as SST since January 2022.
Where do WebCrawler's results come from?
From third-party search feeds that WebCrawler does not name, plus paid listings. System1 does not disclose its syndication contracts by property, so no honest page can tell you which upstream engine you are actually reading. What is certain is the structural fact: there is no WebCrawler index, and there has not been one since 2001.
Is WebCrawler the same company as Dogpile and MetaCrawler?
Yes, in every way that matters. All three are System1 properties operated through InfoSpace Holdings LLC, and they have shared an owner since the early 2000s. They differ in branding and interface, not in ownership, business model or the underlying arrangement of buying results rather than crawling for them. Treating them as three independent alternatives is a mistake.
Is WebCrawler shut down?
No. The site was live and serving results as of 19 August 2026, and it carries System1's corporate branding. The confusion comes from conflating two events: WebCrawler ceased to be an independent search engine in 2001, but the domain has run continuously since, including a cosmetic redesign with a new logo in 2018.
Is WebCrawler a private search engine?
No, and it does not claim to be. WebCrawler publishes no search-specific privacy policy and makes no no-logging commitment; users fall under System1's general corporate privacy policy and United States jurisdiction. Anyone selecting an engine for privacy reasons should discount it immediately. That is a description of the product category, not an allegation about its conduct.