It is difficult now to imagine using the web without starting with a search box. If I want to know something, find a particular site, look up a product, or locate an obscure bit of technical information, search is usually the obvious first step.
That was not always how the web worked.
Before Google became dominant, finding things online was a mixture of search engines, human-edited directories, bookmarks, links from other websites, recommendations from people, and a certain amount of wandering around to see what turned up. None of these methods was as comprehensive or efficient as modern search, but together they produced a very different way of discovering the Internet.
The interesting part is not whether that older system was better. In many ways it clearly was not. The interesting part is how people found their way through a web that had not yet developed one overwhelmingly dominant method of discovery.
The Web Needed a Map
The early web was small by modern standards, but it grew quickly enough that simply knowing where useful sites were became a problem.
One early answer was the directory.
Yahoo is probably the most famous example. It began in 1994 as a collection of websites assembled by Stanford graduate students Jerry Yang and David Filo and evolved into a hierarchical directory organized by subject. Instead of typing a question into a search box, you could browse through categories and subcategories until you reached a collection of relevant sites.
The concept was closer to a library catalog or the Yellow Pages than to a modern search engine. If you were interested in computers, for example, you might start with Computers and Internet, then work your way into operating systems, networking, programming, or whatever narrower category seemed promising.
That structure imposed some order on the web. It also meant that human judgment was part of the process because someone had to decide which sites deserved inclusion and where they belonged.
Human Curation Worked Better Than It Sounds
A manually maintained directory sounds almost absurd when applied to the modern web. There are far too many sites and pages for a group of editors to catalog in any meaningful way.
On a smaller web, though, the idea was practical enough to become important.
Yahoo was not the only example. The Open Directory Project, commonly known as DMOZ, launched in 1998 and relied on volunteer editors to maintain categorized lists of websites. At its eventual scale, tens of thousands of editors had contributed to millions of listings across a huge range of subjects.
Human curation had obvious limitations. Editors could overlook good sites, make bad choices, favor certain subjects, or take a long time to review submissions. A directory could never keep up forever with an exponentially growing web.
Still, there was one useful characteristic to the model: a directory was trying to answer a slightly different question from a search engine.
A search engine asks, more or less, “Which pages appear to match this query?” A directory asks, “What useful sites exist in this subject?”
Those are related questions, but they are not identical.
Search Engines Were Already There
Google did not invent web search.
By the mid-1990s there were numerous search engines competing for users, including WebCrawler, Lycos, Infoseek, Excite, AltaVista, HotBot, and others. WebCrawler and Lycos were among the early systems to gain widespread use, while AltaVista, launched by Digital Equipment Corporation in December 1995, became especially well known for fast full-text searching across a large index of web pages.
The experience could be uneven. Search engines had different indexes, different ranking methods, and different strengths. A query that produced poor results in one engine might work much better in another.
That encouraged people to know several of them.
You might search AltaVista first, try Lycos if that did not work, then go to Yahoo and browse its directory. Metasearch engines such as MetaCrawler and Dogpile appeared partly because there was value in querying multiple search services rather than assuming that one of them had the definitive answer.
The idea that one search engine would become the nearly universal front door to the web had not yet settled in.
AltaVista Felt Remarkably Powerful
AltaVista deserves some attention because it demonstrated how useful large-scale full-text search could be before Google arrived.
At a time when directories were still important, AltaVista indexed large numbers of web pages and allowed users to search the actual text within them. That made the web feel much larger but also much more reachable.
There was suddenly less need for someone to have placed a site into exactly the right category before you could discover it. If the words you were looking for appeared on a page and the search engine had indexed it, there was a chance you could find it.
That model scaled far better than hand-built directories.
It also created a different problem: finding pages was one thing, but deciding which results were actually useful was another.
As the web expanded, relevance became increasingly important.
Google Changed Ranking More Than Searching
Google’s important innovation was not that it provided a text box where people could search the web. That idea was already well established.
What Google did unusually well was rank the results.
Larry Page and Sergey Brin’s PageRank approach treated links between web pages as useful evidence. A link represented, at least in part, one site’s judgment that another page was worth referencing. By analyzing those relationships at web scale, Google could often put more useful pages nearer the top of the results.
This solved one of the central problems of the growing web. Search engines were getting better at finding pages containing the right words, but users did not need ten thousand matches. They needed the ten most useful ones.
Google was remarkably good at that.
Once search became reliable enough, some of the older discovery methods became less necessary. Browsing through several levels of a directory was slower than typing a few words and immediately getting a useful result.
The directory model eventually lost that contest. Yahoo retired its directory at the end of 2014, twenty years after it had begun as one of the defining ways people navigated the web.
Bookmarks Were More Important Than They Look Now
Finding a useful site was only half the problem. You also needed a way to get back to it.
Bookmarks, or favorites depending on the browser, were far more important when people routinely visited individual websites rather than relying on a search engine or social platform to rediscover them.
A good bookmark collection could become a personal directory of the web.
You might have folders for news, technical references, software, hobbies, shopping, friends’ pages, research, or anything else you returned to regularly. The organization was entirely yours, and over time it reflected the small portion of the web that mattered to you.
Bookmarks were especially useful because URLs were not always memorable. Once you had located a good reference site, there was little reason to repeat the search process every time you needed it.
The browser therefore became part navigation tool and part personal catalog.
Today I suspect many people use bookmarks less aggressively because search is so convenient. Why carefully organize a hundred links if typing the site’s name into a browser brings it back almost immediately?
That convenience is real, although something changes when your personal map of the web gets replaced by repeated searches.
Websites Helped You Find Other Websites
One of the more noticeable features of older personal websites was the links page.
People maintained lists of websites they found useful or interesting. Some were carefully categorized, while others were simply a collection of places the site’s author liked.
These pages served no algorithmic purpose. Someone had visited those sites, decided they were worth sharing, and put links to them on a page.
That could be surprisingly useful.
If I found a website devoted to a subject I cared about and the person maintaining it clearly knew what he was talking about, his links page was often worth exploring. One good site could lead to several others, which could lead somewhere else entirely.
The process was inefficient in the best sense of the word. You were not always traveling directly toward a specific answer. Sometimes you were following someone else’s trail through the web.
That sort of browsing was an important form of discovery.
Webrings Made the Links More Formal
Webrings turned that informal linking into something more structured.
Sites covering a common subject could join a ring and include navigation links that moved visitors to the next or previous participating site. A visitor interested in one Amiga site, genealogy page, science-fiction fan site, or photography page could continue through other independent sites covering similar territory.
The mechanism was primitive by modern standards, but it solved a real problem. Small websites needed ways to become discoverable without depending entirely on search engines.
A webring provided a neighborhood of sorts.
The quality naturally varied because membership did not guarantee that every site would be good. Broken links and abandoned pages were constant hazards as sites moved or disappeared.
Still, the ring reflected a useful assumption: people interested in one independent site might also be interested in others made by people in the same community.
Word of Mouth Was Part of the Internet
Not all Internet discovery happened on the web itself.
People recommended websites in email, mailing lists, Usenet groups, IRC channels, BBS discussions, magazines, books, television programs, and ordinary conversation. Printed magazines routinely published URLs, often with the full http:// prefix because the web was still unfamiliar enough that readers needed to know what they were looking at.
A recommendation carried context that a search result often did not.
Someone might say, “This is the best site I’ve found for Linux hardware compatibility,” or “There is a fellow maintaining an excellent collection of old radio manuals here.” The recommendation told you something about why the site was worth visiting.
Online communities were particularly good at this because they gathered people with specialized knowledge. Someone in a technical mailing list or Usenet group might know exactly where a particular document, driver, FAQ, or obscure piece of software could be found.
In that environment, finding things was often a social process as well as a technical one.
FAQs Were Discovery Tools Too
Frequently Asked Questions documents played a related role.
A good FAQ did more than answer common questions. It often pointed readers toward software archives, reference material, documentation, related websites, mailing lists, books, and other resources.
Some FAQs effectively became maps of an entire subject.
This worked because they were maintained by people who had already spent time in the community. Instead of asking every newcomer to reconstruct the same body of knowledge from scratch, the FAQ collected what experienced users had learned.
Search engines eventually made individual answers easier to locate, but they did not necessarily provide the same sense of how a subject fit together.
A curated document could tell you not only where to look but what was worth knowing.
Discovery Was More Intentional
The biggest difference between then and now may be the amount of intention involved.
If you opened a web directory, followed a link from someone’s homepage, checked a bookmark folder, or read recommendations in a mailing list, you were making fairly explicit choices about where to go next.
Even search involved a deliberate query.
Modern online discovery often happens differently. Social feeds, video platforms, news applications, and recommendation systems continuously select material on the user’s behalf. You no longer have to decide what to look for before something appears.
That is enormously convenient and sometimes genuinely useful. Recommendation systems can expose people to material they would never have known to search for.
But that is a different form of discovery from browsing a directory or following someone’s links page.
One begins with “What am I looking for?” The other can begin with “What does the system think will keep me interested?”
There is no need to turn that difference into a morality play. Both approaches can produce valuable discoveries, and the old web certainly contained plenty of junk.
The important point is that the mechanism changed.
Early Discovery Had Serious Problems
It would be easy to romanticize the pre-Google web, particularly for those of us who remember using it. That would ignore why search improved so rapidly.
Directories could not scale indefinitely. Search engines returned piles of irrelevant results. Dead links were everywhere. Sites disappeared without forwarding addresses. Bookmark collections became unmanageable. Finding obscure information sometimes required trying several search engines and multiple variations of a query.
You could also simply fail.
The information might exist somewhere, but there was no guarantee you would find it. A poorly titled page on a small site could remain practically invisible.
Modern search solved a great deal of that. Google became dominant because it was extraordinarily useful, not because millions of people suddenly decided that human-curated directories were philosophically objectionable.
When a technology makes something noticeably easier, people tend to use it.
What We Lost Was Variety
What I find interesting about the earlier period is not that any individual discovery method was superior. It is that there were so many of them.
A directory helped you browse a subject. A search engine helped you locate pages containing particular information. A links page let you borrow someone else’s judgment. A bookmark collection preserved your own. A mailing list or discussion group could provide recommendations from people who knew the subject. A webring connected independent sites that might otherwise have been difficult to find.
These methods overlapped, but they were not interchangeable.
Gradually, search became good enough that many of them stopped being necessary for routine use. Later, social platforms and recommendation systems added another layer, increasingly bringing material to users instead of waiting for users to go looking for it.
The web became easier to navigate, but the paths became more concentrated.
Finding Things Is Not the Same as Discovering Them
Search engines are excellent when I know enough to ask for something.
Discovery is a little different.
Sometimes I do not know what I am looking for because I do not yet know it exists. A human-edited directory, a good links page, a knowledgeable person’s recommendation, or a collection of bookmarks can expose relationships that a specific search query never would.
That distinction still matters.
We have not completely lost the older methods. People share links in forums and group chats. Curated newsletters point readers toward interesting material. Personal sites maintain blogrolls. People publish lists of favorite tools and resources. Directories and webrings have even survived in corners of the independent web.
They are no longer the primary navigation system of the Internet, but the underlying idea remains useful: sometimes the best guide to interesting material is another person who has already spent time looking.
Google made finding information dramatically easier. It did not invent online discovery, and it did not make every older form of discovery pointless.
Before one search box became the obvious place to begin, we found our way around through a collection of tools, people, lists, links, and accumulated knowledge. It was messier and less efficient, but it also made the act of finding something feel less like consulting a universal index and more like navigating a very large, loosely connected collection of places.