Archive: 2004-05-04
Search Engines
I’ve been working on a search engine, and one of the issues that I had to consider was how many bytes to allocate to page indexing. I decided to consult the master. The search engine that I’m making isn’t scanning the whole internet, and so will not approach the number of pages that Google is indexing, but it gives me an idea.