I had always discounted the idea that there was some kind of "conspiracy" at Google which "suppressed" pages maliciously. It seemed to me that those who complained about Google's search algorhythms were simply calling "sour grapes." Why should Google actively suppress pages? Isn't their goal simply to be the most effective search engine out there? This slashdot thread discusses the idea that some sites may be "censored" by Google's search engine. Is this a problem--even when the sites in question are child pornography?
It turns out, the issue is even more complicated than that. Take a look, for instance, at this (modded down) subthread. Yes, that's me commenting on Lebowsky's claim that his friend's Web site (for a basically nonoffensive band--no kiddie porn here) had been censored. Yesterday I was able to find the site using a Google search. Today, however, using the same search terms, I wasn't. Apparently, something in Google's algorhythm is actually supressing results.
In the past, I had assumed that if I scrolled through the search results, I would eventually find every page that included my search terms--that "pagerank" was simply a technology for placing the most "relevant" sites first. It appears it's doing more than that. Is it because Google is "broken," or is Google actively sacrificing search accuracy for globalization and commercialization?



Re: Google conspiracy theories?
Well, it's a dangerous move because big search engines like Google navigate a great percentage of internet traffic. I predicted in an earlier post that "pagerank" would be the death of non-commercial pages; people just won't be able to find the information.
Re: Google conspiracy theories?
"pagerank" would be the death of non-commercial pages
The thing is, it doesn't have to be. If all it did was place the pages in order of "relevance," then users could simply refine their search terms in order to find non-commercial pages. But apparently, it also completely eliminates pages from search results, which strikes me as completely alien to the idea of a search engine: what good is it if it doesn't find anything?
Re: Google conspiracy theories?
Sergey Brin, a co-founder of Google, has already gone on record about Google manipulating search results (e.g., do a search on the term 'suicide', and notice what is in the top results.)
http://boingboing.net/2002_12_01_archive.html#90036289
He had made the comment at a gathering called SuperNova.
The shiftiness of results may also be due to other factors, like Google engineers tweaking the system to improve performance issues...
http://pf.fastcompany.com/online/69/google.html
Re: Google conspiracy theories?
Perhaps a good test would be to use a variety of search engines to search for a certain loaded term. I'd love to see such a study (read I'm too lazy to do it myself). :-)