| || |
|Page 1 of 1 || Previous | Next |
| | WWW.READWRITEWEB.COM
FEBRUARY 1, 2011 [AltaVista, Bing] Quora Blocks Startup Search Engines
As Gabe Rivera of Techmeme pointed out yesterday , its robots.txt file explicitly grants Google, Bing, Blekko and other big players access, but excludes everyone else. If large sites had these restrictions back when Google was starting, it might never have succeeded and wed still be stuck with Altavista. While hes still able to show Facebook pages thanks to API partners like Bing, this leaves him unable to run his own algorithms to optimally rank and display the results.