If everything is coming your way, you’re in the wrong lane.
Robot ControlNovember 7, 2003 - 11:13pm
Lazy Web, I invoke thee… Google’s sending people to my pages’ RSS feeds rather than the real page. The Is there any way to prevent Google from going to any URL ending in Answer: It was in the FAQ, of all places. grumble == 12. How do I tell Googlebot not to crawl dynamically generated pages on my site? == “Self-denial is the test and definition of self-government.” — “The Field of Blood” Alarms and Discursions – G. K. Chesterton |
|