Well, saw this coming. The wizards at Gatehouse Media finally figured out they could change their robost.txt file to prevent the Boston Globe crawlers from hitting their site and rendering their headlines.
Of course, they had filed a lawsuit first, before someone probably send them a wikipedia entry on how to block the crawler. They quietly settled out of court.
{ 0 comments… add one now }