Facebook Crawler Speaks Back
Last Updated on Tuesday, 6 April 2010 04:40 Written by External Post Tuesday, 6 April 2010 04:40
Last week we ran a story about Facebook suing to get a crawled dataset offline. This week we have a bit of a response written by Pete Warden, the guy who actually did the crawling. He followed robots.txt, and then
Go to Source
