How to crawl a quarter billion webpages in 40 hours | DDI - http://www.michaelnielsen.org/ddi...