CPANdeps downtime

drhyde on 2008-04-03T00:20:25

My apologies for the recent downtime on CPANdeps - it's Yahoo's fault. Their web crawler suddenly stopped obeying robots.txt, and so tried to spider all of the CPAN's dependencies. And on top of that, they're making requests every few seconds instead of every few minutes like a good robot should. Given that it takes more than a few seconds to generate the dependency tree, things went pear-shaped. Arseholes.

They're now banned with a mod_rewrite rule, and just for good measure I've limited the number of concurrent webby requests.