Thanks to some help from mauzo, I've found the problem with the failing tests for Test::Aggregate. Basically, just don't attempt to aggregate tests which might have a skip_all plan.
If you're not familiar with this module, it basically lets you "aggregate" tests together so that you only load perl and related modules once. I've had tests speed up four times using this. Though there are some restrictions on how you write your tests, there aren't many. A lot of tests just work.
