Osfamaron handily just pointed me at Test::Strict after my complaining on irc about Test::More not including a compile_ok function.
Test::Strict includes that and some other general kwalitee tests, when I get a chance to write the coding standards for my client I'll be using it to kickstart I think :)