Started the day with the idea of not doing any computer stuff after ahellish day at work. Even went and sat under a tree and read books for a while, but then IRC drew me back in.
Built a 58Mb mbox containing 22,296 messages (void from 2001). Fed it to mariachi - It ground to a halt. Tweaked bits of Email::Folder to make it use less ram and pondered a proper iterator interface.
After tweaking got as far as loading and threading with a big process footprint (246M process footprint), but got killed during ordering, probably by recursing too deeply.
Chatted with Mark about improving that. One approach that may be useful is to flush the message bodies out into a tied hash, and only load them in when they're needed later during output generation. I wondered if it might be the start of over-engineering, to which Mark said[0] "it's not overengineering if underengineering isn't working"
[0] May not be truly accurate, as it relies on my memory.
