The new family is now sitting waiting patiently, all but the big one are up to speed and ready to say hello to the world. Unfortunately the big one is HUGE and despite ripping through data like a hot knife through butter, still has a large amount to get through.
The old reports site currently holds over 5.2GB of data files, and the new site is likely to be over 10GB. The builder behind the scenes is getting through roughly 200 data points an hour (producing 6 files for every data point). There are over 25,000 data points in total and after a day of processing is now down to 21,000 data points still to go. Understandably the database usage is going through the roof, but amazingly the live site doesn't seem to be suffering.
I'm hoping that over the weekend the builder will get through a large enough chunk of the remaining data points, so that I can finally do the official launch next week. Check back here after the weekend for an update :)
