Note to myself: NEVER (and I stress that : NEVER) leave a root console open EVER again! When I got in on friday, I noticed some mysterious files on my disk and quickly discovered that one of my co-workers had installed Festival on it for some reason. I quickly killed the SSH tunnel he ALSO started and removed festival. Since I didn't want to spend half a day checking out every little detail, I continued my day to day work. 30 minutes later, festival fired up and shouted some funny phrases through my speakers. I know I should've turned off my speaker as well.
Apparently, there was still a user bastard on my machine and the co-worker logged in and started festival.
Lesson learned.. Turn off SSHD whenever in doubt. Use tail to keep eye on system log for suspicious logins.