ntang (ntang) wrote,

The joys of running a big site

So someone made a change to put up a new promotion on Tuesday. No big deal, right? The problem is with this new promotion everytime someone read a note on BP they'd get a flash popup. That flash popup was 87k. Just -today- (i.e. in 11 hours) we had over 25g of downloads of that stupid flash file. It increased our peak bandwidth usage by over 15 mbps. That's over 10 t1's worth of data getting pumped out, all that one stupid file.

Here's a fun image of what happened after we found it and took it down:

Note: That's not our total bandwidth, incidentally, just for that one cluster of servers. We push close to 200 mbps at peak.
  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded