One of those days…

Just when you thought everything was going swimmingly, with months and months of uninterrupted uptime you get a minor technical glitch, specifically:

May 22 11:03:04 server kernel: EXT3-fs warning (device sda3): ext3_unlink:
Deleting nonexistent file (17187990), 0

And it takes 9 hours to do a 15 minute repair job, gah.

After which SQL throws up a heap of  errors needing repairing, while at the same time you’re trying to manage (well, observer and prod tech team) transfer and upgrades over another couple of servers.

The only good thing about today has been that it’s a Sunday (Saturday night to the rest of the world).

And the great big irony is that it all comes the night before…

7 replies on “One of those days…”

  1. Thanks for the hard work.
    I gave a workshop yesterday (Saturday in Massachusetts) where 10 non-tech teachers set up their own edublogs and luckily, everything worked like a charm. Glad I didn’t have a weekend of workshops planned. :)

    Good luck, James, and thanks again.

    Kevin

  2. Phew! We always schedule work for weekends and night-time US time (pref after 10PM) so I’m glad it worked out for you.

    Honestly, today has been the most stressful technically in the last 2 years!!!

  3. James, I always appreciate edublogs more after a glitch because it reminds how it’s how only totally possible due to your vision and generosity (not to mention that you roll up your sleeves and get your hands dirty with virtual grease fixing the issues) so thanks. If you’re ever in Adelaide, I’d like to buy you a decent bottle of Penfolds as a small token of gratitude.

  4. You’re too kind – really you should be throwing bricks at me!!!

    Seriously though this has confirmed that we need to invest heavily in some new systems and we have a plan that will guarantee we aren’t hit by the same bug again.

Comments are closed.