Downtime to accidental MVP

I pushed the minor change to the Ruby on Rails app I was working on, deploy it & went to bed. An hour later I started receiving email notifications indicating there was an issue.

I had upgraded a library used in my app, which had introduced a memory leak! It was the worst kind of hockey stick growth & meant the app needed restarting every hour (which caused 30 seconds of downtime).

I rolled back the change, and quickly cobbled together some code to help track down what had caused the error, fix it, wrote a blog post & forgot about it.