Earthling Bot - Bot Offline – Incident details

We recently have had two incidents where Earthling was put offline due to a sudden loss of connectivity with our hosts’ POP systems. These outages caused our services to become unavailable as we were not able to access our systems. We believe this was caused by one of our upstreams being attacked by many terabits and continued for 20 minutes. Our host responded by moving systems over to the failover, which failed to kick in automatically due to the way the systems went down. We apologise for the inconvenience caused and are constantly looking for ways to mitigate these outages from happening again.

Our services are now back online. Our host is monitoring and resolving the situation, and should hopefully cause minimal disruption to our bots.

One of our upstreams has gone completely offline, causing everything to fail. Our host has implemented a failover, while our upstream is working on a fix. Our bots are now returning online.

We have identified the issue with one of our upstreams, we are awaiting a fix.