Anycast Network Issues With MySQL Server

[Roy 10,832 / 0]

Hey all,

 

Around two hours ago our servers on the Anycast network (92.119.148.0/24) stopped being able to connect to our MySQL server. This caused a few servers to go offline which relied on the MySQL connection and others to not work properly.

 

The reason for this was due to the node our Chicago PoP with Vultr being on experiencing networking issues (no connection whatsoever). Vultr tried restarting the node (which restarted the PoP server). However, the PoP still couldn't connect to the Internet and caused Compressor's startup service to crash (with 5 retries) and it stayed offline until I investigated.

 

Our MySQL server routed to the Chicago PoP. Therefore, since Compressor was down on this PoP, it wasn't able to send packets back to the game servers.

 

I will look into seeing if we can have Compressor restart after 5 retries at a later interval.

 

I apologize for the inconvenience and thank you for understanding.