Update: 4:15pm – Today at 12:28pm Sonic experienced a network instability event of an unknown origin at the time. Â Through troubleshooting we were able to narrow down the issue to two transport links going from one of our datacenter locations to core network equipment. Â These links were receiving replicated traffic from the transport providers network equipment, sent back at us. The replicated traffic overloaded the CPU on our core routers. We have taken steps to prevent the replicated traffic from affecting our network, and we have contacted our provider for further diagnosis. Apologies for the delay in getting issue resolved, it was a very difficult problem to troubleshoot, and we have never seen anything like this happen before.
Update 3:42pm – We believe everything is restored. Â We will release a RFO soon with more specific information.
Update 2:46pm – We are still working to mitigate the DoS. All of our engineering staff is currently engaged in this issue. We will post more details as they become available.
As of 12:30pm, the Sonic network is experiencing reachability issues to the outside world. A large DoS attack is the suspected cause but we are still working to identify and mitigate the problem ASAP. More information will follow.
-Sonic NOC
As a fallback, you might want to consider putting in OpenDNS’s or Google’s public DNS servers after Sonic’s in either your router or computer. That way, when Sonic’s (continue to) fail, you’ll fallback to OpenDNS/Google allowing you to continue to work as Sonic’s NOC works to resolve the issue.
OpenDNS: https://www.opendns.com/setupguide/
208.67.222.222
208.67.220.220
Google: https://developers.google.com/speed/public-dns/
8.8.8.8
8.8.4.4
Please notify me of updates
Any updates on this issue? I work from home and have 0 connectivity, getting DNS errors and can’t connect to anything. It’s been almost 2 hours since you reported it.
Any updates? I’m having a lot of trouble staying connected to the internet and getting frequent DNS errors.
The issues you are experiencing is causing connection issues with our Sonoma business location. Can you please send me a update on the status of this issue and what the ETA is to resolve.
Thank you.
following
Did this affect phone service. Sonic phone lines work the intercoms in my apartment buildings.
@Brian This only fixes the problem if you were using them as DNS. For us, the issue was preventing IP traffic to our servers.
This issue was resolved around 3:30PM yesterday afternoon. If anyone runs into any further issues, please don’t hesitate to give us a call.
@Linda Some customers were reporting intermittent phone connection and dropped calls while the issue was present, but overall most phone connections remained working.