This morning at 8am PST we experienced a DDOS that affected services served out of our Santa Rosa datacenter. The DDOS was blocked at our network edge by 8:12am PST and all services where restored.
Michael
DDOS Affecting Popular Sites and Services, Including Twitter, Reddit and Spotify
A Massive denial of service attack on a Dyn, a large DNS service provider, has been affecting many large sites this morning. This includes parts of Amazon’s infrastructure, Twitter, Reddit, Spotify along with many smaller properties. This attack results in errors like “Server not found” or “Host not found” in web browsers and other applications. For a more detailed account, please see https://www.wired.com/2016/10/internet-outage-ddos-dns-dyn/ or https://krebsonsecurity.com/2016/10/ddos-on-dyn-impacts-twitter-spotify-reddit/ and note, this affects more than just the East Coast.
Sebastopol and Guerneville Fusion/FlexLink Intrusive Maintenance
Update (12:40AM): Maintenance Complete
Beginning tonight at midnight, we will be performing maintenance on equipment serving Fusion and FlexLink customers in Sebastopol and Guerneville. The maintenance window for this procedure is 2 hours, but downtime is not expected to be more than 15 minutes.
-Network Engineering
Healdsburg – Fusion/FlexLink Intrusive Maintenance
Update (1:00AM): Maintenance complete
Beginning tonight at midnight, we will be performing maintenance on equipment serving Fusion and FlexLink customers in Healdsburg. The maintenance window for this procedure is 2 hours, but downtime is not expected to be more than 20 minutes.
-Network Engineering
System Maintenance
Update: This maintenance is complete.
On Wed, October 12th, beginning at 11:59pm we will be performing maintenance on sonic.com. The maintenance is expected around 15 minutes, during which time access to sonic.com will be interrupted.
-Dexter K, Sonic System Operations
Northern California Legacy DSL Outage
Today, October 12, starting at 1:30pm, core equipment serving Legacy DSL experienced a failure. We are working to resolve service as quickly as possible and will provide updates as they become available.
Update(3:02pm): All services restored. This outage was caused by malicious BGP traffic from outside our network and we have taken steps to protect our network against any future attacks of this nature.
-Tomoc
System Maintenance
Update: Maintenance was completed at 2:30am.
Starting tonight at 11:59pm, SOC will be running system updates. The following services may experience brief interruptions:
- Web hosting
- IMAP/POP3/SMTP
- IPv6 Tunnels
SOC
Non-Intrusive Core Voice Maintenance
Tonight, October 11th, at midnight, we will be conducting updates on core voice infrastructure. The update will not impact active calls or call completion. For those using commportal, you may experience a brief interruption with the login process during the update while equipment is rebooting. Estimated maintenance window is 1 hour.
-Network Engineering
Update: 12:18am Maintenance is now completed.
-Network Engineering
Fiber DIA OPT-E-MAN Intrusive Maintenance
Update (2:26AM): Maintenance Complete
Beginning tonight at midnight, we will be performing maintenance on a small subset of Fiber DIA OPT-E-MAN circuits. This maintenance will not affect any ASE/SSE customers. The maintenance window for this procedure is 3 hours, but downtime is not expected to be more than 30 minutes.
-Network Engineering
Sonic Telecom Core Maintenance
Tonight, October 10, starting at midnight, we will be performing maintenance on core equipment serving our telecom network. Customers with private transport services may experience a brief disruption in traffic while a new best path is calculated.
Update(3:55am): Unexpected behavior from networking equipment caused an outage for customers at the Santa Rosa Sonic facility. All services have been restored and maintenance is now complete.
-Tomoc