Month: January 2020

Emergency Maintenance in Davis

Update 8:47 AM We believe service to be restored at this time.  The replacement device also had a defect in it, but we were able to work around the issue.  We will have to go back out and replace the new device Monday night for network integrity.

Update: 5:50 AM We are still working on getting this resolved.

Update: 4:00 AM Still working on getting the new equipment up and running.

Update: 2:50 AM Technician is on site and working on replacing equipment.

Update: 12:35 AM. The equipment has failed and we are dispatching out to replace it. We hope to have service restored in the next two hours.

Tonight 1/16/2020 at 11:59 PM we will be preforming emergency maintenance on equipment serving a subset of customers in Davis. We expect the down time of 15 minutes or less in a two hour maintenance window.

 

~Network Engineering

System Maintenance

Starting at 10pm tonight System Operations will conduct planned maintenance on a host serving bandwidth graphs for certain legacy products. This will impact specific applications that display graphs for those legacy products – no other impact is expected. Total downtime should be approximately one hour.

System Maintenance

Update: Maintenance complete.

Tonight beginning at 10pm we will be performing maintenance on a multitude of servers inculding our custom hosting platform as well as members tools.  Any downtime should be very brief and we expect to complete the maintenance within 1 hour.

San Francisco, East Bay, Brentwood – Fusion Fiber Maintenance

Update(2:01am) Maintenance done

Tonigh at 11:59PM, we will be performing upgrades on a very small subset equipment serving residential and enterprise fiber services in the San Francisco, East Bay, and Brentwood area. Connectivity will be impacted for all customers during the course of this work. Our maintenance window will commence until 4:00AM, but we expect actual customer downtime of fewer than 15 minutes. An update will be provided on the completion of our work.

-Network Engineering

Sebastopol – Fusion Fiber Maintenance

Update (12:43am) Maintenance was completed at 12:20am

Tomorrow, (1/8/2020) at 11:59PM, we will be performing upgrades on equipment serving residential and enterprise fiber services in the Sebastopol area. Connectivity will be impacted for all customers during the course of this work. Our maintenance window will commence until 4:00AM, but we expect actual customer downtime of fewer than 15 minutes. An update will be provided on the completion of our work.

-Network Engineering

Sonic Data Center Core Maintenance – Night 2 of 2

Update(1:50AM) Maintenance ran long due to unforeseen hardware issues, but all work has been been successfully completed.

Wednesday, January 8, starting at 11:59pm, we will be performing maintenance on core equipment in our Santa Rosa HQ Data Center. Minimal customer impact is expected, with brief periods of routing instability towards some Sonic services, such as web-hosting, email and Member Tools. This maintenance window is 4 hours.

-Network Engineering

Sonic Data Center Core Maintenance – Night 1 of 2

Update(1:20AM) All work for tonight has successfully concluded.

Tuesday, January 7, starting at 11:59pm, we will be performing maintenance on core equipment in our Santa Rosa HQ Data Center. Minimal customer impact is expected, with brief periods of routing instability towards some Sonic services, such as web-hosting, email and Member Tools. This maintenance window is 4 hours.

-Network Engineering

Lata 1 Northern California Legacy DSL Outage

Update: After a technician was dispatched for hardware replacement, this issue should have been resolved as of 3:30PM today.

 

Today just after 12:00pm, a piece of network infrastructure serving a subset of legacy DSL customers in northern California appears to have failed. We are currently identifying the exact source of the failure.  Update will be provided when we have more info and/or an ETR.

-Network Engineering

System Maintenance

Update: maintenance is complete.

Tonight, beginning at 11pm, we will be upgrading several systems including our VPN servers.  Any downtime should be brief and we expect to complete the maintenance within 1 hour.