At approximately 6pm today, our main customer database server suffered an error with its RAID controller. Operations is working to restore full functionality to the server as soon as possible.
Update: 8:35PM, we were able to restore services by 7:30 and are monitoring for further issues with the system.
— Joe and Sysops
Update (12:20AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Petaluma, Napa, Sonoma, and Saint Helena. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Tonight, between the hours of 12:00AM and 5:00AM, ATT will be performing intrusive maintenance on an aggregation circuit serving legacy DSL and FRATM circuits in the Salinas area. Expected downtime is less than one hour.
Update: Due to unforeseen circumstances, AT&T has pushed this maintenance to the same time window tonight.
Update: AT&T has postponed this maintenance again. New date TBD
-Tomoc
Tonight, starting at 11:59pm, we will be performing maintenance on aggregation equipment serving a small subset of legacy DSL customers San Diego and the bay area. Expected downtime is less than 10 minutes.
Update: Maintenance complete.
-Tomoc
5/20/2014 – 12:27AM PDT – This maintenance is now complete.
Tonight beginning at 11:59PM PDT we will be performing a software upgrade on equipment serving voice customers throughout our network. No customer impact is expected from this upgrade.
-Tim J.
Update: These upgrades are complete.
Tonight at approximately 11:59pm, we will be performing maintenance upgrade on several customer facing systems. Expect brief outages to the following services:
All service interruptions should be brief.
-Grant and Dexter
System Operations
One of the interfaces in the load balancer that handles, mail.sonic.net, pop.sonic.net and imap.sonic.net had an interface lock up and stop passing traffic. During the few minutes this was an issue, these services would have been intermittently available. Traffic has been manually rerouted through the standby load balancer. Under nearly every other failure possible the standby load balancer would automatically take over but, unfortunately, its ability to deal with this lockup is not one of them. -Kelsey
Update(1:30AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Santa Rosa, Windsor, Cotati, and Rohnert Park. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Update(4:30AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Santa Rosa. Expected downtime is less than 15 minutes.
– Robbie
At 9:50 am this morning we received reports of several of our SSL certificates being revoked. These certificates have been updated, and any security warnings for the mail.sonic.net, pop.sonic.net, and imap.sonic.net should be resolved.
Grant and SOC