Brentwood Fiber Outage

Around 5:30PM today, routine network configuration on equipment serving Brentwood triggered a router bug that broke customer connectivity.  Our support staff quickly alerted network engineering and we were able to revert the configuration and restore service.  The NOC will in investigate the exact cause of the issue and take steps too prevent it’s recurrence.

-Network Engineering

East Bay – Fusion and FlexLink Intrusive Maintenance

Tonight, starting at 11:59 PM, we will be performing intrusive maintenance affecting a subset of Fusion and FlexLink customers in the East Bay. Expected down time is approximately 30 minutes. The maintenance window is 6 hours.

Update 5:55 AM: This maintenance is now complete.

– Network Engineering

Speedtest Outage

We have received reports that the Sonic Speedtest site is throwing an error message. Ops is investigating and will update this post when the problem has been resolved.

Update: We have isolated the issue to an outage with an upstream provider and are working with them to resolve that outage. A final update will be provided once the issues are resolved.

Update: The issue was resolved overnight by our upstream provider. We apologize for any inconvenience.

Brentwood Maintenance

Tonight at 11:59PM we are performing maintenance on aggregation gear serving our Brentwood fiber network.  Customer impact should be minimal, but users may experience a few minutes of downtime.  The maintenance window is expected too complete by 1AM.

-Network Engineering

Datacenter Outage

Beginning at around 1:40AM this morning we experienced a period of routing instability on the backbone network feeding our Santa Rosa headquarters. Customers collocated in our datacenter along with Sonic member services may have experienced reachability issues for around 1 hour. We are presently investigating the root causes of this outage so we can prevent any future occurrence.

Jasper Building Outage

We are currently experiencing an issue affecting fiber customers located within the Jasper building in San Francisco. We have dispatched a technician to investigate on-site. We will update this message when we have more information.

Update (15:00): This issue has been resolved and service to customers has been restored. There was a power outage at the Jasper building. As soon as that outage was cleared Sonic services were restored.

– Andrew & Support

East Bay – Fusion and FlexLink Intrusive Maintenance

Tonight, starting at 11:59 PM, we will be performing intrusive maintenance affecting a subset of Fusion and FlexLink customers in the East Bay. Expected down time is approximately 30 minutes. The maintenance window will be from midnight to 4 AM.

Update 4:20 AM: The maintenance is now complete. A subset of customers in Albany and Oakland are down due to unforeseen issue’s. We are working to restore connectivity as quickly as possible.

– Network Engineering

SMS Support Disruption

Sonic’s SMS support system is currently undergoing an unplanned outage. We are investigating the problem and will update here with updates.

Update: SMS support services have been restored. We have identified the root cause and are taking steps to avoid such occurrences in the future.