Author: Brandon Gile

Albany/Berkeley – Fiber Intrusive Maintenance

Update(3:14 AM) We have restored everyone that we could identify.  If you are experiencing a service outage, please reboot your equipment as this usually restores complications after maintenance.  If issues persist please call tech support.

Update(9/16 1:22 AM) We were able to restore most people, still working on the restoration of other customers.

Update(9/16 12:48 AM) During maintenance one of the pieces of equipment serving customers went unreachable.  We are dispatching someone to assist with troubleshooting.  We will update when we have more info.  ETA is roughly 70 mins for someone to get on site.

Thursday (9/15/22), starting at 11:59 PM, a subset of residential and business customers in the Albany and Berkeley areas will experience a brief service interruption while we perform some maintenance. The expected downtime is about 30 minutes while the equipment upgrades. The maintenance window will be 4 hours.

– Network Engineering

Albany/Berkeley – Fiber Intrusive Maintenance

Update(1:19am) This maintenance is now complete.

 

Friday morning (9/2/22), starting at 12:00AM, a subset of fiber and Business fiber customers in the Albany and Berkeley areas will experience a brief service interruption while we perform maintenance on hardware serving their connections. The expected downtime is about 45 minutes. The maintenance window will be 4 hours.

– Network Engineering

Northern California Service Disruption

Update 8/28/2022 3:16 AM: The failed hardware has been replaced and full redundancy has been restored.

Today 8/27/2022, around 6:20 PM Sonic experienced a hardware failure on one of our main edge routers. The symptoms indicated a restart of the affect line card would resolve the issue, so we did so. Upon booting, the previously failed interfaces began discarding all outbound traffic, causing routing failures towards some internet destinations from 7:00 PM to 7:15 PM. We have taken the affected piece of hardware out of service and our redundant edge router is taking over the traffic. As of now, we appear to be stable. We are working on dispatching out to replace the failed hardware to restore full redundancy.

-Network Engineering

Albany/Berkeley – Fiber Intrusive Maintenance

Update(3:05) Maintenance is now complete.

 

Friday morning (8/26/22), starting at 1:00AM, a subset of fiber customers in the Albany and Berkeley area will experience a brief service interruption while we perform maintenance on hardware serving their connections. The expected downtime is about 45 minutes. The maintenance window will be 4 hours.

– Network Engineering

Sebastopol – Fiber Intrusive Maintenance

Update(1:23am) Maintenance is now complete.  IPv6 has been turned on for this location and people are binding properly.  Please reach out to support should you encounter anything out of the ordinary.

–Network Engineering

 

We are pleased to announce that on Thursday evening we will be enabling native IPv6 support in Sebastopol for our fiber customers. This will be deployed in a dual-stack configuration that supports both SLAAC and IA-PD protocols. The process will start on 8/18/22, at 11:59PM. Fiber customers in the Sebastopol area will experience a brief service interruption while we perform configuration changes necessary to bring up IPv6. The expected downtime is about 20 minutes. The maintenance window will be 4 hours.

IPv6 is an important deployment as it provides significantly expanded address space. As the number of devices that need access to the Internet continues to grow, so does the need for additional addressing. For more information about IPv6, check out this link:

https://help.sonic.com/hc/en-us/articles/8242850487575-IPv6

Over the coming weeks and months, we will be deploying IPv6 to all our fiber customers. Our SmartRG and eero rental devices are fully compatible and will work in their standard configuration.

We conducted thorough internal testing but are unable to test for every scenario. We don’t expect any issues, however, if you encounter anything out of the ordinary, don’t hesitate to reach out to our support team.

– Network Engineering

Instability with VM Cluster

Around 8:30am this morning we experienced an issue with our VM Cluster that was impacting customer services.  At 9:47AM we resolved the issue and there should be no problems accessing Sonic internal services.

-Sonic network engineering and systems teams

Fusion Fiber Maintenance – Richmond District in San Francisco

Update(3:02) Maintenance now complete

Thursday morning (10/7/21) at 2 AM we will be performing intrusive system maintenance to replace a piece of redundant gear serving a subset of Fusion Fiber customers in the Richmond District of San Francisco. Data and voice services could potentially be interrupted off and on for up to 30 minutes. The maintenance window is 2 hours.

~Network Engineering

Fusion Fiber Non-Intrusive Maintenance – San Francisco

Update(12:17) Maintenance complete

Tonight (9/29/21) at 11:59PM we will be performing non-intrusive system maintenance to reboot a piece of redundant gear serving a subset of Fusion Fiber customers in the San Francisco area. The expected time to complete is 20mins. The maintenance window is 2 hours.

~Network Engineering

Fusion Fiber Maintenance – San Francisco

Update(3:49am) Maitnenance is now complete

Wednesday morning (8/25/21) at 2 AM we will be performing intrusive system maintenance to replace a piece of redundant gear serving a subset of Fusion Fiber customers in the San Francisco area. Data and voice services could potentially be interrupted off and on for up to 30-45 minutes. The maintenance window is 2 hours.

~Network Engineering