Category: Maintenance

Northern California Core Maintenance

Update 12:21AM: Tonight’s maintenance has been successfully completed.

 

Tonight, 9/14/21, starting at 11:59 PM, we will be performing non-intrusive maintenance on core routing equipment in our northern California network. We do not expect this work to cause any customer impact. The maintenance window is open until 4am.

-Network Engineering

Fusion Fiber Maintenance – San Francisco

Update(4:17) Maintenance is now complete.

Tomorrow morning, 9/3/21 at 2:00am PDT, we will be performing intrusive maintenance on a small subset of customers in San Francisco. Data and voice services will be intermittent for the duration of the maintenance window while work is performed. Full restoral is expected for all users at the end of the window.

-Network Engineering

Fusion Fiber Maintenance – San Francisco

Update (5:40pm) All customers have been restored. If anyone continues to experience issues, please call support.

Update (5:23pm) We have isolated the source of the outage and have restored half of the affected connections and are working to restore the remainder at as quick a pace as possible.

Update (4:32pm) We are investigating connectivity issues for customers previously affected by this maintenance. Details to follow as they become available.

Update(3:42): Emergency maintenance was completed.  Downtime was limited to 30 seconds

Update: Due to technical issues trying to mitigate congestion during peak time we need to move on this now.  We expect downtime to be very minimal, at most a few minutes.

Saturday morning (8/21/21) at 2 AM we will be performing intrusive system maintenance on a small subset of Fusion Fiber customers in the San Francisco area. Data and voice services will be interrupted very briefly. The maintenance window is 1 hour.

~Network Engineering

System Maintenance – OpenVPN Service

Update: Maintenance complete.

Tonight, June 8th, at 10:30pm, System Operations will be adding additional capacity to our OpenVPN (ovpn.sonic.net) cluster. This may briefly take the service offline. We will be monitoring carefully and anticipate all work to be complete by 11pm.

— Joe M

System Maintenance – OpenVPN Service

Update: Maintenance is now complete.

Tonight, June 3rd, at 11pm, System Operations will take our OpenVPN (ovpn.sonic.net) service down briefly to make configuration changes. This should take no longer than 30 minutes.

Non Intrusive Systems Maintenance

Update 6/4 12:35AM: Maintenance successfully completed for tonight.

Tonight at 11:59, we will be performing maintenance on network hardware that up-links servers for a variety of Sonic services including email and web hosting.  All involved equipment is redundant and we do not expect any impact to Sonic customers.  The maintenance window is open until 4am.

-Network Engineering and Systems

Northern California Core Maintenance

Update 5/26 12:33AM: Maintenance successfully completed for tonight.

Tonight (5/25) at 11:59PM, we will be performing maintenance on core routing equipment that is part of our bay area ring. We do not expect this work to cause any customer impact. The maintenance window is open until 4am.

-Network Engineering

Northern California Core Maintenance

Update 5/19 12:40AM: Maintenance successfully completed for tonight.
Tonight (5/18) at 11:59PM, we will be performing maintenance on core routing equipment that is part of our bay area ring. We do not expect this work to cause any customer impact. The maintenance window is open until 4am.

-Network Engineering

Northern California Core Maintenance

Update 5/18 12:40AM: Maintenance is complete for tonight. A short unexpected 2-3 minute service interruption may have been experienced by colocation customers.

Tonight (5/17) at 11:59PM, we will be performing maintenance on core routing equipment that is part of our bay area ring. We do not expect this work to cause any customer impact. The maintenance window is open until 4am.

-Network Engineering

Sonic Fiber Network Maintenance

Update: As of approximately 10:15am all services, both data and voice were restored. RFO to follow.

Update: 8:40am – For the remaining customers that are still without service, we are currently working with our hardware vendor’s engineering team to resolve this as quickly as possible.

Update 7:29am – A large portion of the remaining subscribers have had their services restored, however we are still pushing to bring back the remaining circuits. At this time the root cause of the problem is unknown, but we have a procedure to bring subscribers up incrementally that we will continue to exercise.

Update 6:29am – The service migration has failed to restore service for a number of customers. We are working to restore service as quickly as possible and will provide updates hourly.

Update 4:46am – We have isolated the cause of the issue and are working to resolve by migrating services to restore connectivity.

Update: Some customers in the Albany area are experiencing intermittent connectivity. We are investigating the root cause and will post updates as they become available. The remaining customers in other regions are back online.

Tuesday, 04/27/21, starting at 2:00 AM, we will be performing intrusive maintenance affecting residential and small business Fusion Fiber service in the east bay and Burlingame regions. Expected telephone and internet access downtime within the maintenance window is approximately 30 min as we perform system upgrades on the affected central office hardware. The maintenance window is 2 hours.