Sonic Fiber Outage in Albany

Update – 11:00pm 7/14  Sonic repair crews were able to fix the issue and all customers appear to be back up.

 

We are currently experiencing a Fiber service outage in Albany. We’ve dispatched a team into the field to investigate the issue and work toward resolution. We will post updates here as we get them.

– Sonic Support team

 

Ukiah, Mendocino, Fort Bragg – Service Outage

Update – 5:40pm 7/8/21 All repairs have been finished and full service has now been restored.

Update – 4:55pm 7/8/21 Repair crews are continuing to repair and test at this time. Still no ETR for complete repair.

Update – 7:50am 7/8/21 Repair crews have isolated the issue, and work is partially completed. Repair work to continue this morning.

Update – 6:04pm 7/7/21 Repair crews are still working to repair service. Additional help has been engaged to assist with the restoration effort.

Update – 8:55am This is a confirmed fiber cut through our cabling vendor. They are working to repair the damage right now, will update when more information is available. Partial connectivity was restored last night through an emergency link with limited bandwidth. No ETR as of yet.

Today at 5:40pm 7/6/2021, we began experiencing network connectivity issues to Ukiah, Mendocino, and Fort Bragg. We are working to restore connectivity as quickly as possible and will update as more details become available.

– Sonic NOC

Independence Day

Hello Sonic Customers!

Whether you’re celebrating with with friends and family or taking this time to reflect on our country, we here at Sonic would like to wish you a Happy Independence Day. We will have modified hours of operation for customer care, and will be open from 8am-5pm 7/4/21 and will resume normal business hours on 7/5/21. Our 24×7 network operations team will remain on call for our Enterprise, dedicated circuit and collocated customers.

 

-Jerriel & Sonic Support

Telephone Reachability Issues

Update: 6/24/21 3:15 PM – Multiple inbound carriers have made re-routes to work around the reachability issues we have been experiencing. Due to the nature of telephone network routing we do not have control over how calls make it to our network. We will continue to collect examples, escalate, and test with the other telephone companies involved  If anybody continues to experience dialing delays when calling Sonic customers please open a trouble case with your phone company. We are actively engaged with Verizon, Comcast, and Bandwidth to discover which telephone carrier in the call path is causing these troubles.

Update: 9:37 AM – We have made progress with inbound carriers and our testing has yielded an improved call completion rate. We are continuing to test and work with other inbound routes to isolate and resolve any lingering dialing issues.

We are currently investigating inbound call issues to Sonic customers. The problem does not seem to be systemic at this time, but with some calling parties to Sonic telephone numbers. Symptoms include Post Dial Delay (PDD) after dialing into a Sonic telephone number, and occasional error messages played back to the calling party. We have escalated the issue with the call paths that lead to us and are working to resolve.

~Network Engineering

Systems Maintenance

Update: Maintenance complete.

Tonight beginning at 10 PM PST we will be applying upgrades to multiple systems including our VPN cluster.  We estimate any downtime to impacted services to be very brief, and we expect to complete the maintenance within 2 hours.

Hosting cluster system maintenance

Update: This maintenance is complete.

Tonight beginning at 10 PM PST we will be upgrading systems in our hosting cluster.  This process should not impact sites reachability, however if there is any downtime we expect it to be brief, and we expect to complete this maintenance within 2 hours.

System Maintenance – OpenVPN Service

Update: Maintenance complete.

Tonight, June 8th, at 10:30pm, System Operations will be adding additional capacity to our OpenVPN (ovpn.sonic.net) cluster. This may briefly take the service offline. We will be monitoring carefully and anticipate all work to be complete by 11pm.

— Joe M

System Maintenance – OpenVPN Service

Update: Maintenance is now complete.

Tonight, June 3rd, at 11pm, System Operations will take our OpenVPN (ovpn.sonic.net) service down briefly to make configuration changes. This should take no longer than 30 minutes.

Non Intrusive Systems Maintenance

Update 6/4 12:35AM: Maintenance successfully completed for tonight.

Tonight at 11:59, we will be performing maintenance on network hardware that up-links servers for a variety of Sonic services including email and web hosting.  All involved equipment is redundant and we do not expect any impact to Sonic customers.  The maintenance window is open until 4am.

-Network Engineering and Systems