Emergency Equipment Maintenance

We will be performing emergency maintenance shortly on equipment serving Legacy DSL customers in the Los Angeles area. Affected customers may see up to 10 minutes of downtime while the work is performed.

-Tim

Update: Maintenance work has been completed and all affected customers should be back online. We apologize for the downtime.

Updates to Our Recursive DNS Servers

On the morning of  Tuesday the 22nd, we will block access to our recursive DNS servers from off of our network.  This will help reduce the use of our DNS servers as part of the ongoing DNS Amplification Attacks as well as protect their quality of service for all of our customers.  This will, however, cause issues for any roaming device that has our DNS servers hard coded.  These devices should be configured to use server assigned DNS settings instead.  For more information please see our forums.

-Kelsey and William

 

Non-Intrusive Backbone & Voice Network Maintenance

Update: 4:08A PDT – This maintenance is complete.

Tonight, beginning at 11:59PM PDT, I will be performing maintenance on backbone equipment in San Jose, Palo Alto, Santa Rosa and San Francisco as well as maintenance to our voice network in Santa Rosa. This is the completion of the maintenance from 10/9/2013. No impact is anticipated to customer internet or voice traffic during this maintenance.

– Tim J.

Non-Intrusive Backbone Maintenance

Tonight, beginning at 11:59PM PDT, I will be performing maintenance on backbone equipment in San Jose, Palo Alto, Santa Rosa and San Francisco. No impact is anticipated to customer traffic during this maintenance.

– Tim J.

 

— UPDATE: Maintenance partially completed, remainder will be re-scheduled for another night.

Emergency Router Maintenance

Update (12:50AM) : This maintenance is now complete.

 

Tonight, beginning at 11:59 PM, I will be performing emergency maintenance to replaced a failed module in a core northern California router for our telecom platform. I do not expect any customer downtime as a result of  this procedure, although there may be a brief moment of routing instability as I bring the replaced module back online.

– Robbie

Server Maintenance

Update: All upgrades complete.

System Operations will be applying software upgrades between 12 and 2am on Thursday, October 3rd, 2013. The following Sonic.net systems may be unreachable for a short period of time:

– Game servers
– Mailing lists
– Mirrors
– Speed Test

— Joe and the SOC

Network Maintenance

Tonight, September 30, starting at 11:59PM, we will be performing minor maintenance on routers that serve Biz-T and FRATM customers in both northern and southern California. Expected down time is less than 10 minutes.

Update: Maintenance complete, approximate downtime was 6 minutes.

-Tomoc

Slow DNS Queries

Update:

The small DOS attack has been blocked, and service should be stable.

 

Starting at approximately 4am till now, our DNS servers have been  plagued by small DNS amplification attack. Any problems with slow DNS queries could be attributed to this. We are working on a fix to prevent problems like this in the future.

-Grant and the SOC

Slow DNS responses this morning

This morning approximately between 6:30 AM and 7:00 AM, users may have noticed slow or dropped responses to our recursive dns servers. Further investigation discovered this interruption was caused by a small reflective DOS attack. We are actively working on a solution to fix these DOS attacks that affect our dns servers and hope to have a solution soon. We apologize for not getting this notice out sooner when the problem occurred.

-William and the SOC

Fusion/FlexLink Equipment Maintenance

This evening, beginning at 12:00AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Fairfield, Vallejo, Ignacio, San Rafael, Larkspur, Mill Valley, and Sausalito. Expected downtime for affected customers is less than 15 minutes.

-Tim