custsql upgrade tonight

Tonight Nov 15, starting at 11:59 we will be performing maintenance on our customer sql server running MySQL 5.0. We will be upgrading it to MySQL 5.5. We believe the upgrade to go smoothly with minimal downtime. If you notice anything strange after the upgrade, please visit forums.sonic.net and post your issues.

Thanks, William and the SOC

UPDATE: After a delayed start the upgraded was a success. If you have any issue please post in the forums. -William

Brief Routing Instability

This afternoon, starting at 2:08pm, a misconfiguration caused brief routing instability in our telecom network. This instability lasted no more than 5 minutes, and traffic is now flowing normally.

-Tomoc and Nathan

Legacy DSL DHCP outage – L.A. Area

We have identified and repaired an issue that caused DHCP failures for a subset of DSL customers in the L.A. area. If you have any further trouble with your DSL connection please contact our support department as usual.

– Robbie and Tomoc

Network Maintenance

Tonight, November 6, starting at 11:30pm, we will be performing maintenance on networking equipment in Santa Rosa. We do not anticipate any customer impact from this work.

-Tomoc and Nathan

Core Router Maintenance

Tonight, October 30, starting at 11:59pm, we will be performing maintenance on some of our core networking equipment. We do not anticipate any customer downtime during this window.

 

-Tomoc and Robbie

Update: Maintenance completed as planned, no service interruption.

NOC Hotline Down

Due to Hurricane Sandy on the East Coast, calls may not ring though to the Network Operations Hotline. This does not affect calls to Customer Support.

 

Update: We believe that the Network Operations Hotline toll-free service will suffer an extended outage due to Hurricane Sandy. We’ve activated 707-206-4202 as a replacement until the original number is back in service.

Legacy DSL Maintenance

This evening, beginning at 11:59PM, we will be performing maintenance on equipment serving a subset of legacy DSL customers in the Bay Area. Expected downtime is less than 10 minutes for affected customers.

-Tim, Robbie, and Tomoc

Update: All work has been completed as planned.

Flexlink Outage

Tonight, October 22, equipment serving a small subset of Flexlink Ethernet customers became unreachable. We are dispatching immediately to replace the failed hardware and will provide an update when there is one available.

-Tomoc and Robbie

We have replaced the failed hardware and all affected customers are now back online.

Legacy DSL Outage

At around 7PM this evening an aggregation device that serves a subset of legacy DSL subscribers in the  Bay Area became unresponsive. The device was reloaded and service was restored by 7:15PM. We are investigating the cause of the issue further to ensure it does not happen again.

-Tim

Sacramento Backhaul Upgrades

Tonight, October 11, starting at 11:59pm, we will be cutting over to a new backhaul for our ATM and telecom services in the Sacramento area. This migration should not cause any down time for telecom services, and expected down time for legacy ATM services is less than 10 minutes.

-Tomoc, Robbie, and Clay

Update: All upgrades have been completed, down time was less than 10 minutes