Month: January 2010

CLEC Network Issues

We are currently experiencing issues with one of the AT&T back haul circuits that carries traffic to and from the Sonic Telecom network. We are working with AT&T on resolving the issue and have isolated the trouble to a specific card in a central office. We will provide further updates as soon as possible.

-Tim and Nathan

Update: The issue has been resolved. The circuit has remained stable for the past 45 minutes. We will continue to monitor closely for any further problems.

CLEC DSLAM Maintenance

This evening, at 12:01AM, we will be performing a software upgrade on the DSLAM that serves Fusion customers in the Rincon Valley area of Santa Rosa. Expected downtime is less than 30 minutes while the DSLAM is rebooted onto the new software release.

-Tim and Nathan

MySQL scheduled maintenance tonight

Tonight at 10:00PM I will be performing some needed maintenance on two of our public facing MySQL servers. This will most likely cause a small window of about 3-5 minutes where queries directed at these two systems may timeout. Every effort will be taken to make this window as very small as possible. –Don

Update: This maintenance window has been moved to 12 midnight from 10PM.
Update: Maintenance completed successfully – Less than 60 seconds of possible interruption window.

Authoritative Name Server Outage.

From about 6:30pm to 7:30pm we lost connectivity to one of our geographically diverse redundant Authoritative Name Servers (c.auth-ns.sonic.net) as the co-location facility that it is hosted at recovered from a major network outage — customers’ websites may have been slow to load during this time as DNS requests were routed to the other Name Servers.

–Augie

CLEC Intrusive Maintenance

This evening, between 12:01AM and 6:00AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink ADSL2+ customers in Albany and the South Beach area of San Francisco. Affected customers should experience less than 15 minutes of downtime.

-Tim and Juston

CLEC Intrusive Maintenance

This evening, between 12:01AM and 6:00AM, we will be performing intrusive maintenance on equipment serving Fusion customers in Sonoma. Affected customers should experience less than 15 minutes of downtime.

-Tim and Juston

CLEC Intrusive Maintenance

This evening, between 12:01AM and 6:00AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink ADSL2+ customers in Albany and Berkeley. Affected customers should experience less than 15 minutes of downtime.

-Tim and Juston

CLEC Intrusive Maintenance

This evening, between 12:01AM and 6:00AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink ADSL2+ customers in Petaluma, Windsor, and Healdsburg. Affected customers should experience less than 15 minutes of downtime.

-Tim and Juston

North Bay Area Outage

We are currently experiencing an outage affecting Fusion and FlexLink customers in the north bay area. We are working on restoring service and will provide an update shortly.

-Tim and Jared

Update: As of 4:30PM all service has been restored. Routine network maintenance inadvertently caused a portion of our CLEC network to stop forwarding traffic. We will be working with our equipment vendor and internally to ensure we do not experience another outage of this nature.

CLEC Intrusive Maintenance

This evening, between 12:01AM and 6:00AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink ADSL2+ customers in Petaluma, Windsor, and Healdsburg. Affected customers should experience less than 15 minutes of downtime.

-Tim and Juston

Update: This maintenance work has been postponed.