Category: Network

FlexLink Outages – San Francisco

We are currently investigating an outage involving some FlexLink customers in the San Francisco area following last nights code upgrades. We will update this post when we believe we have found the cause and solution to this issue.

– NOC

Fusion/FlexLink Intrusive Maintenance

Update( 1:00AM ): This maintenance is now complete.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in San Francisco. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

– Robbie

Fusion/FlexLink Intrusive Maintenance

Update (1:00AM): This maintenance is now complete.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in  Sebastopol, Occidental, and Guerneville. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

– Robbie

Fusion/FlexLink Intrusive Maintenance

Update(1:22AM): We were able to remotely resolve the issue with the problematic card  and all affected customers are now back online.

Update(12:51AM): This maintenance is now complete. A single card within a dslam in Mendocino failed to upgrade properly, leaving the customers served from that card offline for the moment. We are working towards a resolution and will update this post when the issue has been resolved.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Fort Bragg, Mendocino, and Cloverdale. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

– Robbie

Non-Intrusive Network Maintenance – Bay Area

7/9/2014 – 4:15AM PDT – This maintenance is now complete.

Tonight beginning at 11:59PM PDT we will begin performing non-intrusive maintenance on network in portions of the bay area. This includes a software upgrade to portions of our voice network. No customer impact is expected, and the estimated duration is around 2 hours.

-Tim J.

Connectivity Issues to Santa Rosa Datacenter

This morning, beginning around 3:45 AM, a host within our Santa Rosa datacenter became the target of a very large DDoS attack. We are currently in the process of battling this attack and users may notice reachability problems to services such as our email servers and member tools during this time.

– Robbie

Legacy DSL Outage

Update( 7:49AM): This issue has been resolved.

A portion of legacy DSL customers in Northern California are currently offline due to an issue with a piece of dsl aggregation gear. We are working on diagnosing and repairing the equipment asap.

– Robbie

Fusion/FlexLink Intrusive Maintenance

Update( 12:20AM ): This maintenance is now complete.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in  San Jose. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

– Robbie

Non-Intrusive Bay Area Network Maintenance

Update: 6/18/2014 1:45AM – This maintenance is now complete. Users may have noticed slight (sub 5%) packet loss for brief instances during this migration, but things should be back to normal now.

Tomorrow night (6/17/2014) beginning at 11:59PM PDT, we will be migrating traffic to newly upgraded portions of our Bay Area network. This covers all Fusion and Flexlink customers in the Bay area. No customer impact is expected during this maintenance.

-Tim J.

Fusion/FlexLink Intrusive Maintenance

Update (12:35AM): This maintenance is now complete.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving a portion of Fusion and FlexLink customers in  San Francisco. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

– Robbie