Wireless Backbone Issues

Tonight at approximately 6:35 one of the backbone links in our wireless network failed, causing poor performance and connectivity for most of our wireless Internet customers. We have a technician en-route now to investigate the problem and will report as we make progress.

-Jared and Adam

Update: As of 7:35, we have restored service. One of the radio transmitters failed and had to be rebooted. We will be scheduling a replacement of this unit in the near future.

Invasive Telecom Network Maintenance

This Saturday, October 22 at 12:01 AM, we will be performing a software upgrade on one of our customer-serving routers in Santa Rosa. This will cause a 5-10 minute interruption of Internet and phone service for customers served by this router.

-Jared and Nathan

Partial CRAC Failure in Santa Rosa

We’ve had a major failure in our redundant CRAC (Computer Room AC) that handles cooling for our Santa Rosa Data Center a Colocation Facilities.  The redundant systems have taken over and we believe that the situation is under control.  Our vendors are en route, more information forthcoming.

Update: 14:15:14 PDT.  The redundant system is functioning properly and the room temperature has nearly stabilized.  We believe the failure was caused by a refrigerant leak due to the failure of a pressure release safety valve.  The faulty valve has been isolated and technicians are en route with refrigerant to recharge the system.

Update: 17:45:30 PDT.  The failed system has been recharged (with over 800 lbs of refrigerant) and restored to service and appears to be functioning correctly.

 

 

 

Chico Legacy DSL Migration

This Friday, October 21 at 12:01 AM, we will be migrating all of our legacy DSL subscribers in the Chico area to a new, higher-capacity circuit. This migration will take 20-30 minutes, and affected customers will lose Internet connectivity while the migration is being done.

-Jared and Nathan

Update: The migration has been completed. Due to a DHCP server misconfiguration, dynamic IP DSL customers may have experienced instability in their Internet connection until about 1AM. At this time all migrated customers should be up and running with no problems.

Backbone Network Maintenance

This Thursday October 20 at 12:01 AM we will be performing an equipment upgrade on our backbone at our San Jose POP. We will be routing customer traffic away from the point of maintenance, so there should be no customer impact.

-Jared, Nathan and Matt

Telecom Backbone Maintenance

Tonight, Wednesday Oct 12 at 12:01 AM we will be performing maintenance on one of our core backbone routers in the telecom network. This maintenance should take 10-15 minutes, and no there should be no customer impact.

-Jared

This maintenance is now completed. The core router is back in service, and there should have been no interruption of service.

Partial LATA1 DSL Outage

We have received confirmation from our vendor regarding a DSL outage that is affecting parts of LATA1.   We are actively working with our vendor to resolve this outage as soon as possible.  At this time we have no estimated time of repair.

Customers on our Fusion platform are unaffected by this outage.

Update: Our vendor reports that the outage was a result of a failing ATM switch within their network.  They have addressed the problem and service should now be restored to all affected users.

If you are still experiencing problems with your DSL service, rebooting your modem may help.  If not, please contact our support group for assistance.

-Chris

Emergency ATM Switch Reload

Today, Saturday September 24, at approximately 10:55 AM, we will be performing an emergency reload of one of our ATM switches. The ATM switch appears to have suffered an error which is affecting traffic flow through the box, and the only possible resolution is a full reload of the switch. All customers served by this switch will experience 5-10 minutes of downtime.

-Jared and Nathan

Update: The ATM switch has been reloaded and all affected customers should be back online at this time. If you are still experiencing problems with your legacy DSL connection, please contact our support team.

Legacy DSL Outage

We are in the process of diagnosing a Legacy DSL outage that appears to be affecting much of Northern California.  We are actively working with our vendor to resolve this outage as soon as possible.  At this time there is no estimated time of repair.

Update: Our vendor has diagnosed the cause of this outage as a defective ATM card within their network.  The card has been replaced and service has been restored to all affected users.

-Chris