Legacy DSL Packet Loss

We are currently investigating a packet loss issue for a subset of our legacy dsl customers in northern California.  We will provide an update on this issue shortly!

-NOC

This issue has been tracked down to a failing port in our network. The affected customers have been migrated off of the port and their service restored.

ATM Customer Aggregation Router Reload

This Tuesday, March 27 at 12:01 AM, we will be performing a maintenance reload on our ATM customer aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers.

-Tomoc and Robbie

Update: Due to unforeseen circumstances, this maintenance will be done tonight, Thursday,  March, 29 at 12:01 AM.

Web Cluster Service Interruption

A configuration change made earlier today on our web cluster  to support the redirection service, that is now included with our DNS hosting services, caused  some hosted domains to break several hours later.  The mistake has been corrected and all services are functioning correctly again.

Non-Intrusive Network Maintenance

Friday, March 23 at 12:01 AM we will be performing non-intrusive network maintenance on one of our LA POPs. This maintenance should not affect connectivity, and should last no more than 10 minutes.

-Tomoc

DSL Aggregation Router Reload

This Wednesday, March 21, at 12:01 AM we will be performing maintenance reloads of six Redbacks that t
erminate traditional DSL service. This will affect some of our Bay Area DSL subscribers.
Expected downtime is 5 minutes.

-Tomoc and Robbie

Update: The scheduled maintenance was completed successfully and all affected customers should be back online.

FlexLink and Fusion Outage

We are currently experiencing an outage affecting FlexLink and Fusion customers in the Menlo Park area. We are investigating the cause of this outage and attempting to restore service as soon as possible. Further updates will be provided shortly.

-Tim and Nathan

Update: A technician has been dispatched to restore service. The current estimated time to restoration is under two hours.

Update #2: Service has been restored as of 1:21PM. The issue was isolated to a piece of IP routing equipment. We will be investigating the root cause of the issue to avoid future occurrences.

Sacramento Network Reconfiguration Redux

Tonight, Friday March 2 at 12:01 AM, we will be performing intrusive network maintenance at our main Sacramento CO. This maintenance will cause 5-10 minutes of downtime for all Fusion and Flexlink customers served by that CO, and potentially longer outage for our Fiber-served customers. This maintenance will tie our old Sacramento services into the new expansion we’ve made in the Sacramento area, providing better reliability and stability for all services.

-Jared and Matt

Update: All network maintenance is complete, and all services should be restored at this time. Fusion and Flexlink customers should have only seen about 5 minutes of downtime.

Sacramento Network Reconfiguration

Tonight, Tuesday, Frebruary 28 at 12:01 AM we will be performing some potentially intrusive network configuration changes to our Telecom network in the Sacramento area. We do not expect any downtime, but there may be some brief outage of network connectivity for Fusion and Flexlink customers in the Sacramento area.

-Jared

ADSL Outage

This afternoon we are experiencing an outage on our ADSL network that manifests as end-users retaining sync but getting either extremely-slow page loads or a complete loss of the ability to surf. Our network engineering staff is currently investigating.  Fusion, dial-up, and other services should be unaffected. — John F

Update: this outage was caused by a card failure. We have switched over to replacement equipment and all affected circuits should be fixed. — Nathan and John F

Customer Database Server Upgrades

Tonight, February 10th at 12:01 AM, the shared customer database servers will undergo routine maintenance which requires a reboot of the servers.  Expected downtime for customer websites that use the shared database service is less than 10 minutes.  This work is in addition to the internal database server upgrades scheduled tonight, but is unrelated.

-Kevan

Update:  All upgrades were completed without event and customer database services are working correctly.