Update(12:45AM): This maintenance is now complete. A single card on a DSLAM did not upgrade properly and is now operating incorrectly. We will be dispatching a technician to replace the card this morning.
Update(11:00PM): This maintenance has been postponed until tomorrow night.
Tonight, beginning at 11:59 PM, we will be performing intrusive maintenance on equipment serving some Fusion and FlexLink customers located in San Francisco. Expected downtime is less than 15 minutes.
– Robbie
Update(6:45PM): Affected customers have been migrated and are now back online.
A portion of legacy dsl customers in northern California are currently offline due to an atm port failure. Those customers are being migrated to a backup port and should be back online once that process is complete.
– Robbie
Tonight, starting at 11:59PM, we will be performing maintenance on gear that aggregates some legacy DSL connections in northern California. Expected downtime is less than 10 minutes.
– Robbie
Update (12:15AM): This maintenance is now complete.
Tonight, beginning at 11:59 PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers located in eastern Santa Rosa. Expected downtime is less than 15 minutes.
– Robbie
A very small subset of enterprise customers served out of San Francisco will experience a breif outage tonight at midnight due to routine system maintainence.
Expected downtime will be less than 5 minutes.
-Mike Tardif
-NOC
This evening, beginning at 2:00AM, we will be performing intrusive maintenance on equipment serving FlexLink customers in Santa Rosa. Expected downtime is less than 15 minutes.
-Matt
Update(12:50AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in the greater Los Angeles area. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Update (12:58PM): A temporary workaround for customers served out of the San Jose CO affected has been implemented. Service should be restored for these customers at htis time.
Update (8:30AM): Att has a construction crew and splicers on site. Still no ETR given.
Update(9:30PM): Att has confirmed a fiber cut and are working towards a resolution. No ETR has been given yet.
Update (8:15PM): This appears to be a fairly substantial fiber cut in the San Jose area. I don’t have definitive confirmation from At&t at this point but all signs are pointing towards this. No ETR yet.
A portion of our customers are currently offline in the San Jose area. We are investigating the issue and will update this post once we know more.
– Robbie
Update:(7:25AM): Fiber splicers worked thru the night to complete repair of the damaged cable. All inbound calling issues caused by this outage should be resolved. Please contact support if you continue to experience any problems.
Update: (9:15PM): Fiber splicers are on site excavating the damaged cable. We do not yet have an ETR as the extent of damage is yet to be fully determined.
Update: (6:24PM): This outage was caused by a fiber cut in one of our upstream voice providers’ network. This outage is affecting some dial-up, Fusion, and FlexLink calls. We will continue to provide updates as they become available.
Update: (6:15PM): We also believe that some dial-up users may be having issues with that service as well. We are still investigating the voice problems.
We are receiving reports of some Fusion users having trouble with calls inbound to their lines. We are investigating these reports with our upstream provider and will update this message when we have more information.
– NOC
Update: All work is complete.
Tonight, August 27th, starting at 11:59pm, we will be performing updates on equipment serving a subset of Legacy DSL subscribers in the Los Angeles area. Expected downtime is 15 minutes.
– Joe @ System Operations