Update: All work is complete.
Tonight, August 27th, starting at 11:59pm, we will be performing updates on equipment serving a subset of Legacy DSL subscribers in the Los Angeles area. Expected downtime is 15 minutes.
– Joe @ System Operations
Category: DSL
Legacy DSL Outage LA Area
Update( 7:58 PM): While the issue turned out to be bigger than expected, all affected customers should now be online.
A small portion of legacy DSL customers in the LA area are currently offline due to a possible atm port failure. We are currently in the process of migrating customers off of the affected device.
– Robbie
Legacy DSL Maintenance
Update( 12:12AM ): This maintenance is now complete.
Tonight, beginning at 11:59 PM, we will be performing maintenance on equipment serving legacy DSL customers in the LA area. Expected downtime is around 15 minutes.
– Robbie
Legacy DSL Outage
Update( 7:49AM): This issue has been resolved.
A portion of legacy DSL customers in Northern California are currently offline due to an issue with a piece of dsl aggregation gear. We are working on diagnosing and repairing the equipment asap.
– Robbie
Legacy DSL Outage – Bay Area
Update: These customers are now be back online.
A small portion of legacy DSL customers are currently offline in the bay area due to a failed optical port in our network. We are currently in the process of migrating those customers off of the failed port to restore service asap.
– Robbie
Legacy DSL Maintenance
Tonight, beginning at 11:59 PM, we will be performing maintenance on equipment that serves a portion of legacy DSL customers in both northern and southern California. Expected downtime is less than 10 minutes.
– Robbie
Legacy DSL Outage – Bay Area
Update (10:25AM): This problem has been resolved and affected customers are now back online.
A portion of legacy DSL users in the Bay Area are currently offline due to a DHCP server problem. We are currently working towards a resolution and will update this post when we have an update.
– Robbie
Legacy DSL Outage – Bay Area
Update: These customers are now back online.
Due to an apparent optical port failure, a small portion of our legacy DSL users in the bay area are currently offline. We will be moving these customers off the affected equipment ASAP.
– Robbie
Legacy DSL Outage – San Diego Area
Update (2:32PM): We have migrated off of the bad port and customers are now back online.
A portion of legacy DSL users in the San Diego area are currently offline due to a apparent optical port failure on a piece of our aggregation gear. We are currently working on a solution and will update this post when we have moved forward.
– Robbie
Slow DNS Queries
Update:
The small DOS attack has been blocked, and service should be stable.
Starting at approximately 4am till now, our DNS servers have been  plagued by small DNS amplification attack. Any problems with slow DNS queries could be attributed to this. We are working on a fix to prevent problems like this in the future.
-Grant and the SOC