This Wednesday, August 5 at 12:01 AM, we will be re-profiling all of our ADSL2+ lines. This will cause all ADSL2+ lines to have to re-sync, causing a minute or two of downtime for any Fusion or Flexlink ADSL2+ customer. If you have problems with your ADSL2+ line after this operation, please reboot your modem.
-Jared
Update: We have completed the re-profiling of all our ADSL2+ lines. All affected lines should be up and running at the new speeds.
This Thursday, at 12:01 am, we will be performing some intrusive maintenance on one of our DSLAM’s in San Francisco. This DSLAM serves Fusion & Flexlink ADSL2+ in the Lower Pacific Heights/ Western Addition area. This work will cause an interruption of service for about 20 minutes while we replace a suspected bad cable.
-Clay
This Tuesday, June 23 at 12:01 AM we will be performing maintenance reloads of the routers that terminate our Business-T service, and two Redbacks that terminate traditional DSL service. This will affect all Business-T customers, all Fresno DSL subscribers, and a small subset of DSL customers in the Bay Area. Expected downtime is 5 minutes.
-Jared
Update June 23 12:31 AM: The Redback reloads were completed without incident, and all DSL customers should be back online at this time. Our Los Angeles POP Business-T router locked up during the reload and required a physical reboot to come back up properly. For this reason Business-T customers in the Los Angeles area experienced approximately 15-20 minutes of downtime. Our other Business-T routers reloaded without incident. All services affected by this maintenance have been restored at this time.
This Tuesday, June 16 at 12:01 AM, we will be performing a software upgrade of our DSLAM that serves Fusion and Flexlink services to customers in the Downtown Santa Rosa area. Expected downtime is 10-15 minutes for the DLSAM to be rebooted onto the new software release.
-Jared
Update: The software upgrade has been completed without incident. Downtime for affected customers was less than 5 minutes.
This Wednesday, June 17 at 12:01 AM, we will be performing a maintenance reload of one of our ATM switches that serves DSL to customers in the North Bay area. Customers served by this switch will experience 5-10 minutes of downtime.
-Jared
Update: The ATM switch was rebooted at approximately 12:20 AM and is functioning normally. Total downtime for affected customers was under 10 minutes.
This evening, June 3rd, at 11:00PM we will be inserting a new interface card into one of our aggregation routers. This router provides FlexLink Long Range coverage for the Petaluma area. This work is not expected to cause an interruption of service, but a router reload may be required to complete this operation. If a reload is required, customers served by the affected router will experience 5-10 minutes of service interruption.
-Clay
This evening, May 28 at 11:00 pm, we will be inserting 3 new interface cards into one of our aggregation routers. This router provides Flexlink coverage for the Sebastopol area. This work is not expected to cause an interruption of service, but a router reload may be required to complete this operation. If a reload is required, customers served by the affected router will experience 5-10 minutes of service interruption.
-Clay and Jared
Beginning at 11:51 AM we began experiencing problems with queries to www.sonic.net and some of our name based hosted customers. During this time, customers may have experienced intermittent connection errors. We have determined the problem to be a hardware problem with one of our load balancers. Because of the nature and obscurity of the problem, the period in which there was delay or question refusals is estimated at 20-24 minutes. We apologize for this unexpected downtime. Service has since been restored to full normal operation. –Don, Augie, and the SOC
At 7:17 PM today, a large distributed denial of service attack was aimed at one of our customers. The DDoS attack reached over 1 million pps at our network edge. The primary impact of the DDoS was to destabilize the FRATM/Business-T router that it was aimed at, though all users may have noticed some sluggishness while browsing, due to the impact it had on some of our upstream transit links. The DDoS was blocked at our edge within 10 minutes, and its impact has been mitigated.
-Jared
Earlier today, our support department diagnosed a problem with one of our DSL aggregation routers that resulted in customers served by that router having difficulties reaching some sites on the Internet. After escalating the issue, it was diagnosed that one of the redundant ATM uplinks of that router went faulty. We have disabled that uplink and will be replacing it soon. First reports of the problem were tracked by Support at approximately 3:45 PM and the faulty uplink was disabled at 4:30 PM.
-Jared and John