Category: Network

DSL Aggregation Router Maintenance Reload

This coming Friday, Feb 6 at 12:01 AM, we will be performing maintenance reloads of two of our DSL aggregation routers. These routers serve DSL to customers in the Bay Area. Expected impact is less than 5 minutes of loss of connectivity for DSL customers served by these routers.

-Jared

Update: The maintenance reloads have been completed without incident. Total downtime for affected customers was less than 5 minutes.

Unexpected Customer Router Reload

At 6:07 PM today, one of our T1 aggregation routers in Santa Rosa reloaded unexpectedly. The router is back up and serving normally at this time. We will be investigating the cause of this router reload, and apologize for any interruption of service this may have caused.

-Jared and Nathan

DSL Aggregation Router Maintenance Reload

At 12:01 AM Tuesday, we will be performing a maintenance reload of one of our DSL aggregation routers. This router serves DSL customers in the San Francisco Bay Area, and customers served by this router will experience approximately 5 minutes of downtime as the router reloads. If you find that your service is not functioning after this maintenance period, please reboot all equipment connected to your DSL line (DSL modem, router, and/or PC).

-Jared

Update: The maintenance reload has been completed without incident. All customers who were affected should be up and running again.

Emergency Router Maintenance

At 10:45AM this morning we will be performing an emergency router reload
on one of our ATM customer aggregation routers. All connected Business-T
and FRATM customers will experience approximately 5 minutes of downtime
during the reload. -Jared and Tim

Multiple Router Reload

Three of our DSL aggregation routers reloaded in quick succession due to a software bug that we have identified and are working with the router vendor on a solution.

We apologize for this inconvenience, but do not expect any further router reloads in the near future.

If your DSL is not functioning properly, please reboot all equipment (PC, modem, routers, etc) connected to the DSL line and your service will likely be restored.

-Jared and Nathan

Massive DDoS Attack

At approximately 9:30 PM tonight, an IP in our network was the target of a massive Distributed Denial of Service attack. We were alerted to the attack and blocked it at our edge quickly, but the size of the attack was large enough to congest some of our upstream network connections. This would have resulted in limited or poor connectivity to most Internet sites. This persisted for another 5-10 minutes as we were isolating the affected upstream providers and beginning to contact them to have them block the DoS in their network, however, the DoS stopped before that was necessary.

At this time the network appears normal, and we have taken steps to prevent the DoS target from being attacked again. We apologize for this network interruption.

-Jared and Nathan

Emergency Router Maintenance

One of the interface cards in a customer-serving router in Santa Rosa has suffered a software glitch this afternoon. We will be performing invasive maintenance on the affected card tonight at midnight. All T1 customers served by this card will be down for 5-10 minutes during this maintenance. There is a chance that the card maintenance will require the entire router to be rebooted. If this occurs, all T1 and wireless customers served by this router will be offline for 5-10 minutes.

Update: The router linecard maintenance has been completed without issue. The affected card is now functioning properly, and there was no need to reboot the entire router.

-Jared and Matt

Transport Link Upgrade

Tonight at 12:01 AM we will be performing an upgrade on our transport link which connects our San Francisco POP to our San Jose POP. We will be moving to a new physical transport link which will provide us with the ability to upgrade the capacity of this link in the future.

All customer traffic will be routed away from this link prior to the operation, so there should be no customer impact. The operation is expected to take 30 minutes to complete.

-Jared and Nathan

Update: The transport link upgrade has been completed. Due to a tech in San Francisco accidentally moving an incorrect piece of fiber, there was a 5-10 minute interruption of traffic from one of our core routers. We apologize for this interruption. All network links have been restored to productivity and appear to be functioning normally at this time.

Trouble with the Sonic.net Website.

Fri Oct 10 10:05:08 PDT 2008 — Trouble with the Sonic.net Website. We are currently experiencing trouble with our corp.sonic.net Web Server that serves part of the Sonic.net Home Page and all of our Blogs. We are working on the problem and will have it back soon. -Augie, William, and Kelsey.

Update: We have restored services and determined the problem being a hardware failure. We apologize for the inconvenience this may have caused. -Don and William

San Jose POP Retrofit

This Thursday, Oct 2 at 12:01 AM we will begin work retrofitting the backbone of our San Jose POP. This retrofit will enhance the redundancy and capacity of this POP to accomodate our growth and new CLEC-based products. Currently this POP does not directly serve any customers, so there should be no customer impact. We will route customer traffic away from the POP, so you may see longer routes to Internet hosts than normal during this time. We expect the operation to take 60-90 minutes.

-Jared and Nathan