Our technical support department will be closing at 9pm this Friday instead of the usual 11pm time. Â We are sorry for any inconvenience this may cause. Â The 24 hour network operations center will as always remain available for business dedicated and colocation customers. Support will re-open as usual on Saturday at 8am. Â -Dane
Author: admin
ATM Switch Maintenance
This Friday May 8 at 12:01 AM, we will be performing a card swap on one of our ATM switches. This card swap will expand our ATM aggregation capacity. A subset Business-T and FRATM customers in the North Bay area will experience 5-10 minutes of downtime as the card that serves them is replaced.
-Jared and Matt
Update: The card swap went smoothly with no unexpected issues. Total downtime for affected customers was less than 1 minute.
Large DDoS Attack
At 7:17 PM today, a large distributed denial of service attack was aimed at one of our customers. The DDoS attack reached over 1 million pps at our network edge. The primary impact of the DDoS was to destabilize the FRATM/Business-T router that it was aimed at, though all users may have noticed some sluggishness while browsing, due to the impact it had on some of our upstream transit links. The DDoS was blocked at our edge within 10 minutes, and its impact has been mitigated.
-Jared
CLEC Intrusive Maintenance
This evening, April 29th at 12:01AM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in the downtown Santa Rosa area. This will be a service affecting maintenance window and we expect customer downtime to be less than 15 minutes.
-Tim and Clay
Update: All work has been completed as planned. Customer downtime was less than 15 minutes.
DSL Uplink Failure
Earlier today, our support department diagnosed a problem with one of our DSL aggregation routers that resulted in customers served by that router having difficulties reaching some sites on the Internet. After escalating the issue, it was diagnosed that one of the redundant ATM uplinks of that router went faulty. We have disabled that uplink and will be replacing it soon. First reports of the problem were tracked by Support at approximately 3:45 PM and the faulty uplink was disabled at 4:30 PM.
-Jared and John
Brief FTP outage.
FTP access to ftp.sonic.net was unavailable for about 20 minutes today when some routine maintenance had unexpected consequences and subsequent failure — all systems are normal now. –Augie
DNS hardware upgrades.
Yesterday we completed an upgrade of our recursive DNS clusters (what you see as ns1.sonic.net and ns2.sonic.net).
This upgrade gives those DNS servers a substantial performance boost and enables them to handle the ever increasing ammout of requests that they see.
DNS is core to the Internet experience — without it : E-mail ceases to function, and surfing your favorite web-sites is impossible; it is because of this that we have always made DNS a priority in our infrastructure and are very proud of our ability to stay available even during times of high traffic and maintenance.
— Augie and Don.
Spam Filtering Glitch
One of our eight inbound mail servers has been intermittently failing to apply some of our front line spam filters for the past couple of days. This lead to additional spam getting through to SpamAssassin and Graymail as well as into all of our inboxes. We’ve added additional monitoring to catch and alert us of this failure in general and have also identified the specific cause and are taking steps to correct it. -Kelsey
DSL Aggregation Router Maintenance Reload
Tonight, April 21 at 12:01 AM, we will be performing a maintenance reload of one of our DSL aggregation routers. This router serves DSL to customers in the Bay Area. Expected impact is less than 5 minutes of service interruption for DSL customers served by this router.
-Jared
Update: The SMS reboot did not go as smoothly as planned. Due to a configuration error, on reboot, the router loaded an archived configuration that was out of date. The proper configuration has been restored and all affected customers should now be back online. We apologize for this additional downtime.
Denial of Service Attack
At approximately 3PM today a DoS attack was aimed at one of our Business-T customers. The attack saturated the uplinks of one of our customer aggregation routers, causing 5-10 minutes of service interruption to customers served by that router. The DoS attack has been blocked at our network edge.
-Jared