At 3:45AM this afternoon we will be performing an emergency router reload on one of our ATM customer aggregation routers. All connected Business-T and FRATM customers will experience approximately 5 minutes of downtime during the reload. -Jared and Matt
Data backup storage increase.
Due to the overwhelming interest in our Sonic.net Data Backup service we have had to greatly expand the storage capacity of our backup servers. Our data backup service will be unavailable this morning for a few hours while we migrate data to our new servers. Any pending backup jobs will continue once data migration is complete and the backup servers are back online. For more information about Sonic.net Data Backup please see our sales page.
-William and the SOC
DHCP Server Failure
One of the DHCP servers that serves our Bay Area DSL subscribers had a disk begin failing, which caused the server to not properly handle all DHCP requests sent to it. This caused spotty DHCP connectivity for some customers until we were able to diagnose the silently failing disk. We have removed the failing server from service, and DHCP service should be fully restored to the affected customers.
-Jared and Nathan
DSL Aggregation Router Maintenance Reload
This coming Friday, Feb 6 at 12:01 AM, we will be performing maintenance reloads of two of our DSL aggregation routers. These routers serve DSL to customers in the Bay Area. Expected impact is less than 5 minutes of loss of connectivity for DSL customers served by these routers.
-Jared
Update: The maintenance reloads have been completed without incident. Total downtime for affected customers was less than 5 minutes.
Unexpected Customer Router Reload
At 6:07 PM today, one of our T1 aggregation routers in Santa Rosa reloaded unexpectedly. The router is back up and serving normally at this time. We will be investigating the cause of this router reload, and apologize for any interruption of service this may have caused.
-Jared and Nathan
Emergency Provider Circuit Maintenance
The backhaul provider of our circuit that provides DSL service to the Chico area must perform card maintenance that will disrupt our service to that area. The expected downtime is between 1 and 15 minutes as they replace the card, and is scheduled to occur tomorrow, Friday, Jan 30, between 5AM and 6AM. We apologize for this necessary interruption of service.
-Jared and Nathan
SMS Uplink Maintenance
One of the uplinks on our SMS that terminates DSL for subscribers in Sacramento is taking errors, causing slight packet loss for all subscribers on that SMS. At 11:45 today, we will be moving that uplink to a new port to resolve the problem. This move will cause 5 minutes of loss of connectivity for all subscribers on this SMS.
-Jared and Nathan
Update: This uplink move has been completed with no complications. Service from this SMS is now trouble-free.
Central Office Outage
We’re currently working on an outage affecting the BKLYCA01 central office. Fusion and FlexLink customers served off this Central Office are currently without connectivity. The problem has been traced to a broken fiber link between OKLDCA03 and BKLYCA01. We’ll update when we have more information. -Nathan and Jared
Update: The affected link has been restored and all customers served by BKLYCA01 are back on-line. -Nathan
Scheduled webmail database maintenance
Starting at 12:30AM this morning, I will be performing maintenance to our databses which serve all our webmail interfaces. During this time, access to these interfaces will be interrupted for a short period of time, however these actions do not interfere with mail flow in any way. This does not have any effect on IMAP or POP services. –Don
Update: The maintenance on our webmail databases has been completed without incident. All Sonic.net Webmail interfaces are back online.
Santa Rosa Datacenter Power Maintenance
We’re doing some massive power work at our Santa Rosa data center and collocation facility on the 24th in order to support our new 500kva UPS. All of the work is fully scripted and we do not anticipate any interruption in power services. However, worst case, one or more of the UPSes serving our Santa Rosa data center may lose power. For most customers this would only mean an interruption in email and hosting services. If you’re interested in learning more, watch for the pending “what’s new” item. -Russ and Kelsey
Update: This work was completed as planned, with no interruption in service. For details, see http://corp.sonic.net/ceo/2009/01/24/power-upgrade/. -Dane