Tonight, Thursday, January 26 at 11:01 PM, we will be replacing the second core router in our datacenter. The switchover should only take a few minutes, and traffic will be routed around the affected router. If there is any disruption, it should not last more than 5-10 minutes at worst.
-Jared
Update: The router replacement was completed without incident. There should have been no impact to customer traffic.
Tonight, Tuesday January 24 at 12:01 AM, we will be replacing the core router in our datacenter which failed earlier this morning. The switchover should only take a few minutes, and traffic will be routed around the affected router. If there is any disruption, as routing updates, it should not last more than 5-10 minutes at worst.
-Jared
Update: The router replacement has been completed without incident. There should have been no impact to customer traffic. In a few days we will schedule a replacement of the other in the pair of redundant routers in our Santa Rosa datacenter.
At 5:32 AM today, one of our core routers in our Santa Rosa datacenter unexpectedly restarted its routing processes. This caused 5-10 minutes of impacted connectivity to our datacenter as the network recovered from the event. This would have affected access to mail, Sonic.net hosted websites, and colocated servers.
Ironically, we had already scheduled retirement and replacement of our core routers in the Santa Rosa datacenter for this upcoming week. We will accelerate our plans due to this event, and apologize for any impact it may have caused.
-Jared
Today we have updated our member tool authentication code. This is a transparent change in our back end code and does not require any end user changes. We believe this will resolves an intermittent bug that was causing users to occasionally have to re-authenticate their session and also results in a slight performance increase while using the tools.
-William
This Thursday, December 29 at 12:01 AM we will be performing core configuration changes on the routers at the head end of our Legacy DSL aggregation network. We will be taking all possible precautions to prevent any outages, but when doing this type of deep configuration change, the possibility of a problem is always present. The reconfiguration should take between 30 and 60 minutes, and we will be able to roll back quickly in the event of an issue.
-Jared and Nathan
Update: The reconfiguration has been completed. There were a couple brief, unexpected hiccups which disrupted connectivity to a small subset of our legacy DSL customers. We apologize for any inconvenience this may have caused.
This Wednesday, December 28 at 12:01 AM, we will be performing a maintenance reload on our ATM customer aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers.
-Jared
The server that handles ssl.sonic.net (our legacy shared https web hosting server) suffered a double disk raid failure (in a mirror) this afternoon and was offline for approximately 23 minutes while we restored to replacement disks from our backups. -Kelsey and William
Sonic.net will be closed today from noon to five pm for our annual staff holiday party. Thanks everyone for a great 2011, it has been our best year yet. Our rapidly growing team (135 of us now!) will be raising a glass to toast our customers this afternoon.
Technical support will re-open 5pm-11pm, and we will be returning calls to anyone who has left a message during the closure. Our 24×7 network operations team will be available on call on the NOC hotline for our Enterprise dedicated circuit and colocation customers.
Starting around 1pm pst Network Solution’s name servers became unreachable. This problem appears to be isolated to the west coast. Network Solutions has been made aware of the problem, and are working on a fix.
Tonight, Wednesday December 7th at 12:10 AM we will be migrating all databases currently on our MySQL 4.1 database server to our new MySQL 5.5 server. We are anticipating approximately 2 hours of downtime. -William and the SOC
Update: All services have been migrated to the new server.