Thu Jun 21 10:11:35 PDT 2007 — DSL Aggregation Equipment Maintenance. At 12:01am on Friday, June 22nd we will be performing emergency maintenance on a portion of our DSL aggregation infrastructure in San Francisco. Customers in Los Angeles as well as a large portion of our LATA 1 customers will be affected by this operation. Business-T customers served in those areas may also experience service interruption. While expected downtime is approximately 15 minutes, we’re reserving a one hour maintenance window in case of further trouble. -Nathan and Jared

Update Fri Jun 22 00:54:44 PDT 2007 — We’ve completed our work for the evening. Actual downtime was approximately 12 minutes for each affected customer. -Nathan and Jared

Tue Jun 12 14:46:00 PDT 2007 — Backbone circuit maintenance. At 9:00 AM on Wednesday June 13 AT&T will be performing maintenance on our GigaMAN circuit between our Santa Rosa and San Jose POPs. The circuit will be down for approximately 15 minutes while AT&T replaces hardware. During this time traffic will flow around our redundant links around the bay, so there should be no impact to connectivity. -Jared

Sat Jun 9 15:24:01 PDT 2007 — DSL Service interruption in LATA 9. Shortly after 3pm today an SMS interface serving the Stockton and Modesto areas failed, causing sync-no-surf conditions. Our network operations staff is currently working to bring service back online. DSL service in these areas should be restored within the hour. Non-DSL connections and service outside this ares should be unaffected. -John F and Nathan

Update Sat Jun 9 15:36:03 PDT 2007 — Service was restored around 3:30pm. Customers in LATA 2, the Chico and Redding area, may have experienced a brief connectivity outage for under five minutes while work was being performed. -John F and Nathan

Fri Jun 8 10:16:45 PDT 2007 — Stockton DSL Aggregation Upgrade. On Tuesday, June 12th at 12:01am we will be upgrading the aggregation circuit that services the Stockton/Modesto area. Expected downtime during this migration is approximately 30 minutes for all customers, though some may experience a significantly shorter outage. The increased capacity will allow further growth in this area without the possibility of performance degradation due to overcrowding. In addition, the new circuit rides an end-to-end redundant path from Stockton to our aggregation hub in San Francisco, further increasing the reliability of our DSL offering. -Nathan and Kelsey

Update Tue Jun 12 00:14:02 PDT 2007 — This migration has been completed successfully. Downtime was under 6 minutes for all customers, with most experiencing less than 3 minutes of service interruption. -Nathan

Fri Jun 8 13:24:01 PDT 2007 — Cable cut in Eureka. Early Friday afternoon, an unexpected cable cut has resulted in loss of DSL service and interruptions in local telephone service in the Eureka, Arcata, and Rio Dell areas. DSL outages affect at least 24 DSLAMs in the area, and we have no ETR at this time. -John F and John K

Fri Jun 1 10:48:28 PDT 2007 — San Francisco power maintenance. Tonight at midnight we will be performing some minor power maintenance at our San Francisco POP. This maintenance will cause a lack of connectivity for dial-up and hotspot customers for approximately 5 minutes. We apologize for the inconvenience. -Nathan

Sun May 20 04:37:33 PDT 2007 — Scheduled maintenance of customer data is complete.

Customer /home and FTP data moved quickly and the bulk of the work which was the Web data took the bulk of the time, but was completed within the scheduled maintenance window.

All services have been restored and all customer data has been verified. -Augie and Kelsey

Fri May 18 06:37:23 PDT 2007 — Dialup service interruption. A hardware failure of one of our routers in our San Francisco POP caused a loss of connectivity to some of our dialup users. We have routed around the failed hardware and all affected customers should have full connectivity again. We are working to replace the failed hardware ASAP. -Jared and Nathan

Update Fri May 18 07:07:09 PDT 2007 — In order to completely resolve the failed hardware problem, we needed to reload the affected router. This would have temporarily affected connectivity to a number of T1 and dialup customers. We will continue to investigate this failure. At this time, everything is functioning normally. -Jared

Tue May 15 15:50:40 PDT 2007 — Scheduled maintenance of our customer data storage system during the early hours of Sunday May 20th.

Early Sunday morning we will be migrating away from our current set of NetApp Filers to a new set of NetApp Filers. These new Filers feature faster disks, more RAM, greater speed and reliability as well as a much higher storage capacity.

This upgrade marks a significant improvement to the system that houses the majority of our customers’ data, and will allow Sonic.net to provide continued performance and storage capacity far into the future.

Over the last few weeks we have been transparently migrating customer data on to the new NetApps and have been very impressed by their performance and reliability.

The total scheduled maintenance window is 4 hours (0:00 – 04:00), but we expect the actual time spent migrating data to be much less. During this time services such as shell, mail, and websites will be unavailable for a period of time as we migrate that particular data set.

-Augie, Kelsey, Dan, Nathan, Dane.

Wed May 9 11:04:45 PDT 2007 — DSL hardware restoration. The DSL hardware that failed yesterday has been repaired and at 12:01 AM Thursday May 10, we will be moving back to the original hardware. Expected impact is 5 minutes of downtime for the DSL customers terminated on this hardware. -Nathan and Jared

Update Thu May 10 00:14:50 PDT 2007 — Technical considerations have caused us to postpone this migration until 1:00 AM this evening. Sorry for the delay! -Nathan