Sat Jan 25 00:09:11 PST 2003 — The Internet has broken. We do not yet know the source of the DoS but we believe that it may be another worm that attacks Microsoft servers. At this time, large portions of the Internet are still unreachable. There have been widespread reports that this DoS also took the lives of many Cisco routers, including one of our 7500 border routers. Our internal network is functioning at 100% but many sites have yet to restore service and I would anticipate, may not return for some time.

A very interesting graph of this event and it’s effect on the Internet as a whole is available at the following link: average.matrix.net/ -Kelsey and Nathan

Fri Jan 24 10:47:59 PST 2003 — A configuration error (operator error) on our part caused a problem for customers that have us listed as a secondary mail exchanger for their domains. This is a very small percentage of our customers, and the symptom manifested itself as bounced mail only when the customers’ primary mail server was unavailable. _I_ apologize for the misconfiguration. — Eli

Fri Jan 24 22:29:43 PST 2003 — High latency and packet loss. We are currently experiencing high latency and packet loss in portions of our network, including part of our core. We are investigating the situation, and will hopefully have things back to normal soon. Kelsey is on-site. -Scott, Kelsey, and Nathan

Update Fri Jan 24 23:11:01 PST 2003… This turns out to be a massive worm which is causing denial of service (DoS) across the Internet. UUNet has characterized this as “the DoS of the year”. The vector is Microsoft SQL servers. So far, we have found 7 servers pumping 100 megabit/second into our core, which is the cause of the high latency and packet loss within portions of our network. We continue to work the problem. -Scott, Kelsey, and Nathan

Fri Jan 24 08:58:07 PST 2003 — Our Second POP in Santa Rosa is currently experiencing packet loss and slow performance due to some problems which are beyond our control. We’ve taken what steps we can to improve the situation here but it’s out of our hands. We anticipate that the other parties involved will have he situation repaired shortly. In the meantime, if you are experience poor performance on your dial-up connection, we suggest that you change to an alternate number for your area which can be found using the pop finder at www.sonic.net/cgi-bin/pops.pl -Kelsey and Nathan

Update: This issue has been resolved.

Fri Jan 24 18:43:54 PST 2003 — Night Operations: Saturday starting at 1:30AM (tonight) we are going to upgrade the OS and one of the interface cards on the SMS 1800. We anticipate minimal downtime of less than 5 minutes while the cards are swapped and the box reloads on the new OS. However, if we run into difficulty it could take a bit longer. While we are working on the SMS, all SBC ADSL and FRATM customers will be offline. We’ll also be changing a few configuration options on our NetApps that may cause momentary un-reachability as we reconfigure their gigabit ethernet interfaces. -Kelsey and Nathan.

Tue Jan 21 18:06:06 PST 2003 — Earlier today at approximately 2:00PM some of Broadlink’s head end gear locked up and stopped responding. They were able to restore service to customers within a few minutes. -Sonic Ops

Mon Jan 13 12:10:52 PST 2003 — We have added catch-all aliases to all remaining domains hosted on our servers that did not already have catch-all alias in place. This, and the modification of our member tools, should eliminate the mis-delivery of email associated with missing catch-all email aliases. -Kelsey and Russ

Sat Jan 11 18:06:51 PST 2003 — SSL Reboot. Our SSL server rebooted at 6pm this evening and didn’t start all services correctly. We manually started the services and fixed the config file which should have started them automatically. Our web mail and SSL customers were affected for about 8 minutes while we diagnosed the problem. The server is now back up and functioning. -Matt and Kavan

Sat Jan 11 03:10:37 PST 2003 — Night Operations Completed: The installation of the new shelves and disks onto our NetApp cluster was uneventful and took only a few minutes to complete. We didn’t fare so well with the SMS upgrade and have had to postpone its upgrade until next week at least due to unforeseen circumstances. We did not interrupt service to any ADSL or FRATM users. -Kelsey, John, Nathan and Zeke.

Fri Jan 10 10:01:00 PST 2003 — .INFO domain names can now be registered for one year. This is down from the two year minimum registration term previously imposed by the .INFO registry.

To find out more about registering domain names with Sonic.net, please visit our domain tool located at: sonic.sonic.net/members/domain_tool/ -Chuckc