Tue Jul 2 08:32:11 PDT 2002 — We are experiencing authentication errors on our Focal POP. We are investigating this now and should have it fixed shortly. Meanwhile we do offer alternate dialup numbers in all of our dialup areas. To find an alternate dialup number you can go to www.sonic.net/cgi-bin/pops.pl . – Steve

Update – Tue Jul 2 09:36:39 PDT 2002 — We found the problem with the authentication errors and it has been corrected. The affected pop is now back up and passing traffic. – Steve, Matt and Nathan.

Tue Jul 2 18:31:47 PDT 2002 — Our news server software, Typhoon, has exited three times in the past 24 hours, causing a brief interruption in the availability of the Usenet news server each time. We’re keeping an eye on it, and will do some investigation to work out what it’s not happy about. -Dane, Scott and Kelsey.

Mon Jul 1 18:19:57 PDT 2002 — Night operations: Tuesday morning at 3am we will be moving mega (a Cisco 7507) which terminates T1, T3 and some Frame-Relay customers. This requires us to coordinate with Pac Bell to move the circuits to Apollo as we un-rack mega and drive it to the new data center. We expect the interruption to last about 30-45 minutes and will only impact customers who terminate in that router. -Operations Staff

UPDATE – Tue Jul 2 00:23:35 PDT 2002 — During this evenings migration, dial-up POP’s will experience various outages as we move circuits. Specifically our Sebastopol (numbers ending in 8812) and Oakland POP’s (numbers ending in 0174) which terminate on a T3 in mega. Some customers may find backup numbers by using our POP Finder tool located at:

www.sonic.net/cgi-bin/pops.pl

UPDATE – Tue Jul 2 05:01:10 PDT 2002 — Night Op Postponed. Pac Bell missed our 3am cut time as work in the Rohnert Park CO was not complete. Bell discovered the problem about 3:30am and by 4:20am it was clear that it was going to take too long to get the work finished. The move has been rescheduled for 3am Wednesday and Bell promises to have their work complete prior to the cut time. There was no service interruption during this operation. -Matt, Dane, Nathan, Kelsey, Zeke, Jon H., Scott B. and Mike (Pac Bell)

Sat Jun 29 12:56:46 PDT 2002 — Over the next couple weeks, we’ll be moving a number of servers and routers between midnight and 3 AM.

Some are internal, and won’t be noticed by customers. The internal servers include eye (network monitoring), bedlam (staff admin), logger (log storage), adelie and boom (fax). We will also be splitting up the RADIUS servers, moving one at a time so that user authentication is not impacted.

Other server moves will cause some customer impact. In particular, the move we anticipate to be the most intrusive and which will take the longest is the relocation of our huge NetApp filer disk array deployment. The units are dual-headed and fully redundant, but cannot be split between sites well without downtime. We will need to move the NetApps and at the same time the load balancing switches and our array of web and mail servers.

This is likely to interrupt email and hosting for two to three hours, between around 2 AM and 5 AM one night next week. We’ll keep you posted as we solidify the schedule. We will strive to keep downtime as short as possible.

Various routers and dialup equipment will also be moved over the next few weeks. Most of the dedicated T1, T3 and Frame Relay customers will move first, this coming Tuesday at 3 AM. Dialup gear for our Focal circuits will move next, and this is tentatively scheduled for Friday the 5th. This will be followed by PacBell dialup and then ATM DS3 (DSL). The router and dialup equipment moves are anticipated to take 30 to 45 minutes each.

We will post updates here as we solidify schedules and move equipment, and we appreciate your patience with any brief service interruptions as we wrap up this migration to our new facility. -Staff

Thu Jun 27 18:37:52 PDT 2002 — For a special event, Sonic.net support will be closed on Friday from 4pm to 7pm, in addition to their normally scheduled Friday training time from 1pm to 2pm. They will be open from 7pm to 9pm as usual. In addition, our administrative office will close early, at 4pm instead of 5pm. -Dane

Thu Jun 27 18:34:19 PDT 2002 — Night operations: We will be doing a low impact night operation which will not affect many services. Non service affecting moves will be made for time, ping and nameservers. We’ll also be moving flash (ftp) and timber (sql) after midnight, which will result in brief interruptions of those services. -Dane, Kelsey and Nathan

UPDATE: We moved six servers this evening: rs2, our caching name server, ping, ssl, timber, and b.smtp-out. They are all up and running in our new datacenter. -Kelsey, Nathan and Matt.

Wed Jun 26 22:38:02 PDT 2002 — BroadLink Communications submits voluntary Chapter 11 filing. BroadLink serves wireless Internet service for about 950 Sonic.net customers. We do not expect any service interruption.

On the company operations, Tim McAllister, Executive VP and co-founder of BroadLink said “Service to BroadLink customers in our markets will remain business as usual.”

We’ll keep Sonic.net customers posted on any developments with our business partner. -Dane

Wed Jun 26 09:36:32 PDT 2002 — DSL outage for certain customers. Currently a number of DSL customers on VP 1 are having a sync-no-surf type outage. This only affects certain Santa Rosa DSL customers. We are in contact with SBC/ASI to determine the nature of the problem and get it resolved- in the interim, please remember that all DSL accounts also have dial-up capability. -Aaron and Eli

Update: SBC/ASI found and fixed a DSLAM problem and normal DSL service has been restored.

Tue Jun 25 16:13:52 PDT 2002 — Wireless Rooftop Router Maintenance Sonic.net will be performing maintenance on Rooftop customers in the Rohnert Park ‘M’ Section today at 4:30pm. -Matt and Bryan

Tue Jun 25 14:09:14 PDT 2002 — Our Cidera satellite news feed has been restored. We experienced a number of hardware related difficulties restoring the service and had to wait for additional replacement hardware shipped from Cidera’s NOC on the East Coast. Our Cidera feed accounts for the majority of our binary news articles. Our 16 other news peers are capable of maintaining excellent small article completion rates and filling in the missing articles from Cidera. However, these feeds are not capable of offering us a complete feed in the event that Cidera is offline due to the amazing bandwidth requirements of a full news feed. We are continually improving our NNTP feed by seeking out peers with key NNTP hubs. -Kelsey