Month: September 2002

Mon Sep 23 08:02:18 PDT 2002 — Cable & Wireless T3 is offline. During the early morning the T3 to Cable and Wireless began to act up. By 7:30am the circuit was down and we are working with C&W to get it repaired. At this time the UUNet T3 is handling all inbound and outbound traffic. -Matt

Update – Mon Sep 23 09:42:53 PDT 2002 — C&W has escalated the trouble ticket to a Pac Bell tester and we are waiting for the results. Our UUNet T3 is reaching capacity and customers will begin to notice some latency. All services will remain available during this repair.

Update – Mon Sep 23 11:30:26 PDT 2002 — C&W is still off-line and we are continuing to work with Pac Bell and their NOC to restore service as soon as possible. In the meantime we are working to bring up transit through two of our peers at Equinix to pickup the lost bandwidth. -Kelsey, Matt, Scott and Nathan

Update – Mon Sep 23 14:17:39 PDT 2002 — C&W is back on-line after some extensive testing. They, among other things, moved us into a different interface in their router. The ckt appears to be functioning as expected. We also made progress enabling two of our peers at Equinix to be able to provide us backup transit in the event of one of our transit links failing. -Kelsey, Matt and Nathan

Mon Sep 23 17:05:02 PDT 2002 — We found a bad patch on one of our Alteons that started taking errors at approximately 16:00 hours. The patch has been replaced and the link is now error free. The bad patch may have resulted in slow and or hung connections to our mail and webservers. -Kelsey and Zeke

Wed Sep 18 07:05:44 PDT 2002 — Intermittent Cable & Wireless T3 problems. The C&W T3 has bounced a couple of times since 2am. This causes a brief slow down as traffic is rerouted. We have a ticket open with C&W and will monitor it throughout the day. -Matt

Update – Wed Sep 18 21:14:24 PDT 2002 — Thursday at 1:30am we will be testing the Cable & Wireless T3 for errors. This will not impact customers as we have redundant service via UUNet. Testing will last about 30 minutes.

Tue Sep 17 13:49:17 PDT 2002 — BUILDING MAINTENANCE – Sonic.net is closing its offices early today. Some building maintenance involving sealants has made it necessary to clear the premises for the afternoon. Technical support and billing will be closed for the rest of the day and we will resume normal business tomorrow at our regular time. We apologize for the inconvenience! – Sonic.net staff

Tue Sep 17 00:13:33 PDT 2002 — The Apache/ModSSL webservers running on both ssl.sonic.net and sonic.sonic.net have been upgraded to the latest secure release to resolve a recently announced exploit in OpenSSL. Both of the new servers appear to be functioning properly. If you experience any abnormal behavior when accessing either one of these servers, please report it to support. Sonic.net urges everyone that is running an Apache/ModSSL webserver to perform the required updates — we have already seen a number of customer machines exploited. -Kelsey, Nathan and Scott

Mon Sep 16 23:00:04 PDT 2002 — Night Operation – At 1am Tuesday morning we will be integrating a new router into our core. During this configuration we will be moving our Cable & Wireless T3 to the new router. Customers will not experience any service interruption, however, there will be a brief (30 second) period where traffic will slow slightly as our UUNet T3 takes over. This new configuration will complete the First Phase build-out of our new network infrastructure.

Our Santa Rosa routing core will consist of two Cisco 7507’s connecting Santa Rosa to our San Francisco (Focal) POP and our San Jose (Equinix) POP. Splitting our core into two border routers allows for a resilient configuration of our POPs and provides us with the hardware to move to Phase 2.

Phase 2 of our new architecture is the completion of a fiber ring linking our Santa Rosa datacenter, San Jose POP and San Francisco POP. This ring will ride UFO fiber from Santa Rosa to Equinix around the East Bay terminating in San Jose. A link from San Jose (Equinix) to San Francisco (Focal) will swing around the South end of the Bay where it will meet up with our Focal POP. Pac Bell fiber then connects Focal to Santa Rosa on two DS3’s.

This fiber infrastructure and ring topology, in conjunction with redundant routing equipment will provide Sonic.net with a fault tolerant fiber ring with plenty of room for expansion. -Sonic.net Staff

Update – Tue Sep 17 04:36:24 PDT 2002 — Night Ops complete. The Cable & Wireless T3 has been moved and now lives in our second border router.

Mon Sep 16 22:42:42 PDT 2002 — Fast busies on 522-1001. A card in the dial-up gear which serves 707-522-1001 was malfunctioning causing intermittent fast busy signals. The card has been rebooted and is taking calls again. -Matt

Mon Sep 16 04:26:42 PDT 2002 — Night ops complete. A misconfiguration during the operation caused some dial-up customers connected to 707-522-1003 to lose connectivity briefly.

Sun Sep 15 11:45:11 PDT 2002 — SSL and Macintosh w/ IE 5.x. Our SSL server, ssl.sonic.net, was running a new httpsd that didn’t agree with IE 5.x on Macintosh. We have gone back to the old httpsd program. -Scott

Sun Sep 15 09:39:59 PDT 2002 — The Downtown Wireless Network which offers 802.11b wireless access to Sonic.net customers in downtown Santa Rosa will be offline until Tuesday. We are re-engineering our backhaul of the network to our new data center and will be performing software upgrades on the server. -Matt, Nathan and Bryan