Month: June 2002

Tue Jun 11 09:35:27 PDT 2002 — Mail Server Trouble: Starting at about 3:00PM yesterday we observed and sharp increase in the number of POP3 sessions that were ‘lost’ by our servers. After many hours of troubleshooting last night we believed the problem had cleared itself up. However, this was incorrect- we are still losing about 5% of our POP3 connections for no apparent reason. If you experience any difficulty receiving mail please be patient and try again. We hope to have this resolved shortly -Kelsey and Nathan

UPDATE: We found a faulty network connection which we overlooked last night and have resolved the problems with dropped POP3 sessions.

Sun Jun 9 23:33:48 PDT 2002 — First diesel generator test run. In a simulated PG&E outage, the Leibert UPS and Detroit Diesel generator at our new 5000 sq. ft. datacenter facility delivered smooth and uninterrupted power. We ran on diesel for a 10 minute test interval, then switched back to utility power. The automatic startup, transfer, return to utility and shutdown of the generator were all handled smoothly by our transfer switch, UPS system and generator.

The generator is a 23.9 liter v-12 twin turbocharged Detroit Diesel, which produces 1024 horsepower and 750 kilowatts of power. We can effectively run forever, just by topping up the fuel tanks as they are used. This assures availability of your server, website or Internet access, regardless of summer black-outs or emergencies. -Dane

Fri Jun 7 12:32:09 PDT 2002 — Planned Supernews Maintenance: Supernews has just informed us that they have begun migration from Above.net to Equinix today at Noon. They do not expect any outage during this migration but anticipate degraded performance until they have completed, which should should take all day. Coincidentally we will also be installing some facilities at Equinix in July in order to participate in their public peering fabric. The peering fabric enables us to peer with other networks that have facilities at Equinix allowing for superior overall performance to those networks. -Kelsey

Wed Jun 5 08:33:59 PDT 2002 — Redback SMS reboot. Our Redback SMS rebooted for some unknown reason, causing downtime for FRATM, DSL, and Broadlink customers. The system is back up and authenticating interface bindings — we expect all active interfaces to be bound within the next 10 minutes.

We will be emailing the Redback’s crash dump to Redback engineers to determine the cause of the reboot. -Scott and Dane

Update: We had the SMS pre-loaded with a new software release, which had been prescribed to fix the rebooting problem. – Eli

Wed Jun 5 16:14:16 PDT 2002 — On Friday evening and Saturday, Sonic.net moved our staff and office network to our new headquarters in Santa Rosa. The move went very smoothly, and we were back up and providing technical support on Sunday morning as expected.

Credit for the smooth move and great new location goes to the site prep and move teams managed by Eli and Jen, and also to JLC Construction, Simons & Brecht Architectural, CloudBuzz Cabling, Honeywell Security, Source One Communications, McClure Electric, CalAir HVAC, Stockham and Parker construction, Secure Access Portals, Marin Flooring and Woodforms.

Thanks, everyone! Extra thanks to helpers Sean Franklin, Dustin Mollo, Jen Musil and Chris Schoenfeld. Thanks to Carl Schneider and Valley Roofing for the use of their amazing truck.

Please visit us at our new location at 2260 Apollo Way in Santa Rosa!

Datacenter moves start next week, and we’ll make notes here in the MOTD as things shift over.

-Dane