Fri Aug 11 15:10:48 PDT 2006 — Internal DNS Server Upgrades. We’ve upgraded the hardware on two of our internal DNS servers to better accommodate the current load they are under. These two servers handle over 10,000 DNS requests per second serving both public and private DNS based blacklists. This upgrade, combined with the hardware upgrades currently in progress on two of our other internal recursive DNS servers, will help prevent a single system failure from adversely affecting our services as a whole. -Kelsey, Augie and Dan
Internal DNS Server Outage.
Thu Aug 10 18:51:18 PDT 2006 — Internal DNS Server Outage. One of the many DNS servers that we employ internally started failing early this afternoon. We finished getting it’s replacement online and things are back to normal now. The most notable affect of this failure is in delayed email flows both in and out of our network and skipped SpamAssassin checks. -Kelsey, Augie and Dan
Intermittent packet loss.
Thu Aug 10 15:49:56 PDT 2006 — Intermittent packet loss. One of our upstream transit providers encountered a router bug this morning that caused packet loss to specific Internet destinations. Among the affected routes were several of SBC’s netblocks. The issue was fixed around 10:30am and traffic is flowing normally. -Nathan and Kavan
Customer router downtime.
Tue Aug 8 10:59:06 PDT 2006 — Customer router downtime. One of our T1 aggregation routers reloaded this morning, causing approx. 3 minutes of downtime for all attached customers. We are investigating the cause of the router reload. -Zeke, Jared and Nathan
Sonic.net company picnic.
Sun Aug 6 08:12:58 PDT 2006 — Sonic.net company picnic. Technical support will be closed today from 11AM until 5PM for our company picnic and 12th anniversary celebration. We’re sorry for any inconvenience, and will be back on duty from 5PM on this evening. -John F
DSL maintenance complete.
Thu Aug 3 00:16:24 PDT 2006 — DSL maintenance complete. The planned code upgrade to our DSL aggregator in Santa Rosa went smoothly. Total downtime for affected customers was less than 5 minutes, and all affected customers should be online again at this time. -Jared
Aftershocks.
Wed Aug 2 21:25:43 PDT 2006 — Aftershocks. Aftershocks can be referenced near-real-time from the following list:
quake.usgs.gov/recenteqs/Quakes/quakes0.htm
…where newer earthquakes are towards the top of the list.
-Scott
Earthquake was 4.4.
Wed Aug 2 20:08:12 PDT 2006 — Earthquake was 4.4. It occurred 3 miles W of Glen Ellen (9 miles SE from Santa Rosa). Earthquake links follow:
Earthquake particulars: quake.wr.usgs.gov/recenteqs/Quakes/nc40187964.htm
Earthquake SF Bay Area map: quake.wr.usgs.gov/recenteqs/Maps/San_Francisco.htm
More Earthquake information: quake.wr.usgs.gov/recenteqs/FaultMaps/San_Francisco_frames.htm
Did you feel it? You can report it to the USGS: pasadena.wr.usgs.gov/shake/ca/STORE/X40187964/ciim_form.html
-Scott
Upcoming DSL maintenance.
Mon Jul 31 17:02:17 PDT 2006 — Upcoming DSL maintenance. We are planning to perform a code upgrade on our DSL aggregator in Santa Rosa this Wednesday night at midnight. The upgrade should involve reloading the router, causing less than 5 minutes of downtime for anyone connected to that router. This router only serves DSL to some of our customers in the bay area. -Jared and Matt
DSL maintenance complete.
Thu Jul 20 00:22:06 PDT 2006 — DSL maintenance complete. The planned code upgrade to one of our DSL aggregators was completed without any trouble. Total downtime for any affected customers was less than 2 minutes. -Jared, Zeke, and Matt