Month: August 2001

Wed Aug 15 18:38:52 PDT 2001 — Update: PacBell and SBC-ASI technicians continue to work to resolve the outage on our ATM DS3 link. A technician has found an open connection in a PacBell central office, and is on his way there to isolate the issue. We hope for resolution “very soon now”.

Wed Aug 15 15:55:53 PDT 2001 — Update: SBC-ASI reports that they have been unable to determine the cause of the failure of our PacBell ATM backhaul circuit. They are dispatching a technician to our site, and we hope that with further on-site testing, they’ll be able to isolate the trouble.

During testing of this circuit, we’ve found that the neighboring BroadLink ATM interconnection had an unreliable physical connector on one of the cables. This caused BroadLink customer connections to bounce a few times. The cables have been replaced, and we don’t expect further impact for BroadLink customers.

Wed Aug 15 13:44:32 PDT 2001 — Update: SBC-ASI testers are inspecting the circuit, no ETR yet. This outage affects Pacific Bell ADSL customers, and several of our T1 customers that cross connect via our ATM. -Kelsey, Nathan, Eli, Russ & Steve

Tue Aug 14 18:16:07 PDT 2001 — We will be performing upgrades to our internal MySQL server at 9:30pm tonight. Member tools will be offline for the duration of the work which should be completed within 15 minutes. -Kelsey & Nathan

Fri Aug 10 16:05:22 PDT 2001 — Marine.sonic.net is down due to a flood of outbound spam sent by a malicious user. We are working to correct the issue, until then outgoing mail delivery may be delayed. No mail will be lost. – Russ, Scott, Nathan and Steve

Fri Aug 10 00:38:07 PDT 2001 — Some minor maintenance to the Broadlink ATM circuit required approximately 15 minutes of downtime, beginning at 12:30 AM. -Kevan and Steve

Thu Aug 9 10:47:14 PDT 2001 — CodeRed filters have been added to our remote pops in Napa, Sebastopol and pops covered by the PacWest group. PacWest pops are numbers that end with 0174. -Steve

Tue Aug 7 09:46:42 PDT 2001 — BroadLink reports that the tower site in Wikiup that serves Northwest Santa Rosa had problems this AM, and that they have resolved the problem. The outage started at 8:23AM and the trouble was resolved at 9:13AM.

In other BroadLink news, John Navas has written an overview of wireless broadband technologies for TechTV. You can read it at:

www.techtv.com/print/story/0,23102,3339884,00.html

Tue Aug 7 02:19:48 PDT 2001 — Night Operations Complete: We’ve completed the upgrades to both spiff, the MySQL server, and the RedBack. Both upgrades appear to have been successful. -Kelsey and Nathan

Mon Aug 6 17:58:23 PDT 2001 — Night Operations. Tonight at midnight we will begin a migration of our internal MySQL to new hardware to resolve some ongoing stability issues. The new MySQL server is configured to use our redundant NetApp filers for data storage instead of a local RAID. Our tests show that this setup performs remarkably well while providing increased redundancy. During the upgrade the member tools will be unavailable.

We will also be rebooting the RedBack SMS onto the latest General Deployment release. RedBack assures us that this release has resolved the spontaneous reboot issues that plagued the last GD release. The RedBack only takes a few minutes to reload; PacBell ADSL and Broadlink WDSL customers will be down briefly. -Kelsey, Nathan and Eli.