This evening at about 5:20 PM, a network reconfiguration caused our DNS resolver load to be shifted onto only one of our multiple load-balanced DNS servers. The server was unable to cope with the full load alone, and was providing sluggish DNS responses, causing Internet connections to appear down or sluggish. We resolved the issue at about 6:45 by re-balancing the DNS traffic. We apologize for this disturbance and will be revisiting our DNS server architecture soon.
-Jared, Kelsey and Nathan
This evening, beginning at 12:01AM, we will be performing maintenance on equipment serving FlexLink Ethernet customers in Berkeley, Los Altos, and the SoMa area of San Francisco. Affected customers should experience less than 10 minutes of downtime.
-Tim
This Tuesday, May 11 at 11:01 PM, we will be performing backbone maintenance at our San Francisco POP. This maintenance will be moving our existing transit and transport load to our new T320 backbone routers. We should be able to perform this work without disruption to customer traffic, but work of this magnitude always carries a risk of impact.
-Jared and Nathan
Update: The backbone maintenance was completed at about 2AM. There should have been no major outages as we reconfigured our backbone. We are now completely live on our new 10 Gigabit Backbone ring!
This Saturday, May 8 at 12:01 AM we will be performing maintenance reloads of two Redbacks that terminate traditional DSL service. This will affect all some of our Los Angeles and Sacramento DSL subscribers. Expected downtime is 5 minutes.
-Jared
The scheduled reloads have been completed without incident. All affected customers are back online after about a 5 minute outage.
This evening, beginning at 12:01AM, we will be performing maintenance on equipment serving FlexLink Ethernet customers in Napa, Oakland, and Windsor. Affected customers should experience less than 10 minutes of downtime.
-Tim
This evening, beginning at 12:01AM, we will be performing maintenance on equipment serving FlexLink Ethernet customers in Rohnert Park and Petaluma. Affected customers should experience less than 10 minutes of downtime.
-Tim
Tonight at 12:01 AM, we will be performing backbone maintenance at our San Jose POP. This maintenance will be moving our existing transit and transport load to our new T320 backbone router. We should be able to perform this work without disruption to customer traffic, but work of this magnitude always carries a risk of impact.
-Jared and Nathan
Update: All appears well. We’re calling it a night, without any observable customer impact.
-Nathan and Jared
This evening, beginning at 12:01AM, we will be performing maintenance on equipment serving FlexLink Ethernet customers in Healdsburg. Affected customers should experience less than 10 minutes of downtime.
-Tim