San Francisco Fusion/FlexLink Outage

Update (11:40am): All service has been restored. We are investigating the problem with our hardware vendor to prevent this problem from happening in the future.

Today, September 17, equipment serving a subset of subscribers in the San Francisco area stopped passing traffic after software upgrades during scheduled maintenance. We are working to restore service to all affected customers.

-Michael

Fusion/FlexLink Intrusive Maintenance – San Francisco

Update (2:00AM): This maintenance is now complete.

Beginning tonight at midnight I will be performing software upgrades on equipment serving Fusion/FlexLink customers in San Francisco. Expected downtime is around 15 minutes. Some VDSL users may experience a longer period of downtime.

– Robbie

Fusion/FlexLink Intrusive Maintenance

Update( 12:30AM ): This maintenance is now complete.

Beginning tonight at midnight I will be performing software upgrades on equipment serving customers in Windsor, Rohnert Park, and Healdsburg. Expected downtime is around 15 minutes.

– Robbie

Legacy DSL Outage – Lata 1

We currently are experiencing an outage affecting Legacy DSL and Biz-T customers in Lata 1.  We are currently working on the issue as fast as we can and will update as the situation progresses.

thanks, Brandon

Update:  The issue is now resolved.

Update(11:51am): I will be performing an emergency maintenance reload of the affected equipment tonight at 11:59pm. Expected downtime for affected Business-T and Legacy DSL customers is less than 15 minutes. — Tomoc

Update(9/10-12:20am): Maintenance complete.

-Brandon

Issues Resolving Netflix CDN

One of Netflix’s domains was incorrectly flagged by one of our DNS DoS protection tools which resulted in many customers not being able display images while using their Netflix apps.  I’ve disabled the tool pending further review to see if it can be reinstated without risking additional false positives like this.  If you’re still having trouble with images in Netflix, restarting your system (TV, Roku, etc.) or flushing your DNS cache should fix it.  We’re very sorry for any inconvenience this may have caused. – Kelsey

System Maintenance

Update: All updates were complete as of 1:00am this morning.

System Operations will be performing updates tonight starting at 11:59pm. The following services may be temporarily unreachable for a few minutes as servers are rebooted:

  • Member Tools
  • Webmail
  • Mail (IMAP/POP3)
  • Secure Hosting

— Joe and the SOC

Fusion/FlexLink Outage

Today, September 3, starting at 9:45am, fiber facilities serving Fusion/FlexLink subscribers in Fort Bragg, Mendocino and Ukiah experienced a failure. At this time we believe this outage is being caused by a fiber cut affecting multiple carriers. Updates will be provided as they become available.

Update(10:50am): Fiber cut confirmed. No ETR yet.

-Tomoc

Update(1:53pm): Crews are working on restoral of fiber cut. No ETR. See below link to Press Democrat article outlining the severity.

http://www.pressdemocrat.com/news/4429875-181/internet-phone-and-wireless-service

-Mike Tardif

Update(6:25am): All traffic appears to be restored at this point. No official word from construction that the trouble is permanently cleared yet.