Month: May 2016

System Maintenance

Update: This maintenance is complete.

Tonight, Monday 2016 05 09, at 10pm we will be performing system maintenance on equipment in our data center at 2260 Apollo Way in Santa Rosa as well as in a remote data center in San Jose.  Part of this maintenance will require us to take the ovpn server offline, likely for less than 15 minutes.  The maintenance should be completed within 1 hour.

  • Dexter K – System Operations

Network outage San Francisco

We are currently experiencing an outage in the San Francisco area. At this time we are working to isolate and address the cause of the issue to restore services as quickly as possible. We do not have an ETR at this time but will provide updates as they develop.

-Sean

(Update 12:06pm) Attempts to restore service remotely to the central office which went down have been unsuccessful. We currently have a tech in route to investigate. ETA is 1 hour, we believe we should have services restores shortly after.

(Update 1:53PM) Our technician was able to isolate the issue to two pieces of gear that had failed in the central office. One piece of equipment has been restored and a subset of customers served out of this data center should be back online. The second piece of gear will need to be replaced. There is currently no ETR on the replacement of the failed equipment at this time.

-Sean

(Update 3:08pm) The second piece of gear has been replaced. Our technician is the process of upgrading code and deploying configuration.

-Mike T.

(Update 5:00pm) The equipment is all fully online. We are scrubbing through the customer configuration to make sure all configuration is back in place. If you are still experiencing an outage, please contact your support line.

-Mike T.

(Update 5:41pm) All services restored and back online. For lingering issues please report immediately to NOC.

-Mike T.

Sonic Core Voice Maintenance

Tonight, 5/3/2016 at 11:59pm we will be upgrading a piece of equipment that is part of our core voice infrastructure.  There should be no impact to calls that are all ready in progress, but there may be a brief delay when completing a newly dialed call during the maintenance window.  Expected completion of the maintenance is 2 hours.

-Brandon

Update – Maintenance is being postponed until tomorrow night, 5/4/2016

-Brandon

Update – Maintenance will be pushed out one more day to 5/5/2016 at 11:59pm

-Brandon

Update – Maintenance is completed. 5/6/2016 at 12:15am

Brian

Fusion Fiber Maintenance – San Francisco

Tonight, 5/3/2016 starting at 11:59 we will be preforming maintenance on a small subset of Fusion Fiber customers in the San Francisco Area.  Expected downtime is 10 minutes.

-Brandon

Update: 12:01am – Maintenance is now complete

-Brandon