Mendocino, Fort Bragg, Palo Alto, and Mountain View – Fusion/Flexlink Intrusive Maintenance

Tonight, 1/6/2017, starting at midnight, we will be replacing cards serving a subset of customers in the Mendocino, Fort Bragg, Palo Alto, and Mountain View areas. Expected downtime is around 20-30 minutes while the cards upgrade themselves and reboot. The maintenance window is from 12am – 5am.

Update(9:13am): A small subset of customers in the Mountain View area are still down due to an issue with one card after the upgrade. We are working to restore service as quickly as possible.

Update(11:28am): The last of the affected customers have been fixed. Maintenance complete.

-Network Engineering

Santa Rosa Data Center – Outage

Around 8:04pm Sonic experienced an NTP attack to our data center – taking down connectivity to services hosted within.  We have put in place measures to prevent the attack from happening further and service stability has been restored.

-Network Engineering

Voice Equipment Maintenance

Update (12:59AM): Maintenance is complete. Due to some unexpected complications, customers may have experienced interruptions in voice service between 12:08 and 12:13AM.

Today at 4:26PM we experienced an equipment failure upstream of our core voice network. This device is redundant so customer impact for this event should have been minimal. Tonight beginning at midnight we will be replacing this hardware. We do not expect this to cause any downtime.

-Network Engineering

San Francisco – Fusion/FlexLink Intrusive Maintenance

Update (1:38AM): Maintenance Complete

Beginning tonight at midnight, we will be performing upgrades on equipment serving a small subset of Fusion and Flexlink customers in San Francisco. Expected downtime for this operation can be up to 2 hours, but is typically less than 30 minutes for most customers. This maintenance will not affect any Fusion Fiber customers.

-Network Engineering

Ukiah — Fusion/Flexlink Intrusive Maintenance

Update (1:45) Maintenance complete.

Tonight, 12/28/2016, at midnight we will be conducting maintenance effecting Fusion and Flexlink customers in the Ukiah area.  Expected downtime is somewhere around 15-30 minutes while equipment is rebooting.

-Network Engineering

San Francisco – Fusion/FlexLink Intrusive Maintenance

Update (12:42AM): Maitenance complete.

Beginning tonight at midnight, we will be performing upgrades on equipment serving a subset of Fusion and Flexlink customers in San Francisco. Expected downtime for this operation can be up to 2 hours, but is typically less than 30 minutes for most customers. This maintenance will not affect any Fusion Fiber customers.

-Network Engineering

FTTN Non-Intrusive Voice Maintenance

Update(11:02pm) – Maintenance Complete.

Beginning tonight at 11pm I will be upgrading config for all ATA’s for FTTN customers.  This will cause the ATA to be temporarily unavailable as it upgrades for about 5-10 minutes.  The upgrade process will not initiate if you are on a call at that time, so there should not be any dropped calls.  ATA’s check their config every hour so this process should not start until midnight.

Thank you

-Brandon

SMS support system outage

Update: SMS support services have been restored, and a root cause of the failure has been identified and is being investigated.

 

Sonic Operations is currently investigating an outage involving the SMS support system.

While SMS support is offline, please call in for support at (888) 766-4233.

An update will be posted when this issue is resolved.

Webmail Upgrade

Tonight, Wednesday December 7th at 11:59 PM we will be upgrading webmail.  The downtime is expected to last no longer than 30 minutes.

This is a minor maintenance release and shouldn’t affect any functionality or appearance.  During the maintenance, POP and IMAP will still be usable, and Webmail Beta can still be used to access mail.

Update: 12:15 AM.  Maintenance is complete.  Please report any issues here or by contacting support.