Category: Uncategorized

Update: Maintenance complete

Tonight at 11:59pm we will be performing upgrades to various systems. Any interruption to services will be brief, and we expect to complete the maintenance within 1 hour.

-Sonic System Operations

Update: This maintenance is now complete

Tonight 5/2/2018 starting at 12:00am we will be performing maintenance on equipment that serves a subset of our Flexlink Ethernet customers based in San Francisco. This window is scheduled for 2 hours. During this time circuits may experience a brief interruption of service. This post will be updated once the maintenance is complete.

– Network Operations

Tonight starting at 11:59 pm we will be doing maintenance on our phone switch. We do not expect any service impacts.

~Network Engineering

Update: 3 am Maintenance is complete.

Tonight starting at 11:59 pm ending 4 am we will be performing maintenance on our phone switch. Commportal will be unavailable for 1 to 5 minutes during this maintenance window.

~ Network Engineering

Update: 1:45 am Maintenance is complete.

UPDATE: Certificates deployed.

Do to unexpected issues with the IMAP cluster upgrades we neglected to deploy the new certificates to the old servers,.  Unfortunately the certs on the old servers just expired.  The new certs are being deployed now.  We are sorry for any inconvenience or concern this may have caused you.

-Sonic Operations

Tonight we are implementing an upgrade to our local Phone system (PBX). We do not anticipate any customer impact. This upgrade will allow us to provide better call back assistance and statistics for our incoming customer phone requests. Support should resume at the regular time of 8 am Wednesday morning. Thank you for choosing Sonic.

–Sonic IT team

Tonight, starting at 11:59 pm we will be performing maintenance on our phone switch. We do not expect service impact.

~Network Engineering

Update: 1:30 am Maintenance is complete.

Early this morning a library used by many of our backend rpc services was updated as part of our nightly automatic upgrade process.  This particular update caused an issue that required services which depended upon it to be restarted in order for them to function correctly under some specific circumstances.  Unfortunately most of those specific circumstances are not tested for by our monitoring suite and so we didn’t discover the issue until this morning.

During this period we were unable to process some payments and the Fusion Voicemail system wasn’t able to process inbound calls correctly.  All services have been restored now and we’re continuing to dig into the underlying cause of the bug and what can be done to prevent it from happening again.

-Kelsey and the rest of System Operations

Tonight, starting at 11:59pm, we will be performing non-intrusive maintenance on core equipment serving Fusion, FlexLink and SSE services. Maintenance window is 4 hours.

Update(11:53pm): This maintenance has been postponed 24 hours and will begin on Wednesday evening starting at 11:59pm

Update(4:50pm): This maintenance has been cancelled until further notice

-Network Engineering

Tonight, starting at 11:59 pm we will be performing maintenance on our phone switch. We do not expect service impact.

~Network Engineering

Update: 1:05 am Maintenance is complete.