In a few moments we will be updating the Pop and Imap servers’ ssl keys due to the Heartbleed bug. Fortunately the way our servers are configured they where not vulnerable to exposing authentication information due to this bug, but there is a chance that the keys where compromised. Expect a brief interruption while the keys are installed, after which incoming mail service will be restored.
– Grant and SOC
UPDATE: The new certificate has been installed.
In the next few minutes we will be pushing a new SSL certificate to our webmail servers. There will be a brief service interruption while this is done. This is one of the last few steps required in cleaning up after the Heartbleed openssl vulnerability.
– Grant and SOC
Tonight, April 7, starting at 11:59PM, we will be performing a maintenance reload on our customer facing ATM aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers.
-Tomoc
A small subset of fusion telephone numbers were deactivated in our phone switch this morning incorrectly. We are currently working to activate the telephone numbers for all effect customers.
NOC
Update: 10:40 am 4/4/2014 – All telephone numbers have been reactivated. Some voicemail settings may have been reset to default for the affected customers. We will be sending an email out to all affected customers.
NOC
Today at 13:20 PST the mailing list server will be taken offline for maintenance. All work should be completed within 15 minutes.
– Maintenance completed
We are currently working on an issue with a small subset of fusion customer unable to receive calls from outside Sonic’s network.
NOC
Update: 3:22pm 4/2/2014 The issue is effecting a large set of fusion customers than first reported . We are actively working to get this resolved as quickly as possible.
Update: 4:00 pm 4/2/2014 A routing mistake by one of our upstream providers caused the inbound calling issue. We are working with our upstream provider to ensure this does not happen again.
Tonight beginning at 11:59PM PST we will begin performing a software upgrade of portions of our voice network in Santa Rosa. There should be no noticeable impact to users during this software upgrade. The upgrade is expected to take 2-3 hours.
-Tim J.
Tonight, February 24, starting at 8:53pm, a large DDoS towards a collocation customer caused reachability issues for services hosted in our Santa Rosa data center. This malicious traffic has been blocked at our edge, and all connectivity has been restored.
-Tomoc
Hello,
Tonight, at 11:59 pm, we will be preforming maintenance upgrades on servers in our mail cluster. Any interruptions caused by this should be brief.
Grant K.
System Operations
Update (11:20 PM): This circuit is now back online and fully functional.
Update: We are still working with our provider to resolve the issue. We have escalated to a very high level and continue to push for resolution as soon as possible.
Today, at 10:30AM, an aggregation circuit serving Legacy DSL for the Chico area went down. We are presently working with our upstream provider to isolate the cause and resolve the issue as quickly as possible. We will provide further updates shortly.
-Robbie and Tim