Scheduled mail storage infrastructure maintenance.

07:40 — Some customers may have noticed a problem when checking their e-mail via imap.sonic.net this AM; the new NetApp filers’ time was off by 30 seconds, which was enough for the IMAP software to think there was a significant problem and not allow those people whose e-mail is stored on the newer cluster to check their e-mail. A configuration error on the new filers was to blame and has been corrected. –Augie

01:49 — Maintenance complete; no major hiccups, please contact us immediately if you notice any problems. –Augie

Beginning early this Friday morning ( 15, July ) at 12:30AM we will be performing maintenance on the cluster of NetApp filers that store customers’ e-mail messages.

We will be adding an additional storage cluster which will improve performance and reliability for all customers’ sending and receiving of e-mail.

E-mail may be un-available or delayed during the maintenance window, which is estimated at one hour.

–Augie

Office Power Outage

Our office is running on generator power at this time. PG&E estimates restoration of main power at 9:45 AM

Update:  14:40:20 PDT.  PG&E service is still out and and we’re still running up and running on our backup power systems.  We do not have an ETR at this time and have made arrangements to have fuel delivered as necessary to maintain services.

Update:  19:25:49 PDT.  PG&E service has been restored and we’re back on utility power.

 

Santa Rosa DoS Attack

This morning at 12:24 PM, a large DDoS was aimed at a server in our colocation facility in Santa Rosa. The DoS was large enough to disrupt connectivity to our Santa Rosa datacenter, which would have affected access to mail and web services hosted by Sonic. The DoS was blocked by 12:32 PM, and no further ill effects should have been felt after that point. -Nathan

Brief Network Outage

Today at 3:24 PM, a misconfiguration during turnup of new backbone links in our telecom network caused a momentary interruption to network traffic. This outage should have been limited to the Bay Area. We apologize for the inconvenience.

-Jared

FaxLine Fax to Email Service Beta

We’ve launched our latest Labs Beta project, FaxLine.  Our FaxLine service provides a dedicated fax number that will deliver incoming faxes to your email as a PDF.  The best part is that we’re giving away one free FaxLine to all of our Internet access customers, including Fusion, DSL and even Dial-up.  This is our way of saying thanks for being a customer!

For more information see this thread in our forums.  To add a new FaxLine now, go to the FaxLine Member Tool.

Please note that FaxLine is Labs project and isn’t supported by our support department.  All question or trouble reports should be directed to the forums.

ATM Customer Aggregation Router Reload

This Tuesday, June 28 at 12:01 AM, we will be performing a maintenance reload on our ATM customer aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers.

-Jared

DSL Aggregation Router Uplink Failure

Tonight, June 26 at 9:14 PM one of the uplinks to our DSL aggregation router that serves the Fresno area went down. We have replaced the failed link and all affected customers should be back online at this time.

-Jared

Customer Service Closed: 2pm-3pm 06/24/11

On Friday, June 24th, an additional half hour will be added to the weekly Customer Service Training Meeting (normally Fridays, 2pm-2:30pm). As a result, customer support via telephone will be unavailable from 2pm-3pm for this special one hour training seminar.

– Kim

 

Sonic Telecom Network Reachability Issues

We are currently investigating a problem within our telecom network. Customers on it may experience intermittent reachability to other hosts both in and outside of our network. We will provide an update shortly once we have further diagnosed the issue.

-Matt and the NOC

Update: Service should now be stabilized for any effected customers. We have determined there was a fiber cut in Palo Alto, CA that impacted a number of our backbone links. That in turn caused reachability issues while our network rerouted around the down circuits. Furthermore, a router bug prevented a number of prefixes from properly rerouting, thus causing additional impact to a limited number of Flexlink Ethernet and Flexlink Long Range customers in the North Bay. We are working with the hardware vendor to diagnose and resolve this issue. All in all, this was a very successful test of our redundancy scheme, which kept packets flowing despite a group outage impacting a significant number of circuits.

Customer Service Closing Early

Sonic.net Support and Sales will close at 9:00pm Friday June 17th for our employee movie night. Support and Sales will open at the regular time Saturday morning.

– Jasper C. and the Sonic.net Staff.