Category: Uncategorized

SMTP maintenance

UPDATE: complete.

Our SMTP servers will be under maintenance tonight to receive software updates and reissued SSL certificates. There may be brief interruptions to outgoing mail starting now and lasting a few minutes.

-SOC

Santa Rosa Data Center UPS Maintenance

Update: Our vendor has had to reschedule yet again, this time for May 16th and 10AM.

Update: Maintenance has been rescheduled again, this time for May 1st.

Update: Maintenance has been rescheduled for April 27th.

Update: This maintenance has been cancelled and will be rescheduled at a later date.

Tomorrow, starting at 10:00, the UPSes that service our Santa Rosa data center will be undergoing scheduled preventative maintenance.  This includes overhauling one of them with a complete capacitor replacement.  The maintenance is fully scripted with our vendor and no interruption of power services to the datacenter are expected.  -Sonic Operations and Facilities

Sonic Telecom Core Maintenance

Update (12:18AM): Maintenance complete

Beginning tonight at midnight, we will be performing software upgrades on core network equipment in Santa Rosa, CA. Because traffic is expected to route around the affected equipment, no customer downtime is expected.

-Network Engineering

Sonic Telecom Core Maintenance

Update (12:57AM): Maintenance complete

Beginning tonight at midnight, we will be performing software updates on core network equipment. Traffic is expected to route around the affected equipment, but customers may experience a brief period of routing instability as traffic shifts.

-Network Engineering

Sonic SSE Fiber Disturbance

Today at approximately 2:05 PM a set of our Sonic SSE Fiber customers began experiencing traffic throughput issues and packet loss. We identified the cause of this disturbance as a byproduct of an unexpected network build provided by our fiber vendor. We promptly mitigated the issue and we have taken preventative measures to avoid this disturbance in the future.

Oakland FlexLink Long Range Outage

Today, March 19th, starting at 2:00am, equipment serving a small subset of FlexLink Long Range customers in the Oakland area failed. We are dispatching to replace the affected equipment immediately. Expected time of repair 5:30am.

Update(4:45am): Affected hardware replaced and service has been restored

-Tomoc

VPN Concentrator Maintenance

UPDATE: Maintenance concluded for tonight. The planned migration was unsuccessful so we reverted back to the original configuration.  VPN access should now be fully available.

 

Tonight at midnight, we will be performing a planned migration of hardware serving vpn.sonic.net in our Santa Rosa datacenter.  Expected downtime for VPN access is expected to be 30 minutes or less.

-Matt

 

System Maintenance

Update: Maintenance complete.

 

Tonight at 11:59pm, System Operations will be running maintenance updates on several customer facing systems. The following services may experience brief interruptions:

  • IMAP/POP3/SMTP
  • Customer hosted websites
  • VPN

The maintenance period is expected to last 1 hour.

-SOC

Jasper Building Outage

Update(5:40PM): A power issued took some equipment offline. The affected equipment has been moved to a different power source.

We are currently investigating an issue affecting fiber customers located within the Jasper building. We will update this message once we have more info

  • Noc

Core Accounting and CRM Database Server Maintenance

Tonight, starting at 23:00 we will be shutting down the SQL Database server to complete a copy of its data to a new slave server.  The final synchronization is expected to take less than an hour.  During this time, membertools and new service qualifications and signups will be unavailable.

– Sonic System Operations