Misconfiguration Caused Email Delivery Problems

This morning the Systems Operations Center identified a DNS misconfiguration on a newly-deployed email backend server which had been leading to forwarding and aliasing delivery problems resulting in bounced email as well as the possibility that some forwarded messages were not sent. Due to the nature of the misconfiguration it is difficult to accurately assess the number of messages impacted, but any issue which did occur would have happened between roughly midday on Monday the 27th and today (the 28th) at approximately 11:15am. We do not see ongoing delivery issues at this time.

Web Hosting Instability

UPDATE: We have restored our Web Hosting platform to regular service. Our teams will be reviewing logs and monitoring data to better coordinate future responses to attacks and improve resiliency.

Starting around 4:30pm PST today, our Operations team noticed a pattern of requests matching a distributed denial-of-service attack directed at our web hosting cluster. As a result, hosted websites, including pages at users.sonic.net, have suffered from intermittent availability. Both our Network and Systems teams are currently working on mitigation measures to slow down and stop the attack on our services.

— Joe @ System Operations

IMAP issue

Sonic is investigating an issue with the IMAP service for our email cluster.

Update: Sonic has identified a potential fix for the issue. We will monitor the situation while continuing to validate the cause.

Dial-up Service Retirement

When Dane and Scott started sonic.net (Sonoma Interconnect) in 1994 on Dane’s back porch with 8 phone lines, a couple of “servers” and a 56kbps leased line to the Internet, nobody could have imagined what Sonic would become. More than three decades later we’re providing 10 gigabit service that’s more than 595,000 times faster than the 16.8 kbps modems we were founded on over a fiber optic network that we own.  But today is truly the end of an era: 32 years later we’re shutting down all our Analog and ISDN dial-up services on April 30th, 2026.

Thanks to everyone who ever listened to the modems screech, watched images slowly load, hung out in IRC, read their email on bolt, broke out of Gopher jails and became our friends in the local sonic.* news groups over the years.

– Kelsey, on behalf of Dane, Scott, Eli, Nathan and everyone else at Sonic today.

webmail – midday security vulnerabilities patch

Sonic will be patching the webmail service, due to security fixes noted from an upstream vendor.  Fixes include:

  • A bug where a password could get changed without providing the old password.
  • Various ways to bypass remote image blocking

If you notice a service interruption, merely logout and then log back into webmail.

– The Sonic Systems team

Systems Maintenance

Update: Maintenance complete.

Tonight (3/10/26) beginning at approximately 11pm System Operations will conduct planned maintenance on a database which backs several Sonic services, including Sonic Fax service. During the outage impacted services may fail or display errors. Expected downtime for the operation is approximately 15-30 minutes. An update will be posted here once maintenance is complete.

DNS Resolution Issue

Between March 5 at 11:40 AM and March 6 at 10:00 AM PST, some DNS queries to ns2.sonic.net (50.0.2.2) were intermittently failing due to stale process state on one of our DNS cluster nodes following a scheduled network migration. The issue has been resolved and service is operating normally. We are updating our post-migration verification procedures to prevent recurrence.

VoIP Phone Maintenance

“Starting March 2nd, we will be updating the firmware of the Grandstream DP750, DP752, WP820, GRP2615, and GRP2616 phones. Part of these changes includes disabling device hot-desking by default. We will roll out these upgrades across our network in stages and aim to complete them by April 29th. The phones will reboot once during the maintenance window of 12 am to 6 am.”

 

~Network Engineering

commportal.sonic.net website update

Update: 3 AM Maintenance is now complete.

“Starting at 2 AM February 24th we will be updating the commportal.sonic.net website. There will be no voice service impacts, but anyone logged on to commportal.sonic.net may have to log back in after the maintenance. The maintenance window should take 2 hours.”

 

~Network Engineering

webmail – midday security vulnerabilities patch

Sonic will be patching the webmail service, due to security fixes noted from an upstream vendor.  These fixes include an injection vulnerability, and a way to bypass remote image blocking.

If you notice a service interruption, merely logout and then log back into webmail.  Thank you for understanding the need for inconveniencing the reliability of the service.

– The Sonic Systems team