Category: Network

Partial LATA1 Legacy DSL Outage

At approximately 8:00pm tonight one of the routers serving DSL circuits in the San Francisco Bay Area went down. Our Network Operations staff have been working on the issue and give an ETR of 8:45pm. No other services should be affected, and most Bay Area DSL circuits are already served by other gear. — John F

Update: service was restored at 8:28pm. Some customers may need to powercyle their DSL modems or routers to start surfing again — John F and NOC

Brief Fusion/Flexlink Outage

Today at 5:02PM a configuration error while doing capacity increase configuration took our Petaluma POP offline for approximately 3 minutes. All customers served out of this POP would have lost all Internet and voice connectivity. We have restored service to this POP and apologize for any inconvenience caused.

-Jared

Legacy DSL Outage

Tonight at approximately 1:45 AM one of the interfaces on one of our core ATM switches went link down, disrupting service to some legacy DSL subscribers in the Bay Area. We worked with site technicians to diagnose and repair the problem, which was an apparently faulty cable. At this time all affected customers should be back online, and we continue to monitor the situation.

-Jared and Nathan

FlexLink Long Range Intrusive Maintenance

This evening, beginning at 12:01AM, we will be performing intrusive maintenance on equipment serving a portion of our FlexLink Long Range customers in the Santa Rosa area. Affected customers can expect up 5-10 minutes of downtime while the work is performed.

-Matt and Robbie

Maintenance has been successfully completed and all affected customers should be back up.

Alleged Fusion Inbound Calling Issues

We are getting reports from multiple users stating inbound callers on the Fusion voice platform are receiving an “All circuits busy” error. We are investigating the situation at present and will post an update shortly when we have more information.

-Matt, Robbie and Nathan

Update: We believe this was a transient issue and it is now resolved. We are working with our vendors to ensure this problem will not reoccur.

LATA1 ADSL1 Outage

Tonight shortly before 7:30pm we lost connectivity on one of the backhaul circuits serving ADSL1 customers in the Bay Area and North Coast. This has resulted in many customers experiencing a sync-no-surf outage, where the DSL modem indicates it has a connection to the local DSLAM, but no traffic passes through.  Out network engineers have been working on the problem since immediately after it happened, but we have no ETR yet. Fusion, wireless, and dialup service, as well as ADSL1 service outside the Bay Area and North Coast are unaffected.  — John F and the NOC staff

Update: Our network engineers have been working counterparts at AT&T and have narrowed the problem down to what appears to be a faulty switch on their end. Still no ETR. — John F and the NOC staff

Update: As of 11:03 PM tonight, the ATM backhaul circuit was restored to service by ATT. All affected customers should be back online at this time. If you are still experiencing a problem with your DSL connection, please reboot your DSL modem.

-Jared

DSL Outage in San Francisco

As of 3:30pm PST, DSL customers served out of many San Francisco wire centers are currently without internet due to an AT&T equipment failure. Our estimated time of repair is within several hours.  We are working with AT&T to fix the problem, and we hope to update our MOTD with a more exact repair time shortly.

Fusion customers in San Francisco are not affected by this outage.

Update: At 4:20pm, most of our customers appear to be surfing again, and AT&T expects the remaining customers to be fixed shortly.

DSL outage, 831 area code

We have a number of ADSL customers experiencing a ‘sync no surf’ condition in the 831 area code. AT&T did some repairs overnight, but the outage persists and we have not been given at ETR.

We will continue to work with AT&T and update the MOTD over the course of the day.  Note that
Sonic.net Fusion, and Flexlink customers are not affected by this outage.

Eli, Support.

Update: As of 10:30am, the problem has been resolved.

VPN Concentrator Certificate Update

Today the security certificate used by our VPN concentrator expired, and we have replaced that certificate with a new one. The certificate is used by the Cisco VPN Client to properly secure VPN connections, so clients with the old certificate will no longer be able to connect. You can get the new certificate by installing the latest version of our VPN Client at this URL:

http://sonic.net/support/hotspotportal/

-Jared and Kelsey

DSL Aggregation Issues

This morning our support group has been tracking an issue that is affecting DSL subscribers connected to one of our DSL aggregation routers. We are investigating possible hardware or physical problems that may be affecting that router.

-Jared

Update: The problem was tracked down to a failing port on one of our ATM switches, which was causing heavy packet loss. We moved our connection off that port and the problem should now be resolved.