Earlier tonight intermittent connectivity issues re-awakened in the San Pedro area. A reload of the affected router has stabilized the router for now. We will be replacing the affected unit during a maintenance window beginning at 11:59PM this evening.
– Robbie
Update. The router has been replaced and the maintenance window has been closed.
This morning, from around 2:10AM to 2:25AM, a large DDoS attack targeting an IP within our Santa Rosa datacenter caused reachability problems to some Sonic.net member and hosting services. The attack has been blocked and all reachability restored.
– Robbie
Yes indeed — for whatever reason, Facebook.com is down.
There are a couple of places to verify this, independent of Sonic.net:
http://www.isitdownrightnow.com/facebook.com.html
http://downforeveryoneorjustme.com/facebook.com
(Please note that these sites, too, will be sporatic, as everybody checks to see if Facebook is, indeed, down.)
These things happen sometimes, and I’m sure they appreciate your patience as they scramble like crazed bunnies to fix things. 🙂
-Scott
Update: Facebook.com is back up.
At about 8:15 AM this morning a utility pole providing power to our 200 Paul Avenue datacenter in San Francisco caught on fire and took the building off of utility power. The datacenter is currently operating on generators and did not have any disruption in service during the switchover. While emergency crews are currently working on the damaged pole, they expect the repair to be a somewhat slow process and we are in high alert until the situation has been resolved.
– NOC
Tonight, June 6th, starting at 11:59 PM, we will be performing power work on a small subset of equipment serving legacy products in one of our San Francisco datacenters. We do not expect any  customer impact from this procedure.
– Robbie
Update: This maintenance is now complete
We are currently investigating an outage that is affecting Fusion and Flexlink customers in the Santa Cruz Area. This post will be updated as we investigate further.
– Robbie
Update: At&t has confirmed a major fiber cut in the area and have dispatched technicians out for repair. We will update further when we receive an ETR.
Update 2: At&t technicians continue to work on all the cut fiber but are unable to provide a ETR at this time.
Update 3 (11:15AM PST): At&t has determined that due to the extent of the damage, new cable will need to be brought in and installed to work around the affected area. The current rough ETR is 5 hours or around 4:00PM PST.
Update 4 (4:10PM PST): AT&T has pulled new cables and has begun splicing. Still no ETR.
Update 5 (7:00PM PST): At&t continues their construction to repair the damage. The latest estimate received from the splicing crew for restoral of service is 1AM to 2AM.
Update 6(3:10AM PST): At&t has completed splicing in the replacement cables and all affected areas are now back online.
Update 7: Additional details on this outage are available from the following news article. http://sanfrancisco.cbslocal.com/2013/04/16/gunshots-cause-oil-spill-at-san-jose-pge-substation/
Tonight, April 11th, starting at 11:59PM, we will be performing maintenance on some of our backbone infrastructure in the San Jose area. Customers may experience brief routing changes but we do not expect any lasting impact.
Update: Maintenance has been postponed.
– Robbie, Tomoc
Tonight, Tuesday April 9th, starting at 11:59 PM, we will be performing maintenance on ATM equipment serving legacy DSL, FRATM, and Biz-T customers. We expect downtime to be less than 10 minutes.
– Robbie, Tomoc
Update: The maintenance has been completed successfully.
At 3:48PM this afternoon, an aggregation circuit serving Fiber DIA customers in northern California experienced a short outage. The issue was quickly diagnosed and connectivity was restored at 3:57PM. We have determined a technician from one of our collocation facilities pulled an incorrect cross-connect while performing otherwise routine maintenance. We will be working with the provider to ensure such mistakes do not happen again.
-Matt
Tonight, beginning at 11:59PM, we will be performing minor maintenance on routers that serve Biz-T and FRATM customers in both northern and southern California. Expected downtime is less than 10 minutes.
– Robbie