We are currently battling a large DDoS targeting our shared hosting server. Customers and visitors to their websites may experience reachability issues while we deal with the attack.
-Grant and Operations
Month: May 2014
Fusion/Flexlink Outage
Update: The fibers were repaired and service restored around 2:30 AM this morning.
Update: AT&T has confirmed a fiber cut between Woodland and Davis, and have dispatched a crew to fix the affected span. No ETR at this time.
Today, at 12:25pm, vendor circuits serving the Woodland central office went down. We have opened tickets with our vendor and will work with them to get this issue resolved as soon as possible.
-Tomoc
Hosted Websites / Colocation Partial Outage
We are currently battling a large DDoS targeting our shared hosting server. Customers and visitors to their websites may experience reachability issues while we deal with the attack.
– Robbie
Fusion/FlexLink Intrusive Maintenance
Update (12:30 AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Healdsburg, Vallejo, Fairfield and Yountville. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Fusion/FlexLink Intrusive Maintenance
Update (1:20AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in San Rafael, Sausalito, Mill Valley, and Ignacio. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Custom Databases Unreachable
At approximately 6pm today, our main customer database server suffered an error with its RAID controller. Operations is working to restore full functionality to the server as soon as possible.
Update: 8:35PM, we were able to restore services by 7:30 and are monitoring for further issues with the system.
— Joe and Sysops
Fusion/FlexLink Intrusive Maintenance
Update (12:20AM): This maintenance is now complete.
This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Petaluma, Napa, Sonoma, and Saint Helena. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.
– Robbie
Legacy DSL and FRATM Maintenace in Salinas
Tonight, between the hours of 12:00AM and 5:00AM, ATT will be performing intrusive maintenance on an aggregation circuit serving legacy DSL and FRATM circuits in the Salinas area. Expected downtime is less than one hour.
Update: Due to unforeseen circumstances, AT&T has pushed this maintenance to the same time window tonight.
Update: AT&T has postponed this maintenance again. New date TBD
-Tomoc
Legacy DSL Maintenance
Tonight, starting at 11:59pm, we will be performing maintenance on aggregation equipment serving a small subset of legacy DSL customers San Diego and the bay area. Expected downtime is less than 10 minutes.
Update: Maintenance complete.
-Tomoc
Non-Intrusive Voice Network Maintanence
5/20/2014 – 12:27AM PDT – This maintenance is now complete.
Tonight beginning at 11:59PM PDT we will be performing a software upgrade on equipment serving voice customers throughout our network. No customer impact is expected from this upgrade.
-Tim J.