Update (1:10AM) : This maintenance is now complete.
Tonight, October 21st, beginning at 11:59 PM, I will be performing maintenance on equipment that serves Fusion and Flexlink customers in the Santa Cruz, Aptos, and Watsonville areas.
– Robbie
Update (1:10AM) : This maintenance is now complete.
Tonight, October 21st, beginning at 11:59 PM, I will be performing maintenance on equipment that serves Fusion and Flexlink customers in the Santa Cruz, Aptos, and Watsonville areas.
– Robbie
Update: 12:41AM PDT 10/22/13 – This maintenance is now complete.
Tonight starting at 11:59 PM PDT we will begin working on our voice infrastructure in Santa Rosa. This is expected to last 2-3 hours. Hosted PBX customers may have intermittent access to commportal during the upgrade, but no other impact is anticipated.
-Tim J.
We are currently experiencing issues with in and outbound calling through our voice platform. Our engineers are working on identifying and resolving the problem ASAP.
– Noc
Update: All call issues should be resolved as of around 1:50PM. We are presently working on a root cause analysis and will provide more information as it becomes available.
At approximated 17:15 this evening, one of the 4 clustered enterprise class filers that handles email storage started to show unexplained high CPU utilization leading to slow I/O performance. Â This may have resulted in slow interactive performance or even some timed-out connections for POP3 or IMAP for approximately 25% of our users. 15 minutes later we issued a partner takeover, and a few minutes after that, a partner giveback to affect as clean a reboot of the affected system. Â At this time things seem to be behaving normally but we are keeping a close eye on these systems.
-Kelsey and Nathan
Update: This issue is ongoing and we are working to resolve. We have no ETR at this time. -Kelsey
Update: We believe we have identified the source of the problem and resolved it for the time being. It looks like the root cause may actually be a software defect of sorts in the IMAP server and not the filer. -Kelsey
Update (3:00AM): Â This work has been successfully completed.
Tomorrow night, Tuesday October 15th, beginning at 11:00 PM, we will be performing major power work within a core datacenter in Northern California. While we expect no customer impact during this procedure, due to the length and nature of this operation we are starting earlier than normal but plan on taking on the potentially intrusive work after  midnight.
– Robbie and Nathan
We will be performing emergency maintenance shortly on equipment serving Legacy DSL customers in the Los Angeles area. Affected customers may see up to 10 minutes of downtime while the work is performed.
-Tim
Update: Maintenance work has been completed and all affected customers should be back online. We apologize for the downtime.
On the morning of  Tuesday the 22nd, we will block access to our recursive DNS servers from off of our network.  This will help reduce the use of our DNS servers as part of the ongoing DNS Amplification Attacks as well as protect their quality of service for all of our customers.  This will, however, cause issues for any roaming device that has our DNS servers hard coded.  These devices should be configured to use server assigned DNS settings instead.  For more information please see our forums.
-Kelsey and William
Update: 4:08A PDT – This maintenance is complete.
Tonight, beginning at 11:59PM PDT, I will be performing maintenance on backbone equipment in San Jose, Palo Alto, Santa Rosa and San Francisco as well as maintenance to our voice network in Santa Rosa. This is the completion of the maintenance from 10/9/2013. No impact is anticipated to customer internet or voice traffic during this maintenance.
– Tim J.
Tonight, beginning at 11:59PM PDT, I will be performing maintenance on backbone equipment in San Jose, Palo Alto, Santa Rosa and San Francisco. No impact is anticipated to customer traffic during this maintenance.
– Tim J.
— UPDATE: Maintenance partially completed, remainder will be re-scheduled for another night.
Update (12:50AM) : This maintenance is now complete.
Tonight, beginning at 11:59 PM, I will be performing emergency maintenance to replaced a failed module in a core northern California router for our telecom platform. I do not expect any customer downtime as a result of  this procedure, although there may be a brief moment of routing instability as I bring the replaced module back online.
– Robbie