SandyNet Voice Outage - Ongoing

Our upstream voice provider is currently experiencing a blackout in voice service. Both primary and secondary datacenters across the United States are affected. We are continuing to check on the provider as they restore service. Please email support@sandynet.org for immediate assistance, and check back for updates on the outage. 

 

Directly from voice provider

Update - We continue to work on the Sacramento recovery and router failure in Ashburn.
Apr 13, 2023 - 15:51 MDT

Update - We were just notified of issues also affecting the Sacramento data center and working to restore services ASAP.
We continue repair work in Ashburn to repair failed routers.

We apologize for the inconvenience this is causing. We have all hands on deck working to restore services.
Apr 13, 2023 - 15:32 MDT

Update - The admin portal is now operational. We recommend to clear cache and cookies for the last 24 hours if issues persist.
We continue repair work in our Ashburn data center. All traffic and registrations have been moved to Sacramento.

We appreciate your patience as we continue to restore services.
Apr 13, 2023 - 12:36 MDT

Update - The Alianza admin portal is not operational at the moment. We continue to work on a fix.
Traffic/Registrations continues to be routed to Sacramento as repairs continue in our Ashburn data center.
Apr 13, 2023 - 11:50 MDT

Update - Our admin portal is now fully operational. However, we continue repair work on a router in our Ashburn site and registrations have been moved to Sacramento.
SRV records that point to Ashburn have been all flipped to Sacramento. We continue to see some Service Providers whose devices didn't fail over to Sacramento. We recommend to check DNS to ensure it is resolving to the right datacenter, and that device configurations are not pinned to Ashburn A record or IP address.
Apr 13, 2023 - 11:27 MDT

Update - We continue working on this incident. Traffic and registrations have been moved to Sacramento to allow for repair work on an Ashburn router that failed.
Apr 13, 2023 - 10:36 MDT

Identified - We are also moving traffic temporarily to Sacramento as a network related incident is affecting our Ashburn site.
Apr 13, 2023 - 09:46 MDT

Monitoring - We applied a fix and users are now able to log in to the admin portal
Apr 13, 2023 - 09:38 MDT

Identified - We have identified an issue that is preventing our users from logging into the Alianza admin portal. We are working on a fix
Apr 13, 2023 - 09:35 MDT