Astro Status

Resolved: This incident has been resolved.

Monitoring: The fix has been applied to the affected deployments, and the issue should no longer be observed.

Identified: We have identified an issue with some Astro Executor deployments where the graceful termination period of workers is not respected, leading to potential task failures. We are rolling out a fix for the affected Deployments

Resolved: Mitigations have been fully applied across all affected regions by Azure, and validations confirm that configurations have been successfully updated.

Customers should now see full recovery of service management operations, and dependent services are operating as expected.

Monitoring: We are now seeing additional clusters being affected. Issue is still ongoing.

Monitoring: We are still waiting on confirmation from Azure that the issue has passed, but we are no longer seeing impact to Astronomer workloads.

Identified: Azure has confirmed the outage. Please see their status page for additional information https://azure.status.microsoft/en-us/status

Investigating: We are continuing to investigate this issue.

Investigating: An potential Azure outage is resulting in some Azure clusters being unable to scale worker nodes. As a result, some tasks may fail. We are investigating internally and working with Azure to restore service as soon as possible.