Hosted Mender Status

Resolved: This incident has been resolved

Monitoring: The restore to 08:10:00 UTC has completed at 09:28:49 UTC and the server is scaled back up. We will continue to monitor the situation.

Identified: The issue has been identified. A migration triggered by an upgrade caused an index to be removed prematurely. This in turn caused data corruption. We have initiated a database restore and rolled back the upgrade. We apologize for the inconvenience.

Investigating: We are continuing to investigate this issue.

Investigating: We noted a spike in API error metrics; we are investigating the issue.

Resolved: This incident has been resolved

Monitoring: The restore to 08:10:00 UTC has completed and the server is scaled back up. We will continue to monitor the situation.

Monitoring: This is the same incident as https://mender.statuspage.io/incidents/v85h4c0whdtc, which is keeping track of it for the hosted Mender EU

The issue has been identified. A migration triggered by an upgrade caused an index to be removed prematurely. This in turn caused data corruption. We have initiated a database restore and rolled back the upgrade. We apologize for the inconvenience.

Resolved: This incident has been solved.

Identified: The cloud provider is fixing their issues, we can see that most of the hosted Mender services are back to full operation. We're continuing to monitor the issue. The email service is still not working.

Identified: We identified an issue with an upstream cloud provider. Unfortunately, even our statuspage was affected and we could not open this status page before now. Among the issues, we identified:

• issues reaching the hosted Mender API server
• emails not being sent
• UI login not possible.

The incident started at about 07:50 UTC