Medallia Experience Orchestration Status

Postmortem: The root cause of this incident was related to publishing Action Properties (previously Action Attributes) after a recent release. This was caused by the addition of a new field that was not populated during the publishing process. Our engineering team released a hot fix to resolve the issue.

Resolved: The issue in our European Production Environment has been resolved as of ~3:45pm EST. Further details may be provided in a post-mortem report.

Monitoring: Our Engineering teams have stabilized the European Production Environment issue as of 7:01 CET PM on February 14, 2025 and are continuing to monitor for stability.

Identified: Our Engineering teams have identified that the issue impacting our European Production Environment is related to an Action Properties (previously Action Attributes) change during the last release. They have identified the root cause and are working on a fix to release as soon as possible.

Customers experiencing issues Pushing to Launchpad can work around this issue by opening and re-saving all Action Properties in the space. To do this,

1. Navigate to Orchestrate -> Action Properties.
2. Open each Action Property.
3. Click 'Save'.
4. Navigate to Test & Publish -> Recent Changes.
5. Select all the Action Properties.
6. Click 'Push To Launchpad'.
7. Navigate to Launchpad.
8. Click 'Publish'.
9. Navigate back to Recent Changes.
10. Select the changes you want to publish.
11. Click 'Push to Launchpad'.

Identified: Our Engineering teams have identified the issue in our European Production Environment and are working on a resolution.

Investigating: We are currently experiencing a partial outage across all MXO regions as of 6:20 PM CET. Our engineers are currently investigating the issue. We will send an additional update in 60 minutes or when more information is available.

Postmortem: The root cause of this incident was related to publishing Action Properties (previously Action Attributes) after a recent release. This was caused by the addition of a new field that was not populated during the publishing process. Our engineering team released a hot fix to resolve the issue.

Resolved: The issue in our Asia Pacific Production Environment has been resolved as of ~3:45pm EST on 2/14. Further details may be provided in a post-mortem report.

Monitoring: Our Engineering teams have stabilized the Asia Pacific Production Environment issue as of 1:39 AM SGT on February 14th, 2024 and are continuing to monitor for stability.

Identified: Our Engineering teams have identified that the issue impacting our Asia Pacific Production Environment is related to an Action Properties (previously Action Attributes) change during the last release. They have identified the root cause and are working on a fix to release as soon as possible.

Customers experiencing issues Pushing to Launchpad can work around this issue by opening and re-saving all Action Properties in the space. To do this,

1. Navigate to Orchestrate -> Action Properties.
2. Open each Action Property.
3. Click 'Save'.
4. Navigate to Test & Publish -> Recent Changes.
5. Select all the Action Properties.
6. Click 'Push To Launchpad'.
7. Navigate to Launchpad.
8. Click 'Publish'.
9. Navigate back to Recent Changes.
10. Select the changes you want to publish.
11. Click 'Push to Launchpad'.

Identified: Our Engineering teams have identified the issue in our Asia Pacific Production Environment and are working on a resolution.

Investigating: We are currently experiencing a partial outage across all MXO regions as of 1:20 AM SGT. Our engineers are currently investigating the issue. We will send an additional update in 60 minutes or when more information is available.

Postmortem: The root cause of this incident was related to publishing Action Properties (previously Action Attributes) after a recent release. This was caused by the addition of a new field that was not populated during the publishing process. Our engineering team released a hot fix to resolve the issue.

Resolved: The issue in our North America Production Environment has been resolved as of ~3:45p EST on 2/14. Further details may be provided in a post-mortem report.

Monitoring: Our Engineering teams have stabilized the North America Production Environment issue as of February 14, 2025 at 11:56 AM EST and are continuing to monitor for stability.

Identified: Our Engineering teams have identified that the issue impacting our North America Production Environment is related to an Action Properties (previously Action Attributes) change during the last release. They have identified the root cause and are working on a fix to release as soon as possible.

Customers experiencing issues Pushing to Launchpad can work around this issue by opening and re-saving all Action Properties in the space. To do this,

1. Navigate to Orchestrate -> Action Properties.
2. Open each Action Property.
3. Click 'Save'.
4. Navigate to Test & Publish -> Recent Changes.
5. Select all the Action Properties.
6. Click 'Push To Launchpad'.
7. Navigate to Launchpad.
8. Click 'Publish'.
9. Navigate back to Recent Changes.
10. Select the changes you want to publish.
11. Click 'Push to Launchpad'.

Identified: Our Engineering teams have identified the issue in our North America Production Environment and are working on a resolution.

Investigating: We are continuing to investigate this issue.

Investigating: We are currently experiencing a partial outage across all MXO regions as of 12:20 PM EST. Our engineers are currently investigating the issue. We will send an additional update in 60 minutes or when more information is available.