IONOS Cloud Status
Real-time updates of IONOS Cloud issues and outages
IONOS Cloud status is Partially Degraded Service
Provisioning
Provisioning
Provisioning
Provisioning
Provisioning
Provisioning
Provisioning
You're checking on IONOS Cloud - but is your own site converting?
Outages aren't the only thing that costs you visitors.
Get a visual audit that shows exactly where your site loses conversions.
Free, takes 2 minutes.
Active Incidents
The AI Model Hub is currently experiencing high demand. As a shared infrastructure environment, this temporary surge in utilization may result in increased latency and varied performance across the platform.
Current Impacts
Increased Latency (TTFT): High GPU utilization may cause delayed responses (Time to First Token) when initiating model requests. We are continuously managing platform resources to maximize availability across all concurrent workloads.
Llama 405B Constraints: Due to its scale and high compute requirements, the Llama 405B model is particularly sensitive to traffic spikes, leading to potential timeouts or higher latency—we recommend switching to alternative models for time-critical workloads requiring faster response times.
Collections: Collections can also be influenced negatively by high demand and utilization. Please see the notes on new deployments in our documentation: https://docs.ionos.com/cloud/ai/ai-model-hub/how-tos/document-collections
Recommendations:
- To mitigate temporarily performance or availability issues, we encourage our customers and partners to implement (exponential backoff) retry mechanisms in their projects and pipelines. Usage peaks that lead in timeouts and degraded performance are usually transient.
- We kindly ask our customers to not create additional Support Tickets for questions and reports related to the performance of models in the Model Hub. Our Product and Tech Teams are aware and are actively monitoring and working on improving the service to meet demand.
- We ask Llama 405B users that face issues to consider a switch to GTP-OSS-120B instead. In most real world use cases, the model is more cost efficient and delivers a more robust performance
Outlook
The following measures are currently underway to improve the performance of the AI Model Hub:
- Various (model specific) optimizations are rolled out on a regular basis
- Improved cross-GPU load balancing (ETA July)
- Adjustments to error codes (replacing HTTP 5xx with HTTP 429) to allow clients to better understand and react to situations
Recently Resolved Incidents
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
We are currently investigating increased latency and error count in the AI Model Hub
IONOS Cloud Outage Survival Guide
IONOS Cloud Components
IONOS Cloud Cloud Support
IONOS Cloud Location DE/FKB
Compute
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Private Cloud
Logging Service
Monitoring Service
IONOS Cloud Location DE/FRA
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Object Storage
Logging Service
Monitoring Service
IONOS Cloud Location DE/FRA/2
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Object Storage
Logging Service
Monitoring Service
IONOS Cloud Location DE/TXL
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Object Storage
Private Cloud
Logging Service
Monitoring Service
IONOS Cloud Location ES/VIT
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Object Storage
Logging Service
Monitoring Service
IONOS Cloud Location FR/PAR
Compute
Storage
Cubes
Managed Kubernetes
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Supporting Services
Network
Logging Service
Monitoring Service
IONOS Cloud Location GB/BHX
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Logging Service
Monitoring Service
IONOS Cloud Location GB/GLO
Private Cloud
IONOS Cloud Location GB/LHR
Compute
Cubes
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Logging Service
Monitoring Service
IONOS Cloud Location US/EWR
Compute
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Logging Service
Monitoring Service
IONOS Cloud Location US/LAS
Compute
Storage
Network
Managed Kubernetes
Supporting Services
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Logging Service
Monitoring Service
IONOS Cloud Location US/MCI
Compute
Storage
Network
Managed Kubernetes
Provisioning
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Supporting Services
Logging Service
Monitoring Service
IONOS Cloud APIs and Frontends
Data Center Designer (DCD)
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Cloud API
Currently, there is an increased processing time for provisioning orders that are initiated via Data Center Designer or API.
Occasionally, connections may be lost in the direction of the Data Center Designer.
Availability and accessibility of your virtual data center resources will remain unaffected. We will inform you as soon as the functionality has been restored.
Billing API
Reseller API
Activity Log API
IONOS Cloud Global Services
Backup Service
CloudDNS
Database as a Service (DBaaS)
Monitoring as a Service (MaaS)
Content Delivery Network (CDN)
AI Model Hub
We are currently investigating increased latency and error count in the AI Model Hub
The AI Model Hub is currently experiencing high demand. As a shared infrastructure environment, this temporary surge in utilization may result in increased latency and varied performance across the platform.
Current Impacts
Increased Latency (TTFT): High GPU utilization may cause delayed responses (Time to First Token) when initiating model requests. We are continuously managing platform resources to maximize availability across all concurrent workloads.
Llama 405B Constraints: Due to its scale and high compute requirements, the Llama 405B model is particularly sensitive to traffic spikes, leading to potential timeouts or higher latency—we recommend switching to alternative models for time-critical workloads requiring faster response times.
Collections: Collections can also be influenced negatively by high demand and utilization. Please see the notes on new deployments in our documentation: https://docs.ionos.com/cloud/ai/ai-model-hub/how-tos/document-collections
Recommendations:
- To mitigate temporarily performance or availability issues, we encourage our customers and partners to implement (exponential backoff) retry mechanisms in their projects and pipelines. Usage peaks that lead in timeouts and degraded performance are usually transient.
- We kindly ask our customers to not create additional Support Tickets for questions and reports related to the performance of models in the Model Hub. Our Product and Tech Teams are aware and are actively monitoring and working on improving the service to meet demand.
- We ask Llama 405B users that face issues to consider a switch to GTP-OSS-120B instead. In most real world use cases, the model is more cost efficient and delivers a more robust performance
Outlook
The following measures are currently underway to improve the performance of the AI Model Hub:
- Various (model specific) optimizations are rolled out on a regular basis
- Improved cross-GPU load balancing (ETA July)
- Adjustments to error codes (replacing HTTP 5xx with HTTP 429) to allow clients to better understand and react to situations