Past Incidents

Affected Components: MetaKube Platform, all regions

State: Fixed

Description:

The MetaKube API has an increased response time. Running workloads are not affected.

We are investigating the root cause to find a fix asap.

Update 18:08: The API is response time has lowered again. Incident over.

Affected Components: SysEleven Stack DNSaaS API

Incident Start: 25th Sept. 2022/20:00 pm Incident End: 25th Sept. 2022/21:00 pm

Description:

• Updating and creating DNS zones is not possible

Customer Impact:

• Creating new DNS Zones and updating records for existing zones will fail

Update: 21:52$ pm

The API is available again but there are sometimes performance issues. Some requests can take some time until they are active on our name servers.

Affected Components: SysEleven Stack, region FES

Incident Start: 21st Apr. 2023/07:00 am Incident End: 21st Apr. 2023/17:50 pm

Description:

• There is an increased packet loss up to 8% for the IPv6 connections. IPv4 connections are not affected.

Customer Impact:

• Network connectivity has some issues for IPv6.

Affected Components: SysEleven Stack API, region CBK

Incident Start: 13th Apr. 2023/02:12 pm

Description:

• Performance of the SysEleven Stack API is degraded.
• We are investigating the situation currently.

Customer Impact:

• Spawning new virtual machines (VMs) or changing existing resources can be slower.

Update:02:32 pm

The situation is worse than a performance degradation, correcting the status towards a partial outage, we are further investigating

Update:03.20 pm

We pinned down the issue around 02:56 and are now observing the situation. In the end not only API but also Compute and storage (Block+Object) storage were affected. Changes to the monitoring and alerting are being planned.

Affected Components: CloudObserver/Grafana

Incident Start: 5th April 2023/19:00 CEST
Incident Start: 5th April 2023/22:00 CEST

Description:

• We are currently experiencing issues with the CloudObserver, causing some missing trending data. We identified the problem and are working to resolve the issue.

Customer Impact:

• Metrics from dashboards in your Grafana might be missing

Update 21:30

• We identified and fixed the issue, we were also able to recover most metrics. In some rare cases you might experience a gap between ~19:00 and ~20:00
• We are still closely monitoring the system

Update 22:00

• All systems are back and fully operational