Past Incidents

Affected Components: metakube control plane, all regions

Incident Start: 20th of December 2022/12:00 pm

Incident End: 20th of December 2022/2:15 pm

Description:

We are currently experiencing a major outage of the kubernetes control plane across all regions.

Update 01:35 pm We have successfully identified the issue and a fix is currently rolled out.

Update 02:15 pm We have successfully fixed the issue

Customer Impact during the Maintenance:

Examples:

• Services will be impeded
• Connectivity is impaired

Customer Actions:

• Please inform us if you notice any further irregularities

Affected Components: Hardware node failure, region BKI

Incident Start: 18th Dec. 2022/11:25 am Incident End: 18th Dec. 2022/11:55 am

Description:

• Malfunction of a hardware node
• Restart of the hardware node was necessary
• Stage only, no production instances affected

Customer Impact: Stage only, no production instances affected

• During the period of restart, there will be a short interruption in the availability of the systems.
• Affected customers were notified via E-Mail.
• Please check the affected systems for their full functionality.

Affected Components: SysEleven Stack, region DBL

Incident Start: 12th Dec. 2022/13:40 Incident End: 12th Dec. 2022/14:10

Description:

• Occurring errors are currently being investigated.

Customer Impact:

• Connectivity is restricted

Update:14:10

We were able to pin down the root cause and rolled out a change to fix the problem

Update:15:00

We are still in the process of cleaning up follow up problems for Octavia load balancers

Update:15:47

The Octavia load balancers are repaired now too. With that all issues are fixed.

Affected Components: Metakube API, region CBK and FES

Incident Start: 24th Nov. 2022/12:15 pm

Description:

We are currently experiencing a partial outage with control plane services in our DBL region. This may result in issues when accessing the Metakube API in the Regions CBK and FES as well. We will update you shortly.

Update 01:10 pm:

Metakube API timeouts have been resolved.

Update 01:35 pm:

All arisen issues have been mitigated and we continue to monitor the issue at hand. Should you experience any limitations or reduction / disruption please contact us.

Update 04:09 pm: We were able to fix the underlying issue with an update. We also haven't seen any issues with any control planes.