Past Incidents

Affected Components: SysEleven Stack API, region HAM1 and DUS2

Incident Start: 2024-09-04 15:20 UTC+02:00 (CEST)

Incident End: 2024-09-04 16:30 UTC+02:00 (CEST)

Description:

• New VMs could not be created

Customer Impact:

• Spawning new virtual machines (VMs)

Update: 16:20

We rolled out a configuration change and are observing.

Update: 16:30

We see that VMs can be created again in our automated tests. We are closing the incident

Affected Components: MetaKube Platform, all regions

Scheduled Start: 2024-09-03 18:00 UTC+01:00 (CET)

Scheduled End: 2024-09-03 21:00 UTC+01:00 (CET)

State: SCHEDULED

Description:

• Scheduled maintenance of the MetaKube platform in all regions
• Small update to MetaKube infrastructure

Customer Impact during the maintenance:

• Short interruptions (<5min) of the control plane possible (e.g. controller-manager, scheduler), but not API
• Running workloads will not be affected
• Network availability will not be affected
• Storage availability will not be affected

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities

Affected Components: Setups that route traffic through Cloudflare experience issues

Investigation Start: 2024-09-02 13:20 UTC+01:00 (CET)

Description:

We are investigating network problems reported by customers that route traffic through Cloudflare

Customer Impact:

Customers that are routing traffic to SysEleven networks through Cloudflare experience high retransmission rates and traffic loss.

Update: 2024-09-02 14:20 UTC+01:00 (CET)

We are still investigating.

Update: 2024-09-02 14:49 UTC+01:00 (CET)

We are observing significant improvements of the retransmit rates on some affected loadbalancers but will continue to observe and analyse the issues.

Update: 2024-09-02 16:25 UTC+01:00 (CET)

Since the Problem seems to be solved for most customers, we declare the incident as solved. Further investigations into the reasons for the problems will continue.

Affected Components: SysEleven Stack Networking in region DBL

Scheduled Start: 20 Aug 2024, 22:00 CEST

Scheduled End: 21 Aug 2024, 00:00 CEST

State: COMPLETED

Description:

We will perform an maintenance on networking components.

Customer Impact during the Maintenance:

• Interruption of connectivity of virtual machines of up to 2 minutes
• VPN connections could be interrupted for up to 2 minutes

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: **SysEleven Stack API **

Incident Start: 2024-08-13 13:33

Description:

• We are currently experiencing a loss of control for DNS zones managed by the DNSaaS API

Customer Impact:

• Changes towards DNSaaS zones and records are not propagated

Update: 2024-08-13 16:10

• Root cause was identified and fixed, we are observing the situation

Affected Components: SysEleven Stack, region CBK

Incident Start: 2024-12-08 11:20 Incident End: 2024-12-08 11:38

Description:

• Occurring errors are currently being investigated.

Customer Impact:

• Connectivity is restricted

Update : 2024-12-08 11:38

• Network problems were identified, we fixed the underlying issue and are now observing the situation