Past Incidents

Affected Components: Hardware node failure, region BKI

Incident Start: 18th Dec. 2022/11:25 am Incident End: 18th Dec. 2022/11:55 am

Description:

• Malfunction of a hardware node
• Restart of the hardware node was necessary
• Stage only, no production instances affected

Customer Impact: Stage only, no production instances affected

• During the period of restart, there will be a short interruption in the availability of the systems.
• Affected customers were notified via E-Mail.
• Please check the affected systems for their full functionality.

Affected Components: SysEleven Stack, region DBL

Incident Start: 12th Dec. 2022/13:40 Incident End: 12th Dec. 2022/14:10

Description:

• Occurring errors are currently being investigated.

Customer Impact:

• Connectivity is restricted

Update:14:10

We were able to pin down the root cause and rolled out a change to fix the problem

Update:15:00

We are still in the process of cleaning up follow up problems for Octavia load balancers

Update:15:47

The Octavia load balancers are repaired now too. With that all issues are fixed.

Affected Components: Metakube API, region CBK and FES

Incident Start: 24th Nov. 2022/12:15 pm

Description:

We are currently experiencing a partial outage with control plane services in our DBL region. This may result in issues when accessing the Metakube API in the Regions CBK and FES as well. We will update you shortly.

Update 01:10 pm:

Metakube API timeouts have been resolved.

Update 01:35 pm:

All arisen issues have been mitigated and we continue to monitor the issue at hand. Should you experience any limitations or reduction / disruption please contact us.

Update 04:09 pm: We were able to fix the underlying issue with an update. We also haven't seen any issues with any control planes.

Affected Components: SysEleven Network, SysEleven API, all regions potentially affected**

Incident Start: 19th Nov. 2022/07:35 pm

Description:

We are currently experiencing issues within our network. Should you be affected, please contact us via our emergency hotline. Opening a ticket prior to calling us, helps us to evaluate, rectify and resolve issues that may persist with your setup.

Update 09:10 pm: All issues have been resolved. As far as we know at the moment, one of the couters at our Berlin Luetzowstraße datacenter was unfunctional and needed to be resetted. These routers are redundant, however, there was impact seen shortly after the failure of the router until all connections successfully moved to the redundant system.