Past Incidents

Affected Components: SysEleven Stack API, region FES

Incident Start: 02nd February. 2023/11:00 Incident End: 02nd February. 2023/12:30

Description:

• Accessibility of the SysEleven Stack API is not ensured.

Customer Impact:

• Spawning new virtual machines (VMs) or changing existing resources is not possible.

Update:11:45

We identified the issue and fixed it. We are currently watching the situation and repairing follow up problems.

Update:12:05

We see additional problems and failing requests again, we are further investigating

Update:16:15

The observed API problems were fixed around 12:30, we kept an eye on the situation until 16:15

Affected Components: SysEleven Login, all regions

Incident start: 21. Feb. 2022/08:30 am Incident end: 21. Feb. 2022/09:03 am

Description:

We are currently experiencing a major outage of our login services and are working on mitigating the situation.

Update: The situation has been resolved.

Affected Components: Regular/emergency hotline

Incident Start: 10th February 2022/10:32 am Incident End: 10th February 2022/12:20 am

Description:

We are currently experiencing an outage at our external phone service provider. We have tightened the focus on our ticket system, please open a ticket instead of calling us in case of an emergency.

Update:

Our external service provider informed us that the incident has been mitigated. All systems are operational again.

Affected Components: https://code.syseleven.de

Incident Start: 8th Feb. 2023/23:45 Incident End: **9th Feb. 2023/06:55"

Description:

• unexpected problems during planned maintenance
• rollback failed
• restore of backup data was necessary

Customer Impact:

• code.syseleven.de unavailable until restore is completed
• loss of all changes since 18:00 (this affects everything such as issues, commits, pipelines, artifacts and registry images)

Update 06:55:

• Backup was restored successfully
• site is available again

Affected Components: SysEleven Metakube control plane services, region FES

Incident Start: 6th Sept. 2022/23:35

Description:

• Accessibility of the SysEleven Metakube API is unstable

Customer Impact:

• Cluster apiserver access disrupted or slow

Update 02:10:

• We found the issue and were able to mitigate the problem. All services recovered and are reachable again.