Past Incidents

Affected Components: SysEleven Stack API in region DBL

Scheduled Start: 21 Mar 2023, 22:00 CET

Scheduled End: 22 Mar 2023, 02:00 CET

State: COMPLETED

Description:

We will perform maintenance on servers for the OpenStack APIs.

Customer Impact during the Maintenance:

• Connectivity to SysEleven Stack APIs and to SysEleven Object Storage (S3) may be impacted for a few seconds

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: SysEleven Stack Networking in region DBL

Scheduled Start: 14 Mar 2023, 22:00 CET

Scheduled End: 15 Mar 2023, 02:00 CET

State: COMPLETED

Description:

We will perform maintenance on networking gateways.

Customer Impact during the Maintenance:

• Interruption of connectivity of virtual machines of up to 2 minutes
• VPN connections could be interrupted for up to 2 minutes

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: SysEleven Stack Networking in region DBL

Scheduled Start: 9 Mar 2023, 22:00 CET

Scheduled End: 10 Mar 2023, 00:00 CET

State: SCHEDULED

Description:

We will perform maintenance on networking gateways.

Customer Impact during the Maintenance:

• Interruption of connectivity of virtual machines of up to 2 minutes
• VPN connections could be interrupted for up to 2 minutes

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: SysEleven Stack in region FES

Scheduled Start: 6 Mar 2023, 22:00 CET

Scheduled End: 7 Mar 2023, 01:00 CET

State: SCHEDULED

Description:

We will roll out security updates for API servers and kernels.

Customer Impact during the Maintenance:

• OpenStack APIs may be unreachable for a short time (a few minutes)
• The availability of our shared storage could be reduced

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: SysEleven Stack API, region FES

Incident Start: 02nd February. 2023/11:00 Incident End: 02nd February. 2023/12:30

Description:

• Accessibility of the SysEleven Stack API is not ensured.

Customer Impact:

• Spawning new virtual machines (VMs) or changing existing resources is not possible.

Update:11:45

We identified the issue and fixed it. We are currently watching the situation and repairing follow up problems.

Update:12:05

We see additional problems and failing requests again, we are further investigating

Update:16:15

The observed API problems were fixed around 12:30, we kept an eye on the situation until 16:15

Affected Components: Keycloak platform (login.syseleven.de), all regions

Scheduled Start: 28. Feb. 2023/07:00 am

Scheduled End: 28. Feb. 2023/08:00 am

State: SCHEDULED

Description:

we will perform a scheduled update of our Keycloak platform (login.syseleven.de) to version 20.0.3.

Customer Impact during the Maintenance: During the update, the service will need to be briefly paused and restarted.

Access to the following services may be limited during this maintenance:

• Metakube Dashboard
• Harbor (scr.syseleven.de)
• Gitlab (code.syseleven.de)
• Managed Grafana (*.grafana.syseleven.de)
• the Kubernetes API of customer clusters (if set up by the customer)

There will be no impact on running Metakube clusters, however, changes to clusters may not be possible if the above services are used.

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities

Affected Components: Keycloak platform (login.syseleven.de), all regions

Scheduled Start: 21. Feb. 2023/07:00 am

Scheduled End: 21. Feb. 2023/08:00 am

State: SCHEDULED

Description:

we will perform a scheduled update of our Keycloak platform (login.syseleven.de) to version 20.0.3.

Customer Impact during the Maintenance: During the update, the service will need to be briefly paused and restarted.

Access to the following services may be limited during this maintenance:

• Metakube Dashboard
• Harbor (scr.syseleven.de)
• Gitlab (code.syseleven.de)
• Managed Grafana (*.grafana.syseleven.de)
• the Kubernetes API of customer clusters (if set up by the customer)

There will be no impact on running Metakube clusters, however, changes to clusters may not be possible if the above services are used.

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities

Affected Components: code.syseleven.de

Scheduled Start: 17. Feb. 2023/13:30 am

Scheduled End: 17. Feb. 2023/14:00 am

State: SCHEDULED

Description:

We are performing urgent and security-relevant maintenance work on code.syseleven.de, the system on which SysEleven provides Gitlab repositories for customers, between 1:30 - 2:00 pm. This involves updating the Gitlab software, which may lead to a brief interruption in the accessibility of the service.

Customer Impact during the Maintenance:

• Service code.syseleven.de will be briefly interrupted for up to 30 min

Customer Actions:

• No customer actions needed

Affected Components: Regular/emergency hotline

Incident Start: 10th February 2022/10:32 am Incident End: 10th February 2022/12:20 am

Description:

We are currently experiencing an outage at our external phone service provider. We have tightened the focus on our ticket system, please open a ticket instead of calling us in case of an emergency.

Update:

Our external service provider informed us that the incident has been mitigated. All systems are operational again.

Affected Components: https://code.syseleven.de

Incident Start: 8th Feb. 2023/23:45 Incident End: **9th Feb. 2023/06:55"

Description:

• unexpected problems during planned maintenance
• rollback failed
• restore of backup data was necessary

Customer Impact:

• code.syseleven.de unavailable until restore is completed
• loss of all changes since 18:00 (this affects everything such as issues, commits, pipelines, artifacts and registry images)

Update 06:55:

• Backup was restored successfully
• site is available again