Past Incidents

Between Nov 16th, 2021 22:00 and 03:00 (CET) we will perform planned maintenance in Region DBL

During this period there will be:

• Short interruptions of virtual machine network connectivity for up to 5 minutes
• Increased storage Input/Output latencies

Should you have any trouble following the maintenance work please contact us.

At the moment we are facing connectivitiy issues in region DBL.

We will keep you informed and apologise for any inconveniences.

**Update 17:22: ** The network in the DBL region is working again.

Between Nov 9th, 2021 22:00 and 03:00 (UTC +1) we will perform planned maintenance in the Region DBL

Our plan is to have no customer-facing impact, but there is a possibility that the storage will have a performance degradation for several minutes.

Should you have any trouble following the maintenance work please contact us.

At the moment we are facing connectivitiy issues in region DBL.

We will keep you informed and apologise for any inconveniences.

Update : We are still continuing the investigation, there has been an improvement of the situation but there is still network degradation Update : We have identified the issue and took measures

Currently we are facing issues with the SysEleven Stack API. We are working on a solution and keep you informed. The outage only affects spawning new virtual machines or changing existing resources.

We apologise for any inconveniences.

Update: We identified the root cause and took measures to bring back control

To update the backend services for Keycloak and Harbor, we need to announce a maintenance work for both services starting at 27.10.2021 20:00 to 21:00. During the update, backend services need to be restarted and thus frontend services may be unavailable for a short time.

Keycloak is used for access control (authentication, authorization) for the Kubernetes API, so access may be limited during the maintenance, especially if new users or tokens need to be created.

Harbor is used for providing the SysEleven Container Registry (https://scr.syseleven.de/), so access may be limited during the maintenance.

There will be no impact on running clusters, however, applying changes to clusters may not be possible if the named services are being used.

The MetaKube dashboard is not usable currently because of degradation of the API. We have identified the cause and are working to fix it.

Solved: 11:15

At the moment we are facing network issues in region DBL. We are seeing packet loss. Some VMs might be unreachable. This affects virtual machines and Octavia load balancers in DBL.

We will keep you informed and apologise for any inconveniences.

UPDATE 15:20: The issues are now resolved.

On October 19th, 2021 10:00 PM to 03:00 AM (CEST) we will perform planned maintenance in Region DBL

Our plan is to have no customer-facing impact, but there is a possibility that there are increased storage latencies for some minutes.

Should you have any trouble following the maintenance work please contact us.

Update 23:44: We finished the planned maintenance

At the moment we are facing network issues in region DBL. We are seeing packet loss. Some VMs might be unreachable. This affects virtual machines and Octavia load balancers in DBL.

We will keep you informed and apologise for any inconveniences.

UPDATE 03:21: The issues are now resolved.