Past Incidents

Between January 11th, 2022 22:00 and 03:00 (UTC +1) we will perform planned maintenance in Region CBK

During this period there will be:

• Interruptions of network connectivity of virtual machines for up to 5 minutes
• Increased storage latencies for a short period of time

Should you have any trouble following the maintenance work please contact us.

At the moment we are facing API issues in region CBK.

We will keep you informed and apologise for any inconveniences.

Update 16:31 : We brought back normal service around 16:21, we identified the root cause and are checking a few things.

Our Monitoring identified a power failure.

A power failure occurred on one phase and both feeds were carried away.

We are in the data center investigating the problem and will restore all devices as soon as possible.

Affected customers were notified via E-Mail. If interaction is required customers will be notified individually.

Please contact us via e-mail or phone if you encountered problems but did not receive any mail.

We will keep you informed and apologise for any inconveniences.

Update: 11:30 One Node is down, both power supplies affected. Operations migrates the affected VEs to new hardware nodes

Update 11:55 Power redundancy restored

Update 12:15 VEs were migrated and defective node and power were repaired.

Update 12:35 Incident fixed. If you still have problems with your systems, please contact us directly.

At the moment we are facing connectivitiy issues in region DBL.

We will keep you informed and apologise for any inconveniences.

Update 10:20: The network seems to be functional again, we are still observing and investigating.

Update 10:30: We are confident that the cause of the issue has been eliminated.

Currently we are facing issues with the SysEleven Stack API. Authentication requests may be rejected wrongly. We are working on a solution and keep you informed. The outage only affects spawning new virtual machines or changing existing resources.

We apologise for any inconveniences.

Metakube API is failing for the FES region. No clusters can be created or managed currently.

Update (17:45): A change could not propagate to the FES infrastructure for Metakube because of a race condition. We were able to manually fix the problem. All systems are operational again.

Affected Systems: Customer Applications

Incident Start: 10.12.2021 17:00

Incident End: 13.12.2021 11:00

Description:

On 10/12/2021 a security alert was published, which can be found at CVE-2021-44228.

The risk is that a Remote Code Execution (RCE) Format String Lookup Vulnerability can be exploited when using Apache Log4j2 in a version >=2.0 and <2.15.

We have contacted all customers individually who, to our knowledge, are urgently affected by the vulnerability. We also cannot exclude the possibility that a corresponding version is running in your user context due to your own deployment and cannot be identified by us.

**We therefore ask every customer to check their own application for the possibility of being affected by the aforementioned security vulnerability.

We are happy to assist you within the scope of our possibilities. Please open a ticket in our helpdesk (https://helpdesk.syseleven.de). Outside our service hours, please contact our on-call service by phone in case of emergency.

See also our HelpDesk Article.

Customer Impact:

Possible: Remote Code Execution (RCE) Format String Lookup Vulnerability

Update: 13.12.2021 11:00

We close this notification Issue. To handle the incident individuelly, please create a Ticket.