SysEleven Status and Incidents https://syseleven-status.de Get all incidents by feed http://www.rssboard.org/rss-specification python-feedgen https://www.syseleven.de/wp-content/uploads/2020/10/SysEleven_XL_Logo_quer_RGB.png SysEleven Status and Incidents https://syseleven-status.de de Thu, 16 Oct 2025 01:14:05 +0000 INCIDENT: SysEleven STACK issues in region CBK <p>Affected Components: <strong>SysEleven Stack, region CBK</strong></p> <h2>Incident Start: 2025-04-25 15:55:00 UTC+01:00 (CET)</h2> <p>Description:</p> <ul> <li>Occurring errors are currently being investigated.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>We are expirencing a partial outage of the Network where some connection might get dropped.</li> </ul> 563 Fri, 25 Apr 2025 17:18:12 +0000 INCIDENT: SysEleven Managed Hosting Network partial outage, region BLU1 <p>Affected Components: SysEleven Managed Hosting Network partial outage, region BLU1</p> <p>Incident Start: 2025-04-25 15:55:00 UTC+01:00 (CET)</p> <p>Description: - Occurring errors are currently being investigated.</p> <p>Customer Impact: - We are expirencing a partial outage of the Network where some connection might get dropped.</p> 564 Fri, 25 Apr 2025 17:46:54 +0000 INCIDENT: SysEleven STACK issues in region CBK (Network) <p>Affected Components: <strong>SysEleven Stack Network, region CBK</strong></p> <p>Incident Start: <strong>2025-04-29 17:30 UTC+02:00 (CEST)</strong> Incident End: <strong>2025-04-29 17:50 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <ul> <li>Network connectivity to cloud region CBK was impaired</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Connectivity is restricted</li> </ul> <hr /> <p><strong>Update: 17:59</strong></p> <p>Network connectivity issues were resolved around 17:50</p> 565 Tue, 29 Apr 2025 18:01:27 +0000 INCIDENT: Partial outage of Metakube control plane in DUS <p>Affected Components: <strong>MetaKube Control Plane, region DUS</strong></p> <p>Incident Start: <strong>2025-04-30 16:00 UTC+02:00</strong></p> <hr /> <p>Description:</p> <p>The loadbalancer for the kubernetes apiserver does not properly work for some clusters.</p> <hr /> <p>Customer Impact: - Potential connection loss to the apiserver</p> <hr /> <p>Update: <strong>2025-04-30 16:30 UTC+02:00</strong></p> <p>We have recovered the affected clusters but haven't found the root cause. Right now we can't see any other affected clusters but will continue to monitor the situation.</p> <p>Update: <strong>2025-04-30 16:52 UTC+02:00</strong> We have identified and fixed the root-cause of the incident. All clusters are working properly again.</p> 566 Wed, 30 Apr 2025 16:10:27 +0000 INCIDENT: Outage of Metakube control plane in HAM <p>Affected Components: <strong>MetaKube Control Plane, region HAM</strong></p> <p>Incident Start: <strong>2025-05-08 14:43 UTC+02:00</strong></p> <hr /> <p>Description:</p> <p>The loadbalancer for the kubernetes apiserver does not properly work for some clusters.</p> <hr /> <p>Customer Impact: - Potential connection loss to the apiserver</p> <hr /> <p>Update: <strong>2025-05-08 15:02 UTC+02:00</strong> We have identified and fixed the root-cause of the incident. All clusters are fully operational again.</p> 567 Thu, 08 May 2025 15:20:50 +0000 INCIDENT: SysEleven STACK issues in region CBK (Network) <p>Affected Components: <strong>SysEleven Stack Network, region CBK</strong></p> <p>Incident Start: <strong>2025-05-08 16:45 UTC+02:00 (CEST)</strong></p> <p>Incident End: <strong>2025-05-08 17:00 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <ul> <li>Network connectivity to cloud region CBK was impaired</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Connectivity is restricted</li> </ul> <hr /> <p>Network connectivity issues were resolved around 17:00</p> 568 Thu, 08 May 2025 17:09:28 +0000 INCIDENT: Outage of Metakube cluster creation in HAM and DUS <p>Affected Components: <strong>SysEleven MetaKube, region HAM and DUS</strong></p> <p>Incident Start: <strong>2025-05-09 09:30 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description: - The cluster creation in DUS and HAM is currently not working. We are currently investigating.</p> <hr /> <p>Customer Impact: - No new clusters can be created</p> <hr /> <p>Update: <strong>2025-05-09 11:23 UTC+02:00 (CEST)</strong> - We are continuing to work on rectifying the situation</p> <hr /> <p>Update: <strong>2025-05-09 11:43 UTC+02:00 (CEST)</strong> - Currently testing a possibly fix.</p> <hr /> <p>Update: <strong>2025-05-09 12:53 UTC+02:00 (CEST)</strong> - We are currently in the process of applying the proposed fix.</p> 569 Fri, 09 May 2025 10:36:19 +0000 INCIDENT: Database as a Service connectivity issues, region dus2 <p>Affected Components: <strong>DBaaS in dus2</strong></p> <p>Incident Start: <strong>2025-05-09 12:00 UTC+02:00 (CEST)</strong><br /> Incident End: <strong>2025-05-09 12:10 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <ul> <li>We are currently seeing connectivity issues with DBaaS in our dus2 region</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Databases in dus2 are partly unreachable</li> <li>New Databases in dus2 can not be created</li> </ul> <hr /> <p>Update: <strong>2025-05-09 12:10 UTC+02:00 (CEST)</strong> - The issue has been identified and resolved</p> 570 Fri, 09 May 2025 12:12:14 +0000 INCIDENT: SysEleven STACK Block Storage issues, region cbk <p>Affected Components: <strong>SysEleven Stack, Block Storage, region cbk</strong></p> <p>Incident Start: <strong>2025-05-20 12:46 UTC+02:00 (CEST)</strong></p> <p>Incident End: <strong>2025-05-20 13:30 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <p>We are facing issues with the distributed block storage system in region cbk.</p> <hr /> <p>Customer Impact:</p> <ul> <li>Reduced performance of block storage</li> </ul> 571 Tue, 20 May 2025 13:17:37 +0000 INCIDENT: PVC Failure of a hardware node, region bki <p>Affected Components: <strong>Hardware node failure, region bki</strong></p> <p>Incident Start: **2024-05-28 17:15 UTC+01:00 (CET)</p> <hr /> <p>Description:</p> <ul> <li>Malfunction of a hardware node</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>During the period of restart, there will be a short interruption in the availability of the systems.</li> <li>Affected customers were notified via E-Mail.</li> <li>Please check the affected systems for their full functionality.</li> </ul> 572 Wed, 28 May 2025 18:13:11 +0000 INCIDENT: SysEleven STACK API issues, region FES <p>Affected Components: <strong>SysEleven Stack API, region FES</strong></p> <p>Incident Start: <strong>2025-05-31 16:00</strong> Incident End: <strong>2025-05-31 16:30</strong></p> <hr /> <p>Description:</p> <ul> <li>Accessibility of the SysEleven Stack API is not ensured.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Spawning new virtual machines (VMs) or changing existing resources is not possible.</li> </ul> 573 Sat, 31 May 2025 16:27:46 +0000 INCIDENT: SysEleven STACK API issues, region HAM1 <p>Affected Components: <strong>SysEleven Stack API, region HAM1</strong></p> <p>Incident Start: <strong>2025-05-31 16:00</strong> Incident End: <strong>2025-05-31 16:30</strong></p> <hr /> <p>Description:</p> <ul> <li>Accessibility of the SysEleven Stack API is not ensured.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Spawning new virtual machines (VMs) or changing existing resources is not possible.</li> </ul> 574 Sat, 31 May 2025 16:28:18 +0000 INCIDENT: SysEleven STACK API issues, region DUS2 <p>Affected Components: <strong>SysEleven Stack API, region DUS2</strong></p> <p>Incident Start: <strong>2025-05-31 16:00</strong> Incident End: <strong>2025-05-31 16:30</strong></p> <hr /> <p>Description:</p> <ul> <li>Accessibility of the SysEleven Stack API is not ensured.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Spawning new virtual machines (VMs) or changing existing resources is not possible.</li> </ul> 575 Sat, 31 May 2025 16:29:09 +0000 INCIDENT: SysEleven STACK issues in region CBK <p>Affected Components: <strong>SysEleven Stack, region XXX</strong></p> <p>Incident Start: <strong>2025-07-04 04:18</strong> Incident End: <strong>2025-07-04 04:45</strong></p> <p>Second Incident Start: <strong>2025-07-04 05:15</strong> Second Incident End: <strong>2025-07-04 05:42</strong></p> <hr /> <p>Description:</p> <ul> <li>Occurring errors are currently being investigated.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Connectivity is restricted'</li> </ul> 576 Fri, 04 Jul 2025 04:44:35 +0000 INCIDENT: PVC Failure of a hardware node, region BKI <p>Affected Components: Hardware node failure, region BKI1</p> <p>Incident Start: 2025-07-21 19:30 UTC+02:00 (CET) Incident End: 2025-07-21 20:15 UTC+02:00 (CET)</p> <hr /> <p>Description:</p> <ul> <li>Malfunction of a hardware node</li> <li>Restart of the hardware node is necessary </li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>During the period of restart, there will be a short interruption in the availability of the systems.</li> <li>Affected customers were notified via E-Mail.</li> <li>Please check the affected systems for their full functionality.</li> </ul> 577 Mon, 21 Jul 2025 20:02:45 +0000 INCIDENT: PVC Failure of a hardware node, region BLU1 <p>Affected Components: <strong>Hardware node failure, region BLU1</strong></p> <p>Incident Start: 2025-07-22 23:46 UTC+02:00 (CEST)</p> <p>Incident End: 2025-07-23 01:26 UTC+02:00 (CEST)</p> <p>We found a memory failure and we are going to evacuate the hardware node.</p> 578 Wed, 23 Jul 2025 00:12:12 +0000 INCIDENT: SysEleven DBaaS issues in region DUS/HAM <p>Affected Components: <strong>SysEleven DBaaS, region DUS, HAM</strong></p> <p>Incident Start: <strong>2025-23-07 14:23 UTC+02:00 (CEST)</strong></p> <p>Incident End: <strong>2025-23-07 18:23 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <p>We are currently investigating the situation that no new DBaaS instances can be created in the DUS and HAM regions at present. The operation of existing instances is not affected. We will report on further developments here.</p> <hr /> <p>Update:</p> <p>The creation of DBaaS instances in the HAM region is functional again. We are still working on a solution for the DUS region and will keep you informed.</p> <hr /> <p>Update:</p> <p>While all DBaaS instances continue to function as usual, we are still working on the ability of spawning new instances again.</p> <hr /> <p>Update:</p> <p>We are pleased to announce that the creation of DBaaS instances is working properly again.</p> <hr /> 579 Wed, 23 Jul 2025 14:49:29 +0000 INCIDENT: SysEleven STACK issues in region CBK <p>Affected Components: <strong>SysEleven Stack, region CBK</strong></p> <p>Incident Start: <strong>2025-08-15 13:45</strong> Incident Start: <strong>2025-08-15 14:12</strong></p> <hr /> <p>Description:</p> <ul> <li>Occurring errors are currently being investigated.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>Connectivity is restricted</li> </ul> <hr /> <p><strong>Update: 16:39</strong></p> <p>The network problems were caused by a DDoS attack which brought the network gateways in the CBK region into performance problems</p> 580 Fri, 15 Aug 2025 14:06:25 +0000 INCIDENT: partial outage of MetaKube control planes in region CBK/DBL <p>Affected Components: <strong>MetaKube control planes, region CBK/DBL</strong></p> <p>Incident Start: <strong>2025-10-14 02:40 UTC+02:00 (CEST)</strong></p> <hr /> <p>Description:</p> <p>Some clusters in the regions CBK/DBL have partial outages. The problem is identified and a solution is being worked on.</p> <hr /> <p>Update <strong>2025-10-14 04:52 UTC+02:00 (CEST)</strong></p> <p>Performance is back to normal, watching status.</p> 581 Tue, 14 Oct 2025 04:04:54 +0000 INCIDENT: SysEleven STACK issues in region FES <p>Affected Components: <strong>SysEleven Stack, region FES</strong></p> <p>Incident Start: <strong>2025-10-15 17:35</strong> Incident End: <strong>2025-10-15 18:18</strong></p> <hr /> <p>Description:</p> <ul> <li>Occurring errors are currently being investigated.</li> </ul> <hr /> <p>Customer Impact:</p> <ul> <li>New VMs with m2 flavors seem to have problems spawning correctly</li> </ul> <hr /> <p>Update: <strong>2025-10-15 18:18</strong></p> <p>We could pin down the issues towards a recent update. The update was rolled back</p> 582 Wed, 15 Oct 2025 17:46:39 +0000