All systems are operational

About This Site

Timezone: Europe/Berlin (CET - UTC +1/CEST - UTC +2)

We provide current information about infrastructure and service availability below. If you experience service impacts or performance issues please contact our helpdesk or our Service Desk.

Past Incidents

Tuesday 28th March 2023

MAINTENANCE: SysEleven STACK announcement (CBK), scheduled 1 year ago

Affected Components: SysEleven Stack Networking in region CBK

Scheduled Start: 28 Mar 2023, 22:00 CEST

Scheduled End: 29 Mar 2023, 02:00 CEST

State: COMPLETED

Description:

We will perform maintenance on networking gateways.

Customer Impact during the Maintenance:

  • Interruption of connectivity of virtual machines of up to 2 minutes
  • VPN connections could be interrupted for up to 2 minutes

Customer Actions:

  • no customer actions needed
  • please inform us if you notice any irregularities

Update : 01:55

There was an unplanned delay during an update procedure causing the maintenance to take longer as planned

Thursday 23rd March 2023

No incidents reported

Wednesday 22nd March 2023

INCIDENT: SysEleven MetaKube issues in region FES

Affected Components: MetaKube, region FES

Incident Start: 22st March. 2022/10:45 am

Description:

The load balancer to the cluster control planes did not behave correctly and caused slow or dropped connections.

This in turn caused nodes to show as NotReady and problems for kubernetes controllers in the clusters.

Update at 11:30am

Services are operational again.

Update at 15:15am

The load balancer caused problems again for a few minutes.

Incident over at 15:30

If you still experience issues, please open a ticket.

Update: 24st March. 2023/13:45 pm

Reason for Outage (RfO) (eng)

Tuesday 21st March 2023

MAINTENANCE: SysEleven STACK announcement (DBL), scheduled 1 year ago

Affected Components: SysEleven Stack API in region DBL

Scheduled Start: 21 Mar 2023, 22:00 CET

Scheduled End: 22 Mar 2023, 02:00 CET

State: COMPLETED

Description:

We will perform maintenance on servers for the OpenStack APIs.

Customer Impact during the Maintenance:

  • Connectivity to SysEleven Stack APIs and to SysEleven Object Storage (S3) may be impacted for a few seconds

Customer Actions:

  • no customer actions needed
  • please inform us if you notice any irregularities
Control Plane Services (SysEleven - FES) INCIDENT: Metakube Control Plane issues in Region FES

Affected Components: MetaKube Control Plane, region FES

Incident Start: 21st March. 2022/08:30 am

Description:

We're investigating sporadic issues with out MetaKube Control Plane / API in our FES region that may have started already before.

Customer Impact:

Some API commands / changes are not properly executed.

Update: 09:10 am

We created a workaround for an issue in a networking component but affected pods are not restarting automatically, we are triggering that manually.

Update: 09:25 am

Most affected pods have recovered but managing the cluster is still impaired.

Update: 10:13 am

A fix has been implemented but will take some time to be rolled out.

Actions using the Cloud Controller Manager (i.e. creating Load Balancers, getting IPs for Nodes...) do not yet work for the affected clusters.

Update: 12:38 pm

The fix has been rolled out and clusters are running as expected again.

Update: 23st March. 2023/16:25 pm

Reason for Outage (RfO) (eng)

Monday 20th March 2023

No incidents reported

Sunday 19th March 2023

No incidents reported

Saturday 18th March 2023

No incidents reported

Friday 17th March 2023

No incidents reported

Thursday 16th March 2023

No incidents reported

Wednesday 15th March 2023

No incidents reported

Tuesday 14th March 2023

MAINTENANCE: SysEleven STACK announcement (DBL), scheduled 1 year ago

Affected Components: SysEleven Stack Networking in region DBL

Scheduled Start: 14 Mar 2023, 22:00 CET

Scheduled End: 15 Mar 2023, 02:00 CET

State: COMPLETED

Description:

We will perform maintenance on networking gateways.

Customer Impact during the Maintenance:

  • Interruption of connectivity of virtual machines of up to 2 minutes
  • VPN connections could be interrupted for up to 2 minutes

Customer Actions:

  • no customer actions needed
  • please inform us if you notice any irregularities

Monday 13th March 2023

No incidents reported

Sunday 12th March 2023

No incidents reported

Saturday 11th March 2023

No incidents reported

Friday 10th March 2023

No incidents reported

Thursday 9th March 2023

MAINTENANCE: SysEleven STACK announcement (DBL), scheduled 1 year ago

Affected Components: SysEleven Stack Networking in region DBL

Scheduled Start: 9 Mar 2023, 22:00 CET

Scheduled End: 10 Mar 2023, 00:00 CET

State: SCHEDULED

Description:

We will perform maintenance on networking gateways.

Customer Impact during the Maintenance:

  • Interruption of connectivity of virtual machines of up to 2 minutes
  • VPN connections could be interrupted for up to 2 minutes

Customer Actions:

  • no customer actions needed
  • please inform us if you notice any irregularities

Wednesday 8th March 2023

No incidents reported

Tuesday 7th March 2023

No incidents reported

Monday 6th March 2023

MAINTENANCE: SysEleven STACK announcement (FES), scheduled 1 year ago

Affected Components: SysEleven Stack in region FES

Scheduled Start: 6 Mar 2023, 22:00 CET

Scheduled End: 7 Mar 2023, 01:00 CET

State: SCHEDULED

Description:

We will roll out security updates for API servers and kernels.

Customer Impact during the Maintenance:

  • OpenStack APIs may be unreachable for a short time (a few minutes)
  • The availability of our shared storage could be reduced

Customer Actions:

  • no customer actions needed
  • please inform us if you notice any irregularities
MAINTENANCE: code.syseleven.de announcement, scheduled 1 year ago

Affected Components: code.syseleven.de

Scheduled Start: 06. March 2023/8:00 pm

Scheduled End: 06. March 2023/11:00 pm

State: SCHEDULED

Description:

We will implement changes to the storage type used by GitLab. We do not expect any restrictions on the accessibility of code.syseleven.de for the duration of the maintenance work, but it will not be possible to upload images to the container registry during this time. Read access should be possible throughout.

Customer Impact during the Maintenance:

  • read Access to code.syseleven.de will not be affected
  • it will not be possible to upload images to the container registry

Customer Actions:

  • No customer actions needed

Sunday 5th March 2023

No incidents reported

Saturday 4th March 2023

No incidents reported

Friday 3rd March 2023

No incidents reported

Thursday 2nd March 2023

API INCIDENT: SysEleven STACK API issues, region FES

Affected Components: SysEleven Stack API, region FES

Incident Start: 02nd February. 2023/11:00 Incident End: 02nd February. 2023/12:30

Description:

  • Accessibility of the SysEleven Stack API is not ensured.

Customer Impact:

  • Spawning new virtual machines (VMs) or changing existing resources is not possible.

Update:11:45

We identified the issue and fixed it. We are currently watching the situation and repairing follow up problems.

Update:12:05

We see additional problems and failing requests again, we are further investigating

Update:16:15

The observed API problems were fixed around 12:30, we kept an eye on the situation until 16:15

Wednesday 1st March 2023

No incidents reported

Tuesday 28th February 2023

MAINTENANCE: Keycloak platform scheduled update, scheduled 1 year ago

Affected Components: Keycloak platform (login.syseleven.de), all regions

Scheduled Start: 28. Feb. 2023/07:00 am

Scheduled End: 28. Feb. 2023/08:00 am

State: SCHEDULED

Description:

we will perform a scheduled update of our Keycloak platform (login.syseleven.de) to version 20.0.3.

Customer Impact during the Maintenance: During the update, the service will need to be briefly paused and restarted.

Access to the following services may be limited during this maintenance:

  • Metakube Dashboard
  • Harbor (scr.syseleven.de)
  • Gitlab (code.syseleven.de)
  • Managed Grafana (*.grafana.syseleven.de)
  • the Kubernetes API of customer clusters (if set up by the customer)

There will be no impact on running Metakube clusters, however, changes to clusters may not be possible if the above services are used.

Customer Actions:

  • No customer actions needed
  • Please inform us if you notice any irregularities

Monday 27th February 2023

No incidents reported

Sunday 26th February 2023

No incidents reported

Saturday 25th February 2023

No incidents reported

Friday 24th February 2023

No incidents reported

Thursday 23rd February 2023

No incidents reported

Wednesday 22nd February 2023

No incidents reported