Known Issues

This page documents the list of known issues in Kubermatic KubeOne along with possible workarounds and recommendations.

This list applies to KubeOne 1.9 release. For KubeOne 1.8, please consider the v1.8 version of this document. For earlier releases, please consult the appropriate changelog.

Calico VXLAN Addon is not working properly

StatusUnder investigation
SeverityLow
GitHub issueTBD

Description

We have discovered the the optional Calico VXLAN addon that we provide might not work in all setups. We’re currently investigating this and will provide more information as we have them.

This issue is considered low severity because this is an optional addon and you have to opt-in to use it as described in this document. By default, KubeOne uses Canal CNI which is a separate addon and is confirmed to work properly on all supported providers and Kubernetes versions.

If you’re using the optional Calico VXLAN addon, we recommend staying on your current Kubernetes version until we don’t have more information about this issue.

Internal Kubernetes endpoints unreachable on vSphere with Cilium/Canal

StatusWorkaround available
SeverityLow
GitHub issuehttps://github.com/cilium/cilium/issues/21801

Description

Symptoms

  • Unable to perform CRUD operations on resources governed by webhooks (e.g. ValidatingWebhookConfiguration, MutatingWebhookConfiguration, etc.). The following error is observed:
Internal error occurred: failed calling webhook "webhook-name": failed to call webhook: Post "https://webhook-service-name.namespace.svc:443/webhook-endpoint": context deadline exceeded
  • Unable to reach internal Kubernetes endpoints from pods/nodes.
  • ICMP is working but TCP/UDP is not.

Cause

On recent enough VMware hardware compatibility version (i.e >=15 or maybe >=14), CNI connectivity breaks because of hardware segmentation offload. cilium-health status has ICMP connectivity working, but not TCP connectivity. cilium-health status may also fail completely.

Recommendation

sudo ethtool -K ens192 tx-udp_tnl-segmentation off
sudo ethtool -K ens192 tx-udp_tnl-csum-segmentation off

These flags are related to the hardware segmentation offload done by the vSphere driver VMXNET3. We have observed this issue for both Cilium and Canal CNI running on Ubuntu 22.04.

We have two options to configure these flags for KubeOne installations:

References