KKP on a Single Node with KubeOne on AWS

Use Cases

Resource constraint: In some cases, you will have one/single server/VM and would like to manage the workload with k8s. Follow this guide, when you want to build your k8s environment considering the resource constraint.

This chapter will guide you through the KKP Master setup on a single master/worker k8s node using Kubeone. Here, we are leveraging the kubeone addons capability for quick installation of KKP.

In this Get Started with KKP guide, we will be using AWS Cloud as our underlying infrastructure and KKP release v2.18.4.

For more information on the kubeone configurations for different environment, checkout the Creating the kubernetes Cluster using Kubeone documentation.

Prerequisites

Download the Repository

The kubermatic/kkp-single-node contains the required configuration to install KKP on single node k8s with kubeone. Clone or download it, so that you deploy KKP quickly as per the following instructions and get started with it!

git clone https://github.com/kubermatic/kkp-single-node.git
cd kkp-single-node

Configure the Environment

export AWS_ACCESS_KEY_ID=xxxxxxxxxxxxxxx
export AWS_SECRET_ACCESS_KEY=xxxxxxxxxxxxxxxxxxxx
# Path to your private SSH key. This is only used to configure SSH agent on your local machine.
export K1_SSH_PRIVATE_KEY_PATH=~/.ssh/id_rsa
# Path to your public SSH key, copied over to the nodes for SSH access
export K1_SSH_PUBLIC_KEY_PATH=~/.ssh/id_rsa.pub

Create the Infrastructure using Terraform

make k1-tf-apply PROVIDER=aws

You can update the terraform.tfvars with values such as cluster_name, ssh_public_key_file, ssh_private_key_file. More variables can be overridden here, see variables.tf.

Important: Add untaint flag with value as true in the output.tf file as shown below

output "kubeone_hosts" {
  description = "Control plane endpoints to SSH to"

  value = {
    control_plane = {
      untaint              = true

Prepare the KKP Addon Configuration

Replace the TODO place holder in addons/kkp yaml definitions.

export KKP_DNS=xxx.xxx.xxx.xxx
export KKP_USERNAME=xxxx@xxx.xxx
export RANDOM_SECRET=$(base64 < /dev/urandom | tr -dc '[:alnum:]' | head -c32)
export ISSUERCOOKIEKEY=$(base64 < /dev/urandom | tr -dc '[:alnum:]' | head -c32)
export SERVICEACCOUNTKEY=$(base64 < /dev/urandom | tr -dc '[:alnum:]' | head -c32)
mkdir -p ./aws/addons
cp -r ./addons.template/kkp ./aws/addons
sed -i 's/TODO_DNS/'"$KKP_DNS"'/g' ./aws/addons/kkp/*.yaml
sed -i 's/TODO@email.com/'"$KKP_USERNAME"'/g' ./aws/addons/kkp/*.yaml
sed -i 's/TODO-A-RANDOM-SECRET/'"$RANDOM_SECRET"'/g' ./aws/addons/kkp/*.yaml
sed -i 's/TODO-KUBERMATIC-OAUTH-SECRET-FROM-VALUES.YAML/'"$RANDOM_SECRET"'/g' ./aws/addons/kkp/*.yaml
sed -i 's/TODO-A-RANDOM-ISSUERCOOKIEKEY/'"$ISSUERCOOKIEKEY"'/g' ./aws/addons/kkp/*.yaml
sed -i 's/TODO-A-RANDOM-SERVICEACCOUNTKEY/'"$SERVICEACCOUNTKEY"'/g' ./aws/addons/kkp/*.yaml

KKP_DNS specifies the domain where the kubermatic dashboard would be hosted.

Create k8s Cluster using KubeOne along with KKP Master as an Addon

make k1-apply PROVIDER=aws

Configure the Cluster access

export KUBECONFIG=$PWD/aws/<cluster_name>-kubeconfig

Validate the KKP Master Setup

Get the LoadBalancer External IP by following command.
```
kubectl get svc -n ingress-nginx
```
Update DNS mapping with External IP of the nginx ingress controller service. In case of AWS, the CNAME record mapping for $TODO_DNS with External IP should be created.
Nginx Ingress Controller Load Balancer configuration - Add the node to backend pool manually.
Known Issue: Should be supported in the future as part of Feature request#1822
Verify the Kubermatic resources and certificates
```
kubectl -n kubermatic get deployments,pods
```
```
kubectl get certificates -A -w
```
Wait for a while, if still kubermatic-api-xxx pods / kubermatic & dex tls certificates are not in Ready state, delete and wait to get validated.

Finally, you should be able to login to KKP dashboard!

Use username/password configured as part of Kubermatic configuration.