Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port? #5423

Closed
lilianghao8 opened this issue Apr 13, 2022 · 18 comments

Comments

@lilianghao8
Copy link

K3s Version:
k3s version v1.20.15+k3s1 (c7a91e1)

Node(s) CPU architecture, OS, and Version:
Linux k3s-master 3.10.0-1160.el7.x86_64 #1 SMP Mon Oct 19 16:18:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Cluster Configuration:
single node

Describe the bug:
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

Steps To Reproduce:
After installing K3S and executing the command, the following prompt will appear, and it is occasional:
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

@brandond
Copy link
Member

Is the k3s service crashing and being restarted?

@lfdesousa
Copy link

lfdesousa commented Jul 9, 2022

I also have the same issue, I was following the instructions here, and tried to install and uninstall it, though in my case I am doing it in raspberry pi, with Ubuntu 22.04 and the outcome is always the same.

ubuntu@loadgenerator001:~$ sudo kubectl get nodes
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

After a lot of digging I found my answer here:
#4234

And by doing this my problem vanished:
sudo apt install linux-modules-extra-raspi && reboot

Make sure to check the logs, I was having an error message:
level=fatal msg="flannel exited: operation not supported"

Also, in my case I was caught on the corner while following these instructions:
https://computingforgeeks.com/install-kubernetes-on-ubuntu-using-k3s/

In particular this one:
curl -sfL https://get.k3s.io | sh -s - --docker

I went to another error, this time due to a mismatch between the cgroups, the issue is reported here:
#5738
In my case the fix was to install k3s with only this:
curl -sfL https://get.k3s.io | sh -

My platform is a raspberry pi 4B

I hope this can help others trying to find information

@cfpandrade
Copy link

If you are using a Raspi4 add this to the end of the line inside /boot/cmdline.txt (without the quotes)
"cgroup_memory=1 cgroup_enable=memory ip=[IP]::[GATEWAY]:[MASK]:[PI-NAME]:eth0:off"
and also add "arm_64bit=1" at the end of /boot/config.txt.

reboot and give it a try

@npivaut
Copy link

npivaut commented Oct 31, 2022

Up - Please

export KUBECONFIG=/etc/rancher/k3s/k3s.yaml
kubectl get pods --all-namespaces
helm ls --all-namespaces
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?
WARNING: Kubernetes configuration file is group-readable. This is insecure. Location: /etc/rancher/k3s/k3s.yaml
WARNING: Kubernetes configuration file is world-readable. This is insecure. Location: /etc/rancher/k3s/k3s.yaml
Error: Kubernetes cluster unreachable: Get "https://127.0.0.1:6443/version?timeout=32s": dial tcp 127.0.0.1:6443: connect: connection refused

@brandond
Copy link
Member

@npivaut
Get "https://127.0.0.1:6443/version?timeout=32s": dial tcp 127.0.0.1:6443: connect: connection refused

Is K3s running?

@npivaut
Copy link

npivaut commented Oct 31, 2022

@npivaut
Get "https://127.0.0.1:6443/version?timeout=32s": dial tcp 127.0.0.1:6443: connect: connection refused

Is K3s running?

systemctl status k3s.service
● k3s.service - Lightweight Kubernetes
Loaded: loaded (/etc/systemd/system/k3s.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Tue 2022-11-01 00:54:50 CET; 1s ago
Docs: https://k3s.io
Process: 73957 ExecStartPre=/bin/sh -xc ! /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.s>
Process: 73959 ExecStartPre=/sbin/modprobe br_netfilter (code=exited, status=0/SUCCESS)
Process: 73960 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS)
Process: 73961 ExecStart=/usr/local/bin/k3s server (code=exited, status=1/FAILURE)
Main PID: 73961 (code=exited, status=1/FAILURE)
CPU: 73ms

@npivaut
Copy link

npivaut commented Oct 31, 2022

@npivaut
Get "https://127.0.0.1:6443/version?timeout=32s": dial tcp 127.0.0.1:6443: connect: connection refused

Is K3s running?

nov. 01 00:57:49 PC-AMD sh[75182]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 00:57:49 PC-AMD sh[75183]: Failed to get unit file state for nm-cloud-setup.service: No such>
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=info msg="Starting k3s v1>
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=info msg="Configuring sql>
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=info msg="Configuring dat>
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=info msg="Database tables>
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=info msg="Kine available >
nov. 01 00:57:49 PC-AMD k3s[75186]: time="2022-11-01T00:57:49+01:00" level=fatal msg="starting kuber>
nov. 01 00:57:49 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit k3s.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
nov. 01 00:57:49 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit k3s.service has entered the 'failed' state with result 'exit-code'.
nov. 01 00:57:49 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
░░ Subject: L'unité (unit) k3s.service a échoué
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ L'unité (unit) k3s.service a échoué, avec le résultat failed.

@npivaut
Copy link

npivaut commented Nov 1, 2022

127.0.0.1       localhost
127.0.1.1       PC-AMD
127.0.1.1 artefacts.npivaut.local
# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
127.0.0.1 artefacts.npivaut.local

@brandond
Copy link
Member

brandond commented Nov 1, 2022

Please attach the full service logs.
journalctl -u k3s > k3s.log

@npivaut
Copy link

npivaut commented Nov 1, 2022

The file is very long, thank you. I put the last lines, I think the concern is in it.

logs
nov. 01 09:31:59 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2405.
nov. 01 09:31:59 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:31:59 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:31:59 PC-AMD sh[84041]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:31:59 PC-AMD sh[84042]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:31:59 PC-AMD k3s[84049]: time="2022-11-01T09:31:59+01:00" level=fatal msg="no default routes found in \"/proc/net/route\" or \"/proc/net/ipv6_route\""
nov. 01 09:31:59 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:31:59 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:31:59 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:32:04 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2406.
nov. 01 09:32:04 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:32:04 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:32:04 PC-AMD sh[84399]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:32:04 PC-AMD sh[84400]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:32:04 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:32:04 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:32:04 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:32:09 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2407.
nov. 01 09:32:09 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:32:09 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:32:09 PC-AMD sh[85193]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:32:09 PC-AMD sh[85194]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:32:09 +0000 UTC"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:32:09 +0000 UTC"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:32:09 +0000 UTC"
nov. 01 09:32:09 PC-AMD k3s[85197]: time="2022-11-01T09:32:09+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:32:09 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:32:09 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:32:09 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:32:14 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2408.
nov. 01 09:32:14 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:32:14 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:32:14 PC-AMD sh[86698]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:32:14 PC-AMD sh[86699]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:32:15 PC-AMD k3s[86702]: time="2022-11-01T09:32:15+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:32:15 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:32:15 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:32:15 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:32:20 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2409.
nov. 01 09:32:20 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:32:20 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:32:20 PC-AMD sh[86743]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:32:20 PC-AMD sh[86744]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:32:20 PC-AMD k3s[86747]: time="2022-11-01T09:32:20+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:32:20 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:32:20 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:32:20 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:32:25 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2410.
nov. 01 09:32:25 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:32:25 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:32:25 PC-AMD sh[86777]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:32:25 PC-AMD sh[86778]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:32:25 PC-AMD k3s[86781]: time="2022-11-01T09:32:25+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:32:25 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:32:25 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:32:25 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
-- Boot e07efb6e3caa47c88c22f7a051adafa6 --
nov. 01 09:33:15 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:15 PC-AMD sh[2539]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:15 PC-AMD sh[2540]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:15 PC-AMD k3s[2554]: time="2022-11-01T09:33:15+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:15 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:15 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:15 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:21 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 1.
nov. 01 09:33:21 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:21 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:21 PC-AMD sh[3091]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:21 PC-AMD sh[3092]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:33:21 +0000 UTC"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:33:21 +0000 UTC"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1666730186: notBefore=2022-10-25 20:36:26 +0000 UTC notAfter=2023-11-01 08:33:21 +0000 UTC"
nov. 01 09:33:21 PC-AMD k3s[3095]: time="2022-11-01T09:33:21+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:21 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:21 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:21 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:26 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 2.
nov. 01 09:33:26 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:26 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:26 PC-AMD sh[3124]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:26 PC-AMD sh[3125]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:26 PC-AMD k3s[3128]: time="2022-11-01T09:33:26+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:26 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:26 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:26 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:31 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 3.
nov. 01 09:33:31 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:31 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:31 PC-AMD sh[3922]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:31 PC-AMD sh[3923]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:31 PC-AMD k3s[3926]: time="2022-11-01T09:33:31+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:31 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:31 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:31 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:37 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 4.
nov. 01 09:33:37 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:37 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:37 PC-AMD sh[4158]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:37 PC-AMD sh[4159]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:37 PC-AMD k3s[4162]: time="2022-11-01T09:33:37+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:37 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:37 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:37 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:43 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 5.
nov. 01 09:33:43 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:43 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:43 PC-AMD sh[4316]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:43 PC-AMD sh[4317]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:43 PC-AMD k3s[4320]: time="2022-11-01T09:33:43+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:43 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:43 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:43 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:48 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 6.
nov. 01 09:33:48 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:48 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:48 PC-AMD sh[4370]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:48 PC-AMD sh[4371]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:48 PC-AMD k3s[4374]: time="2022-11-01T09:33:48+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:48 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:48 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:48 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:53 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 7.
nov. 01 09:33:53 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:53 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:53 PC-AMD sh[4398]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:53 PC-AMD sh[4399]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:53 PC-AMD k3s[4402]: time="2022-11-01T09:33:53+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:53 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:53 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:53 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:33:59 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 8.
nov. 01 09:33:59 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:33:59 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:33:59 PC-AMD sh[4427]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:33:59 PC-AMD sh[4428]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:33:59 PC-AMD k3s[4431]: time="2022-11-01T09:33:59+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:33:59 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:33:59 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:33:59 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:04 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 9.
nov. 01 09:34:04 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:04 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:04 PC-AMD sh[4536]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:04 PC-AMD sh[4537]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:04 PC-AMD k3s[4540]: time="2022-11-01T09:34:04+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:04 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:04 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:04 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:09 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 10.
nov. 01 09:34:09 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:09 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:09 PC-AMD sh[4566]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:09 PC-AMD sh[4567]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:09 PC-AMD k3s[4570]: time="2022-11-01T09:34:09+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:09 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:09 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:09 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:14 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 11.
nov. 01 09:34:14 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:14 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:14 PC-AMD sh[4613]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:14 PC-AMD sh[4614]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:14 PC-AMD k3s[4617]: time="2022-11-01T09:34:14+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:14 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:14 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:14 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:20 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 12.
nov. 01 09:34:20 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:20 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:20 PC-AMD sh[4664]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:20 PC-AMD sh[4665]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:20 PC-AMD k3s[4668]: time="2022-11-01T09:34:20+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:20 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:20 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:20 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:25 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 13.
nov. 01 09:34:25 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:25 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:25 PC-AMD sh[4695]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:25 PC-AMD sh[4696]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:25 PC-AMD k3s[4699]: time="2022-11-01T09:34:25+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:25 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:25 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:25 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:30 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 14.
nov. 01 09:34:30 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:30 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:30 PC-AMD sh[4724]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:30 PC-AMD sh[4725]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:30 PC-AMD k3s[4728]: time="2022-11-01T09:34:30+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:30 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:30 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:30 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:35 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 15.
nov. 01 09:34:35 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:35 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:35 PC-AMD sh[4760]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:35 PC-AMD sh[4761]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:35 PC-AMD k3s[4764]: time="2022-11-01T09:34:35+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:35 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:35 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:35 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:41 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 16.
nov. 01 09:34:41 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:41 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:41 PC-AMD sh[4823]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:41 PC-AMD sh[4824]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:41 PC-AMD k3s[4827]: time="2022-11-01T09:34:41+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:41 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:41 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:41 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:46 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 17.
nov. 01 09:34:46 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:46 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:46 PC-AMD sh[4856]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:46 PC-AMD sh[4857]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:46 PC-AMD k3s[4860]: time="2022-11-01T09:34:46+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:46 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:46 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:46 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:51 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 18.
nov. 01 09:34:51 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:51 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:51 PC-AMD sh[4886]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:51 PC-AMD sh[4887]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:51 PC-AMD k3s[4890]: time="2022-11-01T09:34:51+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:51 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:51 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:51 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.
nov. 01 09:34:56 PC-AMD systemd[1]: k3s.service: Scheduled restart job, restart counter is at 19.
nov. 01 09:34:56 PC-AMD systemd[1]: Stopped Lightweight Kubernetes.
nov. 01 09:34:56 PC-AMD systemd[1]: Starting Lightweight Kubernetes...
nov. 01 09:34:56 PC-AMD sh[4915]: + /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service
nov. 01 09:34:56 PC-AMD sh[4916]: Failed to get unit file state for nm-cloud-setup.service: No such file or directory
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=info msg="Starting k3s v1.25.3+k3s1 (f2585c16)"
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=info msg="Configuring database table schema and indexes, this may take a moment..."
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=info msg="Database tables and indexes are up to date"
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=info msg="Kine available at unix://kine.sock"
nov. 01 09:34:56 PC-AMD k3s[4919]: time="2022-11-01T09:34:56+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"
nov. 01 09:34:56 PC-AMD systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE
nov. 01 09:34:56 PC-AMD systemd[1]: k3s.service: Failed with result 'exit-code'.
nov. 01 09:34:56 PC-AMD systemd[1]: Failed to start Lightweight Kubernetes.

@brandond
Copy link
Member

brandond commented Nov 1, 2022

The file is very long, thank you.

yes, that was why I asked you to attach it instead of pasting it in.

nov. 01 09:32:04 PC-AMD k3s[84403]: time="2022-11-01T09:32:04+01:00" level=fatal msg="starting kubernetes: preparing server: failed to normalize token; must be in format K10<CA-HASH>::<USERNAME>:<PASSWORD> or <PASSWORD>"

There appears to be just this one pretty self-explanatory error message repeating every time. Please check the token you've configured on the CLI or in the config file, and make sure that it matches one of the requested formats.

@mrtnd
Copy link

mrtnd commented Nov 4, 2022

I also have the same issue, I was following the instructions here, and tried to install and uninstall it, though in my case I am doing it in raspberry pi, with Ubuntu 22.04 and the outcome is always the same.

ubuntu@loadgenerator001:~$ sudo kubectl get nodes The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

After a lot of digging I found my answer here: #4234

And by doing this my problem vanished: sudo apt install linux-modules-extra-raspi && reboot

Make sure to check the logs, I was having an error message: level=fatal msg="flannel exited: operation not supported"

Also, in my case I was caught on the corner while following these instructions: https://computingforgeeks.com/install-kubernetes-on-ubuntu-using-k3s/

In particular this one: curl -sfL https://get.k3s.io | sh -s - --docker

I went to another error, this time due to a mismatch between the cgroups, the issue is reported here: #5738 In my case the fix was to install k3s with only this: curl -sfL https://get.k3s.io | sh -

My platform is a raspberry pi 4B

I hope this can help others trying to find information

This fixed it for me! Thank you!

@npivaut
Copy link

npivaut commented Nov 7, 2022

@MarkOStewart
Copy link

I had this issue as well. (on RHEL 8.7)
My solution was k3s didn't like the hostname awx_21. I saw a discreet message about cannot find hostname and invalid characters etc.
After I changed the hostname to awx21 and restarted the VM I could get response from kubectl get nodes.

Hope this helps someone else. I looked for a solution online but only deep dive of logs told me what was wrong.

@sateesh5
Copy link

Hi

I have installed Docker Desktop in Windows 11 pro and enabled Kubernetes as well .

While running kubectl get node i am getting error as below

sateesh@Sateesh:$ kubectl get nodes
The connection to the server 127.0.0.1:56326 was refused - did you specify the right host or port?
sateesh@Sateesh:
$

Can you please help here

@brandond
Copy link
Member

brandond commented Mar 28, 2023

@sateesh5 you don't appear to be using K3s so I'm not sure how we can help.

@theLockesmith
Copy link

sudo apt install linux-modules-extra-raspi && reboot

I've been banging my head against a wall for a few days looking for this solution. Thank you!

@caroline-suse-rancher
Copy link
Contributor

Closing as it looks like there's a sufficient workaround for this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

No branches or pull requests

10 participants