Reconciler error

[guyguy333]

Hello,

Our nodes are changed everyday (long story) but sometimes, VPC connection is not working and rebooting vpc-node pod results in:

I1020 17:25:00.639714       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"=":8080"
I1020 17:25:01.137435       1 node.go:108] setup "msg"="starting manager"  
I1020 17:25:01.139272       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
I1020 17:25:01.140499       1 controller.go:142] controller "msg"="Starting EventSource" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"id":"","nodeName":""},"status":{"linkName":"","macAddress":""}}}
I1020 17:25:01.242497       1 controller.go:142] controller "msg"="Starting EventSource" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"id":""},"status":{}}}
I1020 17:25:01.344076       1 controller.go:149] controller "msg"="Starting Controller" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
I1020 17:25:01.344206       1 controller.go:176] controller "msg"="Starting workers" "controller"="networkinterface" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" "worker count"=1
E1020 17:25:01.756659       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:01.756829       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:03.206108       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:03.206251       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:04.662746       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:04.662920       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:06.086721       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:06.086872       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:07.542605       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:07.542748       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:08.978448       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:08.978572       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:10.621461       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:10.622092       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:12.095565       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:12.095689       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:13.571530       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:13.642116       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:15.368710       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:15.368933       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:18.359452       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:18.359611       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:23.932903       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:23.933131       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:34.586873       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:34.587262       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface" 
E1020 17:25:55.501756       1 networkinterface_controller.go:144] controllers/NetworkInterface "msg"="unable to get link" "error"="link with address 02:00:00:00:72:23: NIC not found" "networkinterface"={"Namespace":"","Name":"example-scw-sxq7k"} 
E1020 17:25:55.502024       1 controller.go:246] controller "msg"="Reconciler error" "error"="link with address 02:00:00:00:72:23: NIC not found" "controller"="networkinterface" "name"="example-scw-sxq7k" "namespace"="" "reconcilerGroup"="vpc.scaleway.com" "reconcilerKind"="NetworkInterface"

It's second time happening in 3 months. Replacing the node fixes the issue.