Failing Bootstrap Initialization

[camaro4life18]

Describe the bug

I have been trying for awhile now to setup OKD for the first time, so I have been round and round with documents and Gemini trying to make sure this is not a ME problem. Still could be, but here is my setup:
Dell R730 Host
Proxmox 8.4.1
I have created 3 Control Plane nodes, 3 Worker Nodes, and 1 Bootstrap node. All have 4CPU, 16GB RAM, and 120GB HDDs

Version
I have tried 4.17, 4.18, and 4.19
I am attempting the UPI install on bare metal

How reproducible
Follow the instructions in the documentation
I have created the install-config.yaml, ran the manifest and ignition creation commands on my jump server.
Ran the command: openshift-install coreos print-stream-json | grep '.iso[^.]'
Downloaded the ISO specified for each version I have tried, (FCOS and SCOS)
Boot up the bootstrap VM, run:
sudo coreos-installer install --ignition-url http://192.168.1.91:8000/bootstrap.ign /dev/sda --insecure-ignition

The OS installer does its thing and comes back completed.
I tell it to reboot, and it starts booting the installed OS.
Here it takes some time, but some times I get the initial step to complete where it says it needs to wait for the versions API, some times I never get the API. However I never get past the step on waiting for the 45 minutes for the bootstrap to complete. This is where it always fails.
The API pass/fail may be dependent on 4.18 or 4.19. I have done so many installs at this point its hard to tell. My most recent install was from 4.18, which I will include the logs for. In the morning I will try 4.19 again and include those logs.

Log bundle 4.18

install-config.yaml.txt

.openshift_install.log

journal_bootstrap_current_boot.log

[JaimeMagiera]

I'm converting this to a discussion, as this doesn't seem to be a bug.

[JaimeMagiera]

Just to be clear: The bootstrap machine itself stalls on waiting for the API server or the installer?

[camaro4life18]

If I try to install 4.18, it fails waiting for the API server.

If I try to install 4.19, the API server starts up, but several containers fail to download and start.

Here are the logs from a 4.19 install attempt...

.openshift_install.log from the jump server:
time="2025-05-06T02:12:34Z" level=debug msg=" Loading Install Config..."
time="2025-05-06T02:12:34Z" level=debug msg=" Loading Bootstrap Ignition Config..."
time="2025-05-06T02:12:34Z" level=debug msg=" Fetching Cluster ID..."
time="2025-05-06T02:12:34Z" level=debug msg=" Reusing previously-fetched Cluster ID"
time="2025-05-06T02:12:34Z" level=debug msg=" Fetching Install Config..."
time="2025-05-06T02:12:34Z" level=debug msg=" Reusing previously-fetched Install Config"
time="2025-05-06T02:12:34Z" level=debug msg=" Fetching Bootstrap Ignition Config..."
time="2025-05-06T02:12:34Z" level=debug msg=" Reusing previously-fetched Bootstrap Ignition Config"
time="2025-05-06T02:12:34Z" level=debug msg="Generating Metadata..."
time="2025-05-06T02:12:34Z" level=info msg="Ignition-Configs created in: . and auth"
time="2025-05-06T02:19:04Z" level=debug msg="OpenShift Installer 4.19.0-okd-scos.ec.9"
time="2025-05-06T02:19:04Z" level=debug msg="Built from commit 08aa270e20db77b237306b3f3700d6b2ad654abc"
time="2025-05-06T02:19:04Z" level=info msg="Waiting up to 20m0s (until 2:39AM UTC) for the Kubernetes API at https://api.thor.asguard.com:6443..."
time="2025-05-06T02:19:04Z" level=debug msg="Loading Agent Config..."
time="2025-05-06T02:19:14Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:21:45Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:24:15Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:26:45Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:29:16Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:31:46Z" level=debug msg="Still waiting for the Kubernetes API: Get "https://api.thor.asguard.com:6443/version\": EOF"
time="2025-05-06T02:33:56Z" level=info msg="API v1.32.3-dirty up"
time="2025-05-06T02:33:56Z" level=debug msg="Loading Install Config..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading SSH Key..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Base Domain..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Platform..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Cluster Name..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Base Domain..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Platform..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Pull Secret..."
time="2025-05-06T02:33:56Z" level=debug msg=" Loading Platform..."
time="2025-05-06T02:33:56Z" level=debug msg="Using Install Config loaded from state file"
time="2025-05-06T02:33:56Z" level=info msg="Waiting up to 45m0s (until 3:18AM UTC) for bootstrapping to complete..."
time="2025-05-06T03:18:56Z" level=info msg="Use the following commands to gather logs from the cluster"
time="2025-05-06T03:18:56Z" level=info msg="openshift-install gather bootstrap --help"
time="2025-05-06T03:18:56Z" level=error msg="Bootstrap failed to complete: timed out waiting for the condition"
time="2025-05-06T03:18:56Z" level=error msg="Failed to wait for bootstrapping to complete. This error usually happens when there is a problem with control plane hosts that prevents the control plane operators from creating the control plane."

Here is the full log for the bootsrap server...
4.19-journal_bootstrap_current_boot.log.txt

The issue with 4.19 I believe has to do with this log snipet I see multiple time...

May 06 02:32:29 bootstrap.thor.asguard.com kubelet.sh[3099]: E0506 02:32:29.634937 3099 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="quay.io/okd/scos-content@sha256:acf89b72f9e24c6ad355a3fe0f9dd5f5b8209927d4489e5471fc5583dc24c8c1"
May 06 02:32:29 bootstrap.thor.asguard.com kubelet.sh[3099]: E0506 02:32:29.635019 3099 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="quay.io/okd/scos-content@sha256:acf89b72f9e24c6ad355a3fe0f9dd5f5b8209927d4489e5471fc5583dc24c8c1"
May 06 02:32:29 bootstrap.thor.asguard.com kubelet.sh[3099]: E0506 02:32:29.635569 3099 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:kube-controller-manager,Image:quay.io/okd/scos-content@sha256:acf89b72f9e24c6ad355a3fe0f9dd5f5b8209927d4489e5471fc5583dc24c8c1,Command:[hyperkube kube-controller-manager],Args:[--openshift-config=/etc/kubernetes/config/kube-controller-manager-config.yaml --kubeconfig=/etc/kubernetes/secrets/kubeconfig --v=2 --allocate-node-cidrs=false --authentication-kubeconfig=/etc/kubernetes/secrets/kubeconfig --authorization-kubeconfig=/etc/kubernetes/secrets/kubeconfig --cert-dir=/var/run/kubernetes --cloud-provider=external --cluster-cidr=10.128.0.0/14 --cluster-signing-cert-file=/etc/kubernetes/secrets/kubelet-signer.crt --cluster-signing-duration=720h --cluster-signing-key-file=/etc/kubernetes/secrets/kubelet-signer.key --controllers=* --controllers=-bootstrapsigner --controllers=-tokencleaner --controllers=-ttl --controllers=selinux-warning-controller --enable-dynamic-provisioning=true --feature-gates=AWSClusterHostedDNS=false --feature-gates=AWSEFSDriverVolumeMetrics=true --feature-gates=AdditionalRoutingCapabilities=true --feature-gates=AdminNetworkPolicy=true --feature-gates=AlibabaPlatform=true --feature-gates=AutomatedEtcdBackup=false --feature-gates=AzureWorkloadIdentity=true --feature-gates=BareMetalLoadBalancer=true --feature-gates=BootcNodeManagement=false --feature-gates=BuildCSIVolumes=true --feature-gates=CPMSMachineNamePrefix=false --feature-gates=ChunkSizeMiB=true --feature-gates=CloudDualStackNodeIPs=true --feature-gates=ClusterAPIInstall=false --feature-gates=ClusterAPIInstallIBMCloud=false --feature-gates=ClusterMonitoringConfig=false --feature-gates=ClusterVersionOperatorConfiguration=false --feature-gates=ConsolePluginContentSecurityPolicy=true --feature-gates=DNSNameResolver=false --feature-gates=DisableKubeletCloudCredentialProviders=true --feature-gates=DualReplica=false --feature-gates=DyanmicServiceEndpointIBMCloud=false --feature-gates=DynamicResourceAllocation=false --feature-gates=EtcdBackendQuota=false --feature-gates=EventedPLEG=false --feature-gates=Example2=false --feature-gates=Example=false --feature-gates=ExternalOIDC=false --feature-gates=ExternalOIDCWithUIDAndExtraClaimMappings=false --feature-gates=GCPClusterHostedDNS=false --feature-gates=GCPCustomAPIEndpoints=false --feature-gates=GCPLabelsTags=true --feature-gates=GatewayAPI=true --feature-gates=GatewayAPIController=false --feature-gates=HardwareSpeed=true --feature-gates=HighlyAvailableArbiter=false --feature-gates=ImageStreamImportMode=false --feature-gates=IngressControllerDynamicConfigurationManager=false --feature-gates=IngressControllerLBSubnetsAWS=true --feature-gates=InsightsConfig=false --feature-gates=InsightsConfigAPI=false --feature-gates=InsightsOnDemandDataGather=false --feature-gates=InsightsRuntimeExtractor=false --feature-gates=KMSEncryptionProvider=false --feature-gates=KMSv1=true --feature-gates=MachineAPIMigration=false --feature-gates=MachineAPIOperatorDisableMachineHealthCheckController=false --feature-gates=MachineAPIProviderOpenStack=false --feature-gates=MachineConfigNodes=false --feature-gates=ManagedBootImages=true --feature-gates=ManagedBootImagesAWS=true --feature-gates=MaxUnavailableStatefulSet=false --feature-gates=MetricsCollectionProfiles=true --feature-gates=MinimumKubeletVersion=false --feature-gates=MixedCPUsAllocation=false --feature-gates=MultiArchInstallAWS=true --feature-gates=MultiArchInstallAzure=false --feature-gates=MultiArchInstallGCP=true --feature-gates=NetworkDiagnosticsConfig=true --feature-gates=NetworkLiveMigration=true --feature-gates=NetworkSegmentation=true --feature-gates=NewOLM=true --feature-gates=NewOLMCatalogdAPIV1Metas=false --feature-gates=NewOLMPreflightPermissionChecks=false --feature-gates=NodeDisruptionPolicy=true --feature-gates=NodeSwap=false --feature-gates=NutanixMultiSubnets=false --feature-gates=OVNObservability=false --feature-gates=OnClusterBuild=true --feature-gates=OpenShiftPodSecurityAdmission=true --feature-gates=PersistentIPsForVirtualization=true --feature-gates=PinnedImages=false --feature-gates=PlatformOperators=false --feature-gates=PrivateHostedZoneAWS=true --feature-gates=ProcMountType=false --feature-gates=RouteAdvertisements=false --feature-gates=RouteExternalCertificate=true --feature-gates=SELinuxChangePolicy=false --feature-gates=SELinuxMount=false --feature-gates=ServiceAccountTokenNodeBinding=false --feature-gates=SetEIPForNLBIngressController=true --feature-gates=ShortCertRotation=false --feature-gates=SignatureStores=false --feature-gates=SigstoreImageVerification=false --feature-gates=SigstoreImageVerificationPKI=false --feature-gates=TranslateStreamCloseWebsocketRequests=false --feature-gates=UpgradeStatus=false --feature-gates=UserNamespacesPodSecurityStandards=false --feature-gates=UserNamespacesSupport=false --feature-gates=VSphereConfigurableMaxAllowedBlockVolumesPerNode=false --feature-gates=VSphereDriverConfiguration=true --feature-gates=VSphereHostVMGroupZonal=false --feature-gates=VSphereMultiDisk=false --feature-gates=VSphereMultiNetworks=false --feature-gates=VSphereMultiVCenters=true --feature-gates=ValidatingAdmissionPolicy=true --feature-gates=VolumeAttributesClass=false --feature-gates=VolumeGroupSnapshot=false --flex-volume-plugin-dir=/etc/kubernetes/kubelet-plugins/volume/exec --kube-api-burst=300 --kube-api-qps=150 --leader-elect-renew-deadline=12s --leader-elect-resource-lock=leases --leader-elect-retry-period=3s --leader-elect=true --pv-recycler-pod-template-filepath-hostpath= --pv-recycler-pod-template-filepath-nfs= --root-ca-file=/etc/kubernetes/secrets/kube-apiserver-complete-server-ca-bundle.crt --secure-port=10257 --service-account-private-key-file=/etc/kubernetes/secrets/service-account.key --service-cluster-ip-range=172.30.0.0/16 --use-service-account-credentials=true],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:10257,ContainerPort:10257,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{60 -3} {} 60m DecimalSI},memory: {{209715200 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:ssl-certs-host,ReadOnly:true,MountPath:/etc/ssl/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:secrets,ReadOnly:true,MountPath:/etc/kubernetes/secrets,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:etc-kubernetes-cloud,ReadOnly:true,MountPath:/etc/kubernetes/cloud,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/kubernetes/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:logs,ReadOnly:false,MountPath:/var/log/bootstrap-control-plane,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:{0 10257 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:45,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:{0 10257 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:healthz,Port:{0 10257 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:3,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod bootstrap-kube-controller-manager-bootstrap.thor.asguard.com_kube-system(d69238bcdf23c41adbb1a7a19ff7b762): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError"

[doman18]

Hi. I believe i have the same issue. Im trying to install 4.19 (note: i already successfully installed 4.8 months ago). Bootstrap node starts, 6443 and 26623 frontends status in haproxy are green.

netcatting returns connection ok. (56.3 - haproxy address , 56.10 - bootstrap node address)

[ocadmin@okd4t-services OKD]$ sudo nano /etc/haproxy/haproxy.cfg
[sudo] password for ocadmin:
[ocadmin@okd4t-services OKD]$ nc -zv 10.10.56.3 22623
Ncat: Version 7.92 ( https://nmap.org/ncat )
Ncat: Connected to 10.10.56.3:22623.
Ncat: 0 bytes sent, 0 bytes received in 0.01 seconds.

[ocadmin@okd4t-services ~]$ nc -zv 10.10.56.10 22623
Ncat: Version 7.92 ( https://nmap.org/ncat )
Ncat: Connected to 10.10.56.10:22623.
Ncat: 0 bytes sent, 0 bytes received in 0.01 seconds.

When i enter through SSH to bootstrap it shows some problem with coreos-fix-selinux-labels.service and node-image-finish.service. When i tried to just disable selinux and restart to see what happens now i have node-image-pull.service failing

$ ssh core@okd4t-bootstrap.os-t.mydomain.local
The authenticity of host 'okd4t-bootstrap.os-t.mydomain.local (10.10.56.10)' can't be established.
ED25519 key fingerprint is SHA256:c3pfsp9hoWrBHthxK2O5Z160miLpZwO1GTh72u+5sQo.
This key is not known by any other names
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'okd4t-bootstrap.os-t.mydomain.local' (ED25519) to the list of known hosts.
This is the bootstrap node; it will be destroyed when the master is fully up.

The primary services are release-image.service followed by bootkube.service. To watch their status, run e.g.

  journalctl -b -f -u release-image.service -u bootkube.service
[systemd]
Failed Units: 2
  coreos-fix-selinux-labels.service
  node-image-finish.service
[core@okd4t-bootstrap ~]$ sudo su
[systemd]
Failed Units: 2
  coreos-fix-selinux-labels.service
  node-image-finish.service
[root@okd4t-bootstrap core]# nano /etc/selinux/config
[root@okd4t-bootstrap core]# reboot -h now
[root@okd4t-bootstrap core]# Connection to okd4t-bootstrap.os-t.mydomain.local closed by remote host.
Connection to okd4t-bootstrap.os-t.mydomain.local closed.
[ocadmin@okd4t-services OKD]$ ssh core@okd4t-bootstrap.os-t.mydomain.local
This is the bootstrap node; it will be destroyed when the master is fully up.

The primary services are release-image.service followed by bootkube.service. To watch their status, run e.g.

  journalctl -b -f -u release-image.service -u bootkube.service
Last login: Tue May 20 13:47:49 2025 from 10.10.56.2
[systemd]
Failed Units: 1
  node-image-pull.service
[core@okd4t-bootstrap ~]$  journalctl -b -f -u release-image.service -u bootkube.service

^C
[core@okd4t-bootstrap ~]$ sudo su
[systemd]
Failed Units: 1
  node-image-pull.service
[root@okd4t-bootstrap core]# journalctl -b -f -u release-image.service -u bootkube.service
^C
[root@okd4t-bootstrap core]# sudo systemctl status node-image-pull.service
× node-image-pull.service - Node Image Pull
     Loaded: loaded (/etc/systemd/system/node-image-pull.service; static)
     Active: failed (Result: exit-code) since Tue 2025-05-20 13:48:55 UTC; 1min 56s ago
    Process: 1070 ExecStartPre=chcon --reference=/usr/bin/ostree /usr/local/bin/node-image-pull.sh (code=exited, status=0/SUCCESS)
    Process: 1080 ExecStart=/usr/local/bin/node-image-pull.sh (code=exited, status=1/FAILURE)
   Main PID: 1080 (code=exited, status=1/FAILURE)
        CPU: 328ms

May 20 13:48:53 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1080]: Currently on CoreOS version 9.0.20250411-0
May 20 13:48:53 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1080]: Target node image is quay.io/okd/scos-content@sha256:fba4eb9ce34172ff46107f3455db8>
May 20 13:48:53 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1080]: Not in live environment
May 20 13:48:53 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1080]: Pulling quay.io/okd/scos-content@sha256:fba4eb9ce34172ff46107f3455db8f045f9d6f2047>
May 20 13:48:53 okd4t-bootstrap.os-t.mydomain.local ostree-containe[1250]: Fetching ostree-unverified-registry:quay.io/okd/scos-content@sha256:fba4eb9ce34172ff4>
May 20 13:48:55 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1250]: No changes in ostree-unverified-registry:quay.io/okd/scos-content@sha256:fba4eb9ce>
May 20 13:48:55 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1269]: error: --create specified but ref coreos/node-image already exists
May 20 13:48:55 okd4t-bootstrap.os-t.mydomain.local systemd[1]: node-image-pull.service: Main process exited, code=exited, status=1/FAILURE
May 20 13:48:55 okd4t-bootstrap.os-t.mydomain.local systemd[1]: node-image-pull.service: Failed with result 'exit-code'.
May 20 13:48:55 okd4t-bootstrap.os-t.mydomain.local systemd[1]: Failed to start Node Image Pull.

I tried to debug it with AI and it points at some problems in /usr/local/bin/node-image-pull.sh script

https://www.perplexity.ai/search/last-login-tue-may-20-07-23-55-9avgx6X9T5Kftp7irGhTIw

EDIT: I checked journalctl of bootstrap node from the start and found this

May 20 16:28:54 okd4t-bootstrap.os-t.mydomain.local podman[1976]: 2025-05-20 16:28:54.47436078 +0000 UTC m=+0.247478721 system refresh
May 20 16:28:54 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1976]: Error: no such object: "quay.io/okd/scos-release@sha256:133e4ee7406b060cf434256cdea489b184c575fb4aad985f4ed5fe0fe18dd851"
May 20 16:28:54 okd4t-bootstrap.os-t.mydomain.local node-image-pull.sh[1968]: Warning: Could not resolve release image to pull by digest

but when i tried to pull it manually it went fine

 podman pull quay.io/okd/scos-release@sha256:133e4ee7406b060cf434256cdea489b184c575fb4aad985f4ed5fe0fe18dd851
Trying to pull quay.io/okd/scos-release@sha256:133e4ee7406b060cf434256cdea489b184c575fb4aad985f4ed5fe0fe18dd851...
Getting image source signatures
Copying blob 6b2459a9848d done   |
Copying blob fb6485c1d3bf done   |
Copying blob 2916c184a58b done   |
Copying blob b0268b2d3348 done   |
Copying blob 0144b5d731d6 done   |
Copying blob dd529faa9f56 done   |
Copying config 32312380bf done   |
Writing manifest to image destination
32312380bf22ccf42c98b147e9c3c363086acbc1e19713079864e38ad4d495b8

Also i see new 4.19 version came out. I will try it out tomorrow