Runners are not getting created

[GolanTrevize10]

Hi we just installed the ARC using helm chart in AKS. The controller and listener are created correctly but when we try to run a job, the runner is not created. We can see in the listener logs this

2024-05-20T14:17:05Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:17:05Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:17:55Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:17:55Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:17:55Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:17:55Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:18:45Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:18:45Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:18:45Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:18:45Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:19:35Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:19:35Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:19:35Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:19:35Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:20:25Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:20:25Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:20:25Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:20:25Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:21:15Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:21:15Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:21:15Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:21:15Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}
2024-05-20T14:22:05Z    INFO    listener-app.worker.kubernetesworker    Created merge patch json for EphemeralRunnerSet update  {"json": "{\"spec\":{\"patchID\":0,\"replicas\":null}}"}
2024-05-20T14:22:05Z    INFO    listener-app.worker.kubernetesworker    Scaling ephemeral runner set    {"assigned job": 0, "decision": 0, "min": 0, "max": 2147483647, "currentRunnerCount": 0, "jobsCompleted": 0}
2024-05-20T14:22:05Z    INFO    listener-app.worker.kubernetesworker    Ephemeral runner set scaled.    {"namespace": "arc", "name": "arc-test-lgs86", "replicas": 0}
2024-05-20T14:22:05Z    INFO    listener-app.listener   Getting next message    {"lastMessageID": 0}

Anybody knows how we can get some logs about what is failing?

[alexgaganashvili]

@GolanTrevize10 , seems like I'm running into the same issue.

[nikola-jokic]

Hey 👋

Are you targeting the scale set from your workflows? The listener seems to be configured correctly, and it seems like there are no jobs scheduled on that scale set. If your workflow doesn't contain runs-on: [YOUR_SCALE_SET_NAME], then the workflow will not be scheduled on it.

[GolanTrevize10]

I found the issue, I forgot to grant permission on the repository to use the Runner group

[nikola-jokic]

I'm glad you resolved it!