Implement background job heartbeat and stuck-job detection

[Baskarayelu]

Implement background job heartbeat and stuck-job detection

Description

• Detect and surface stuck workers by tracking periodic job heartbeats.

Requirements and context

• Persist heartbeat timestamp and mark stale jobs after configurable threshold.
• Expose stale-job metric and alert-ready signal.

Suggested execution

• Update worker runtime to emit heartbeat at fixed interval.
• Add reconciliation process to mark and optionally requeue stale jobs.

Test and commit

• Add tests for heartbeat updates and stale detection transitions.

Example commit message

• feat(jobs): add heartbeat tracking and stale job detection

Guidelines

• Avoid duplicate requeue for actively running jobs.
• Keep logic resilient to short network interruptions.

[drips-wave]

This issue has been added to the Stellar Wave Program and is worth 200 Points.

🧑‍💻 Interested in contributing? Apply to work on this issue on Drips Wave, earn points, and receive rewards.

Warning

Only applications submitted via the apply link above will be considered. Please do not apply by commenting on the issue or opening a PR directly.

🤠 Repo maintainers: You can manage this issue's Points and Complexity on your Maintainer Dashboard here. Please keep an eye on applications and respond quickly 💙

ℹ️ Learn more about Drips Wave

[codenerde]

@codenerde has applied to work on this issue as part of the Stellar Wave Program's 3rd wave.

Good day kind sir, please i'd love to work on your projects sir.

ℹ️ Repo Maintainers: To accept this application, review their application or assign @codenerde to this issue.

[drips-wave]

Congratulations, @codenerde! 🎉 Your application was accepted by the repo's maintainers, and the issue is due on March 30, 2026.

🧑‍💻 @codenerde: Please resolve the issue such that the repo's maintainers have enough time to review your contribution before the due date. You'll earn Points for completing the issue on-time, which will make you eligible for a share of the Stellar Wave Program's reward pool.

Warning

When opening a PR, please link it to this issue to ensure it gets tracked accurately. Points are awarded when this issue is marked as completed by the maintainer.

🤠 Repo maintainers: Please keep an eye on the contributor's progress and review their work before the due date. You can manage this issue, including adjusting its complexity and points, here.

🌊 Happy Wave 🌊