feat(bitcoin-da): Job service

[jfldde]

Description

• Fixes the stale fee issue and utxo selection by funding the tx at the time of sending instead of the time of queueing.
• Replaces two queues with a single persistent job storage.

Improvements

• A proving job id now has an associated da job id. A partial chunked proof can now be recovered via da job id and doesn't have to be fully resent. This saves re-sending already sent chunks.
• Each da job now uses the current bitcoin fee rate for sending transaction. Txs are funded on the same block they are sent. This should fix the stale fee issue feat: batch proof sending stops over 15 sat/vbyte #2801
• Da queue is now persistent and handles recovery of pending and in-progress da jobs

Status

• Job submission and tracking
• Partial sending of chunked transactions
• Recovery (missing tests)

Missing

• Job iteration by status @jfldde
• Prevent concurrent job processing @jfldde
• RPC (Admin) @jfldde
  • Cancel a job
  • Retry a job
  • List jobs
  • Protect with API_KEY
• Fee rate per job @jfldde
• Cap fee rate, see feat: Temporary cap bitcoin-da fee rate #2942 @jfldde
• Improve UTXO selection for chained mode @jfldde
• metrics
• Handle finalize_proving_job
• Database job schemas (@rakanalh )
• Tests
  • RPCs
  • recovery
  • Parallel proof sending
• rollback handling (@rakanalh)
• documentation
• Tame disk usage (de-duplicate RawTxData)
• Fix Bypass commit transaction change unsafeness #2999
• fix queue_oldest_mode flakiness Flaky test: test_queue_da_transactions_oldest_mode #2930 && Fix test_queue_da_transactions_oldest_mode flakiness #2744

Linked Issues

• Fixes bitcoin-da Job service #2841
• fixes feat: batch proof sending stops over 15 sat/vbyte #2801

[codecov]

Codecov Report

❌ Patch coverage is 90.22646% with 82 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.8%. Comparing base (65687ea) to head (8de4155).

Files with missing lines	Patch %	Lines
crates/bitcoin-da/src/job/service.rs	82.7%	20 Missing ⚠️
crates/bitcoin-da/src/service.rs	90.9%	15 Missing ⚠️
crates/bitcoin-da/src/job/metrics.rs	76.7%	10 Missing ⚠️
crates/storage-ops/src/rollback/node/sequencer.rs	54.5%	10 Missing ⚠️
crates/bitcoin-da/src/job/rpc.rs	91.4%	8 Missing ⚠️
crates/bitcoin-da/src/job/utils.rs	0.0%	4 Missing ⚠️
...ates/sovereign-sdk/adapters/mock-da/src/service.rs	88.4%	3 Missing ⚠️
...dk/full-node/db/sov-db/src/schema/types/da_jobs.rs	90.0%	3 Missing ⚠️
crates/bitcoin-da/src/fee.rs	96.7%	2 Missing ⚠️
...s/bitcoin-da/src/helpers/builders/body_builders.rs	83.3%	1 Missing ⚠️
... and 6 more

Additional details and impacted files

Files with missing lines	Coverage Δ
bin/citrea/src/main.rs	80.4% <ø> (ø)
bin/citrea/src/rollup/bitcoin.rs	67.5% <100.0%> (-0.3%)	⬇️
bin/citrea/src/rollup/mock.rs	75.9% <100.0%> (+0.3%)	⬆️
bin/citrea/src/rollup/mod.rs	86.4% <100.0%> (+<0.1%)	⬆️
crates/batch-prover/src/prover.rs	98.7% <100.0%> (+1.1%)	⬆️
crates/batch-prover/src/rpc.rs	94.1% <100.0%> (+0.6%)	⬆️
crates/bitcoin-da/src/error.rs	64.7% <ø> (-23.6%)	⬇️
crates/bitcoin-da/src/helpers/builders/mod.rs	100.0% <ø> (ø)
crates/bitcoin-da/src/helpers/builders/tests.rs	98.5% <100.0%> (+<0.1%)	⬆️
crates/bitcoin-da/src/helpers/mod.rs	93.6% <100.0%> (+0.5%)	⬆️
... and 25 more

... and 3 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.