[Refactor] Migrate Pandas Ingestion to Polars for High-Throughput

[gelluisaac]

​Description: Use Polars for the preprocessing/ module to handle millions of rows of ledger data efficiently during backfills.

[drips-wave]

This issue has been added to the Stellar Wave Program and is worth 200 Points.

🧑‍💻 Interested in contributing? Apply to work on this issue on Drips Wave, earn points, and receive rewards.

Warning

Only applications submitted via the apply link above will be considered. Please do not apply by commenting on the issue or opening a PR directly.

🤠 Repo maintainers: You can manage this issue's Points and Complexity on your Maintainer Dashboard here. Please keep an eye on applications and respond quickly 💙

ℹ️ Learn more about Drips Wave

[hotoke-no-Kami]

@hotoke-no-Kami has applied to work on this issue as part of the Stellar Wave Program's 3rd wave.

I will love to work on this.

ℹ️ Repo Maintainers: To accept this application, review their application or assign @hotoke-no-Kami to this issue.

[drips-wave]

Congratulations, @hotoke-no-Kami! 🎉 Your application was accepted by the repo's maintainers, and the issue is due on March 30, 2026.

🧑‍💻 @hotoke-no-Kami: Please resolve the issue such that the repo's maintainers have enough time to review your contribution before the due date. You'll earn Points for completing the issue on-time, which will make you eligible for a share of the Stellar Wave Program's reward pool.

Warning

When opening a PR, please link it to this issue to ensure it gets tracked accurately. Points are awarded when this issue is marked as completed by the maintainer.

🤠 Repo maintainers: Please keep an eye on the contributor's progress and review their work before the due date. You can manage this issue, including adjusting its complexity and points, here.

🌊 Happy Wave 🌊