Skip to content

Max pending/unpinned quota #1870

@alanshaw

Description

@alanshaw

We've recently had a user pin hundreds of thousands of CIDs that they do not have access to and can never retrieve.

This adds load to our cluster and dagcargo that is currently never resolved.

The idea here is to add a quota for maximum "in flight" pins. This effectively puts a per user cap on the number of pins that can be submitted that never become pinned. The user then starts to receive 4xx errors for pin requests, which should prompt them to delete bad pins. It also serves as a crude rate limiting mechanism.

Alternatively an adequete cleanup job could take care of this, but the idea here is to reduce that load by encouraging users to clean up after themselves.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1High: Likely tackled by core team if no one steps upkind/enhancementA net-new feature or improvement to an existing featurepotential/support-pi

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions