Skip to content

v6.2: HAT-Tiny student distillation (≤1M params) #4

Description

@cashcon57

Distill HAT-Tiny teacher for inference path. Codex measurement job at /tmp/codex-queue/300 will verify HAT-Tiny actual ms before committing student size. Candidate students: NAFNet block, 3-layer EfficientViT-lite.

Metadata

Metadata

Assignees

No one assigned

    Labels

    distillationModel distillationpriority-p1Tier 2 priorityv6.2v6.2 architecture work

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions