Skip to content

Allow caching of on-device compiled model #3597

@charlesollion

Description

@charlesollion

For a given android device, the litert graph compilation can take time. How can I save/load/cache that to prevent recompiling each time i open the app?
I see that there's a roadmap for a model store that are compiled ahead of time, but that would be also very, very convienient to be able to manage the compiled model locally.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions