Skip to content

Improve performance for CLI with database format output #3

@wtlin1228

Description

@wtlin1228

The database version takes 3m while the in-memory version only takes 5s to parse 5,000 modules and create the portable. Maybe there is some optimization could speed up the database version. Like:

  • Use in-memory https://www.sqlite.org/inmemorydb.html SQLite then serialize it in the end.
  • Use the original in-memory approach to collect the portable then batch insert the records into SQLite database.
  • Enable multiple threads database modification by (1) replacing the "retrieve then create" with UNIQUE table constraint and (2) removing last_insert_rowid().
  • Add index for tables.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions