Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read the metadata of the SAR image files #7

Merged
merged 23 commits into from
Jul 5, 2023
Merged

Conversation

keewis
Copy link
Collaborator

@keewis keewis commented Jun 28, 2023

The SAR image files have a header, and then contain a (large) number of uncompressed data records. This only defines the structure of the SAR image header, because reading all data records at once would consume too much memory.

Todo: figure out the byte ranges for each of the data records.

@keewis keewis mentioned this pull request Jun 28, 2023
6 tasks
@keewis
Copy link
Collaborator Author

keewis commented Jul 3, 2023

with the latest commits, we can extract the metadata including byte offsets of the actual data, then separately read the data (this takes a 100-400ms or more, depending on network speed / disk access time).

Extracting the metadata also takes about a minute per sar image file (we have lots of those per dataset), so we might want to create cache files for those, reducing the time to a few seconds at most.

@keewis keewis merged commit 54909c3 into umr-lops:main Jul 5, 2023
7 checks passed
@keewis keewis deleted the sar-image branch July 5, 2023 09:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant