New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up parsing the NMEEA messages #171

Open

sandroklarer-pingpong wants to merge 2 commits into Stanford-NavLab:v1.0.3b from sandroklarer-pingpong:sandro-klarer/speed-up-nmea-parsing

sandroklarer-pingpong commented Oct 31, 2024

Using the pandas concat() function is very time consuming. Changed it according to:
what-is-the-fastest-and-most-efficient-way-to-append-rows-to-a-dataframe

Parsing my 7receivers day log (~800MB) of MNEA messages takes 3500s, now it takes 180s.

danineamati and others added 2 commits

October 29, 2024 21:38


          Merge pull request Stanford-NavLab#170 from Stanford-NavLab/v1.0.3b

880bbf7

V1.0.3b


          Speed up parsing the NMEEA messages. Using the pandas concat() functi…

77008ee

…on is very time consuming. Changed it according to:

https://stackoverflow.com/questions/57000903/what-is-the-fastest-and-most-efficient-way-to-append-rows-to-a-dataframehttps://stackoverflow.com/questions/57000903/what-is-the-fastest-and-most-efficient-way-to-append-rows-to-a-dataframe
Parsing 800MB of MNEA messages takes 3500s, now it takes 180s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet