Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FIX: Avoid loss of precision when casting in packet loading #781

Closed
wants to merge 1 commit into from
Closed

FIX: Avoid loss of precision when casting in packet loading #781

wants to merge 1 commit into from

Commits on Aug 26, 2024

  1. FIX: Avoid loss of precision when casting in packet loading 

    When using derived values there can be situations where a linear
conversion factor is applied to a uint8 value to turn a raw measurement
into a float temperature value for instance. These are represented
as a small uint datatype onboard, but need to be represented as a
float or larger integer datatype on the ground so we don't lose
precision. Previously we were getting 2.1 cast to 2 after the
derived types were attempted to be cast to their onboard types.
    @greglucas
    greglucas committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    af73099 View commit details
    Browse the repository at this point in the history