You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently we compare the car states from panda and openpilot to ensure that both parse CAN messages with the same 1) validity checks and 2) correctness/no bugs. That let us fix quite a few mismatches in behavior between the two: #30443
Now we want to fuzz the tx messages as well, to discover bugs related to controlsAllowed in panda, and general tx safety. Here is one such mismatch that we should aim to catch: commaai/panda#1948
See the first PR linked above for rx to know where to start. Bounty is for a merged PR that adds fuzz testing for sent openpilot messages that
detects mismatches in tx (sent messages) logic between openpilot and panda,
extensible (generic, and easy to expand with more state),
as performant as our current fuzzy testing, and
covers as many cases as possible (catches a few bugs along the way, if there are any).
The text was updated successfully, but these errors were encountered:
@sshane Based on the rx example, should the tx messages be similar to the rx messages? Create a packet, transmit can messages (via safety_tx_hook), update openpilot, and compare it with the previous panda state?
adeebshihadeh
changed the title
[$500 bounty] test_models: add a test that fuzzes the tx messages
test_models: add a test that fuzzes the tx messages
Jul 7, 2024
Currently we compare the car states from panda and openpilot to ensure that both parse CAN messages with the same 1) validity checks and 2) correctness/no bugs. That let us fix quite a few mismatches in behavior between the two: #30443
Now we want to fuzz the tx messages as well, to discover bugs related to controlsAllowed in panda, and general tx safety. Here is one such mismatch that we should aim to catch: commaai/panda#1948
See the first PR linked above for rx to know where to start. Bounty is for a merged PR that adds fuzz testing for sent openpilot messages that
The text was updated successfully, but these errors were encountered: