Skip to content

Latest commit

 

History

History
119 lines (115 loc) · 8.3 KB

negative-coverage.md

File metadata and controls

119 lines (115 loc) · 8.3 KB

SBOL 3.1.0 negative + positive coverage matrix

Generated by SBOL_UPDATE_NEGATIVE_COVERAGE=1 cargo test -p sbol3 --test validation_rules negative_coverage_matrix_matches_committed_file. CI runs the same test without the variable as a freshness gate.

Every one of the 109 machine-checkable rules has at least one negative fixture (a violating document asserted to report the rule at its catalog severity) and at least one positive fixture (a valid instance asserted not to report it). Resolver- and topology-gated rules carry their negative under a dedicated external/option test rather than the offline cases() corpus.

Rule Section Status Normative Blocker Negatives Positives Negative source
sbol3-10101 5.1 Configurable Must External 1 1 cases()
sbol3-10102 5.1 Error Must — 1 1 cases()
sbol3-10103 5.1 Error Must — 1 1 cases()
sbol3-10104 5.1 Error Must — 1 1 cases()
sbol3-10105 5.2 Configurable Must Policy 1 1 cases()
sbol3-10106 5.4 Error Must — 1 1 cases()
sbol3-10107 5.4 Warning Should — 1 1 cases()
sbol3-10108 5.4 Warning Should — 1 1 cases()
sbol3-10109 5.2 Error Must — 1 1 cases()
sbol3-10110 4.2 Error Must — 1 1 cases()
sbol3-10111 5.3 Error Must — 5 1 cases()
sbol3-10112 5.3 Error Must — 1 1 cases()
sbol3-10113 5.3 Configurable Must Resolver 1 1 cases()
sbol3-10114 5.3 Configurable Should Resolver 0 1 external_validation.rs (resolver mode)
sbol3-10201 6.1 Error Must — 1 2 cases()
sbol3-10202 6.1 Error Must — 1 1 cases()
sbol3-10203 6.1 Error Must — 1 1 cases()
sbol3-10204 6.1 Error Must — 1 1 cases()
sbol3-10205 A.1 Warning Should — 1 1 cases()
sbol3-10301 6.2 Error Must — 1 2 cases()
sbol3-10501 6.3 Error Must — 1 1 cases()
sbol3-10503 6.3 Configurable Must Ontology 1 4 cases()
sbol3-10505 6.3 Configurable Should Ontology 1 1 cases()
sbol3-10601 6.4 Error Must — 1 1 cases()
sbol3-10604 6.4 Warning Should — 1 1 cases()
sbol3-10607 6.4 Configurable Should Ontology 1 1 cases()
sbol3-10608 6.4 Configurable Should Ontology 1 1 cases()
sbol3-10612 6.4 Configurable Should Ontology 1 1 cases()
sbol3-10613 6.4 Configurable Should Ontology 1 1 cases()
sbol3-10616 6.4 Configurable Must Ontology 1 1 cases()
sbol3-10617 6.4 Configurable Should Policy 1 1 cases()
sbol3-10702 6.4.1 Error Must — 1 1 cases()
sbol3-10801 6.4.1.1 Error Must — 1 1 cases()
sbol3-10802 6.4.1.1 Error Must — 1 1 cases()
sbol3-10803 6.4.1.1 Error Must — 1 1 cases()
sbol3-10804 6.4.1.1 Error Must — 1 1 cases()
sbol3-10805 6.4.1.1 Error Must — 1 1 cases()
sbol3-10806 6.4.1.1 Error Must — 1 1 cases()
sbol3-10807 6.4.1.1 Error Must — 1 1 cases()
sbol3-10901 6.4.1.2 Error Must — 1 1 cases()
sbol3-10902 6.4.1.2 Error Must — 1 1 cases()
sbol3-10903 6.4.1.2 Error Must — 1 1 cases()
sbol3-10904 6.4.1.2 Error Must — 1 1 cases()
sbol3-11001 6.4.1.3 Error Must — 1 1 cases()
sbol3-11004 6.4.1.3 Warning Should — 1 1 cases()
sbol3-11007 6.4.1.3 Configurable Should Ontology 1 1 cases()
sbol3-11008 6.4.1.3 Configurable Should Ontology 1 1 cases()
sbol3-11011 6.4 Configurable Should Ontology 1 1 cases()
sbol3-11012 6.4 Configurable Should Ontology 1 1 cases()
sbol3-11013 6.4.1.3 Error Must — 1 1 cases()
sbol3-11101 6.4.1.4 Error Must — 1 1 cases()
sbol3-11104 6.4.1.4 Warning Should — 1 1 cases()
sbol3-11107 6.4.1.4 Configurable Should Ontology 1 1 cases()
sbol3-11108 6.4.1.4 Configurable Should Ontology 1 1 cases()
sbol3-11201 6.4.1.5 Error Must — 1 1 cases()
sbol3-11301 6.4.2 Error Must — 2 1 cases()
sbol3-11302 6.4.2 Error Must — 1 1 cases()
sbol3-11303 6.4.2 Error Must — 1 1 cases()
sbol3-11401 6.4.2.1 Error Must — 1 2 cases()
sbol3-11402 6.4.2.1 Error Must — 1 2 cases()
sbol3-11403 6.4.2.1 Error Must — 1 1 cases()
sbol3-11501 6.4.2.2 Error Must — 1 2 cases()
sbol3-11701 6.4.3 Error Must — 1 1 cases()
sbol3-11702 6.4.3 Error Must — 1 1 cases()
sbol3-11703 6.4.3 Error Must — 1 1 cases()
sbol3-11704 6.4.3 Warning Should — 1 1 cases()
sbol3-11705 6.4.3 Configurable Must Policy 1 2 cases()
sbol3-11706 6.4.3 Configurable Must Policy 1 1 cases()
sbol3-11803 6.4.4 Configurable Should Ontology 1 1 cases()
sbol3-11804 6.4.4 Configurable Should Ontology 1 1 cases()
sbol3-11901 6.4.4.1 Error Must — 1 1 cases()
sbol3-11902 6.4.4.1 Error Must — 1 1 cases()
sbol3-11903 6.4.4.1 Error Must — 1 1 cases()
sbol3-11906 6.4.4.1 Configurable Should Ontology 1 1 cases()
sbol3-12001 6.4.5 Error Must — 1 1 cases()
sbol3-12002 6.4.5 Error Must — 1 1 cases()
sbol3-12003 6.4.5 Error Must — 1 1 cases()
sbol3-12101 6.5 Error Must — 1 1 cases()
sbol3-12102 6.5 Error Must — 1 1 cases()
sbol3-12103 6.5 Error Must — 1 1 cases()
sbol3-12104 6.5 Configurable Should Policy 1 1 cases()
sbol3-12105 6.5 Configurable Should Policy 1 1 cases()
sbol3-12106 6.5 Configurable Should Policy 1 1 cases()
sbol3-12107 6.5 Configurable Should Policy 1 1 cases()
sbol3-12108 6.5 Configurable Should Policy 1 1 cases()
sbol3-12109 6.5 Configurable Must Policy 1 1 cases()
sbol3-12110 6.5 Configurable Should Policy 1 1 cases()
sbol3-12111 6.5 Configurable Should Policy 1 1 cases()
sbol3-12112 6.5 Configurable Must Policy 1 1 cases()
sbol3-12113 6.5 Configurable Must Resolver 1 1 cases()
sbol3-12114 6.5 Configurable Should Policy 1 1 cases()
sbol3-12115 6.5 Configurable Should Policy 1 1 cases()
sbol3-12201 6.5.1 Error Must — 2 1 cases()
sbol3-12202 6.5.1 Error Must — 1 1 cases()
sbol3-12203 6.5.1 Error Must — 1 1 cases()
sbol3-12204 6.5.1 Error Must — 1 1 cases()
sbol3-12504 6.8 Configurable Should Ontology 1 1 cases()
sbol3-12507 6.8 Warning Should — 1 1 cases()
sbol3-12803 6.10 Configurable Should Ontology 1 1 cases()
sbol3-12807 6.10 Warning Should — 1 1 cases()
sbol3-12808 6.10 Error Must — 1 1 cases()
sbol3-12901 A.1.1 Warning Should — 1 1 cases()
sbol3-12902 A.1.1 Warning Should — 1 1 cases()
sbol3-13001 A.1.2 Warning Should — 1 1 cases()
sbol3-13401 A.2.1 Warning Should — 1 1 cases()
sbol3-13501 A.2.2 Warning Should — 1 1 cases()
sbol3-13502 A.2.2 Warning Should — 1 1 cases()
sbol3-14201 A.2.9 Warning Should — 1 1 cases()
sbol3-14202 A.2.9 Warning Should — 1 1 cases()

Totals: 109 machine-checkable rules, 140 negative cases, 121 positive cases.