Test suite is failing, but ignored on CI

[sternenseemann]

I'm a bit confused about how the test suite is supposed to work. It seems like it is executed, but the return value from fiveam is never checked. Currently 6 tests fail in the test suite on CI, but the script exits with 0:

 Did 166 checks.
    Pass: 160 (96%)
    Skip: 0 ( 0%)
    Fail: 6 ( 3%)

 Failure Details:
 --------------------------------
 JSON-BIND-IN-BIND-BUG in JSON []: 
      
RESULT2

 evaluated to 

"(0 ((ID . pingId) (NAME . ping)) NIL
            (((NAME . tableTennisGroupName) (ID . tableTennisGroupId))))"

 which is not 

STRING=

 to 

"(0 NIL NIL (NIL))"


 --------------------------------
 --------------------------------
 TEST-ENCODE-JSON-CLOS-MAX-PACKAGE in JSON []: 
      Unexpected Error: #<SB-INT:SIMPLE-REFERENCE-ERROR "~S called on ~S, which is not yet finalized." {1002A61933}>
SB-MOP:CLASS-SLOTS called on #<FLUID-CLASS JSON:FLUID-OBJECT>, which is not yet finalized.
See also:
  AMOP, Generic Function SB-MOP:CLASS-SLOTS.
 --------------------------------
 --------------------------------
 TEST-ENCODE-JSON-CLOS in JSON []: 
      Unexpected Error: #<SB-INT:SIMPLE-REFERENCE-ERROR "~S called on ~S, which is not yet finalized." {10029B0EE3}>
SB-MOP:CLASS-SLOTS called on #<FLUID-CLASS JSON:FLUID-OBJECT>, which is not yet finalized.
See also:
  AMOP, Generic Function SB-MOP:CLASS-SLOTS.
 --------------------------------
 --------------------------------
 TEST*JSON-SYMBOLS-PACKAGE* in JSON []: 
      Unexpected Error: #<SB-INT:SIMPLE-REFERENCE-ERROR "~S called on ~S, which is not yet finalized." {1002997263}>
SB-MOP:CLASS-SLOTS called on #<FLUID-CLASS JSON:FLUID-OBJECT>, which is not yet finalized.
See also:
  AMOP, Generic Function SB-MOP:CLASS-SLOTS.
 --------------------------------
 --------------------------------
 JSON-OBJECT-WITH-PROTOTYPE in JSON []: 
      Unexpected Error: #<SB-INT:SIMPLE-REFERENCE-ERROR "~S called on ~S, which is not yet finalized." {1003F6DB13}>
SB-MOP:CLASS-SLOTS called on #<FLUID-CLASS JSON:FLUID-OBJECT>, which is not yet finalized.
See also:
  AMOP, Generic Function SB-MOP:CLASS-SLOTS.
 --------------------------------
 --------------------------------
 JSON-OBJECT in JSON []: 
      Unexpected Error: #<SB-INT:SIMPLE-REFERENCE-ERROR "~S called on ~S, which is not yet finalized." {1003D7E093}>
SB-MOP:CLASS-SLOTS called on #<FLUID-CLASS JSON:FLUID-OBJECT>, which is not yet finalized.
See also:
  AMOP, Generic Function SB-MOP:CLASS-SLOTS.
 --------------------------------

; 
; compilation unit finished
;   caught 6 STYLE-WARNING conditions
Script succeeded

See e.g. the latest run.

[cage2]

Hi!

FWIW i got the same error in some code i have written that uses the CLOS decoder of cl-json

Bye!
C.