After some local testing, I can't find anything obviously wrong. Unfortunately, I think it has to do with the ECON doing several compile/decompile cycles and that is harder to audit.
Swapping std::map for std::unordered_map does not meaningfully change the time it takes to compile the defaults parameter map.