ELI5 helps debug machine learning classifiers and explain their predictions. It includes:
ELI5 works in Python 2.7 and Python 3.4+ and can be install using pip:
pip install eli5
or using conda:
conda install -c conda-forge eli5
For more examples check out the ELI5 documentation.