appendix

Supplementary Materials

💡 Note: each folder has its own README with further details!

This folder contains:

• results: comprehensive metrics for all our experiments, stored as JSONLines files;
• predictions: model predictions for all our experiments, stored as JSONLines files;
• filters: the implementations of frequent filters from CMG research we used in our experiments.

Other details referenced in the paper

• The prompts for LLMs are available under appendix_llm tag in src/data_utils/cmg_prompts.py.
• The regular expressions we used for commit messages processing are available in another repo in src/processing/message_processor.py.
• Specific percentiles that we used to drop outliers from our dataset are available in dataset_percentiles.md.