Implement debug mode and improve context and metadata collection #14
Open
Yahiewi wants to merge 2 commits into
Open
Implement debug mode and improve context and metadata collection #14Yahiewi wants to merge 2 commits into
Yahiewi wants to merge 2 commits into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR brings 3 majors changes:
-Context collection now works as agreed, by traversing backwards from the code cell to the nearest markdown cell and gathering it and all intermediate cells.
-Added a debug mode which logs the prompts and answers under /tmp/jupyter-ai-tutor. This can be activated by running
jupyter lab --JupyterAITutorApp.debug=True.-Implemented ROT13 decoding for the reference_solution found in the cell's metadata, as well as formatting for the evaluation criteria from the metadata into more readable prose for the LLM.
-Added metadata examples for the
matplotlib_exercices.ipynbexample to test these changes.-The payload sent to the LLM now follows this structure:
Screencast.from.2026-07-03.14-14-52.mp4
In this screencast, we inspect the two test files so we can see what exactly was the prompt sent to the LLM and the answer it generated.