Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: sgm-gharchive - updates and fixes for generating parquet from gharchive records + KubeCon SLC Demo #127

Closed
wants to merge 4 commits into from

Conversation

halcyondude
Copy link
Collaborator

No description provided.

Also add windows support as this runs well on a Threadripper.
- Remove stdout/stderr redirection from batch file to preserve tqdm progress bars
- Add proper logging configuration with both file and console output
- Configure icecream debug output to use logging system
- Replace print statements with logging.info() calls
- Add RotatingFileHandler to prevent large log files
- Maintain both console visibility and log file recording

The changes allow real-time progress visibility while still capturing all output
in log files. tqdm progress bars now display correctly in the console while
maintaining a clean log file format.
@halcyondude halcyondude self-assigned this Dec 6, 2024
@halcyondude halcyondude added enhancement New feature or request sgm Sub-Graph Module (sgm) labels Dec 6, 2024
@halcyondude halcyondude closed this Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request sgm Sub-Graph Module (sgm)
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

1 participant