-
-
Notifications
You must be signed in to change notification settings - Fork 14
Added MLOps pipeline and new WordSegmenterCNN class #43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
• Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase • added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py • modified word_segmenter to save history plots and upload model to cloud storage if trained on vertex AI • added requirements.txt • added train.py for training on the cloud • fixed typo on README.md • added Cloud Usage.md to walkthrough setting up ML training pipeline
• Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase • added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py • modified word_segmenter to save history plots and upload model to cloud storage if trained on vertex AI • added requirements.txt • added train.py for training on the cloud • fixed typo on README.md • added Cloud Usage.md to walkthrough setting up ML training pipeline
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me. Thanks!
b40e657
to
fe40364
Compare
@sffc @SahandFarhoodi Hi Shane and Sahand, this is the new polished code of both MLOps pipeline and CNN model (word_segmenter_cnn.py). I've also included a sample CNN model in the Models directory if anyone is interested to test it. I could also remove it if its unnecessary for now. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you Shenghong for all this work. I left some comments here and there, but most of them are small nit comments.
• added Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase
• added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py
• modified word_segmenter.py to save history plots and upload model to cloud storage if trained on vertex AI
• added requirements.txt
• added train.py for training on the cloud
• fixed typo on README.md
• added Cloud Usage.md to walkthrough setting up ML training pipeline