-
-
Notifications
You must be signed in to change notification settings - Fork 13
Added MLOps pipeline and new WordSegmenterCNN class #43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
• Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase • added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py • modified word_segmenter to save history plots and upload model to cloud storage if trained on vertex AI • added requirements.txt • added train.py for training on the cloud • fixed typo on README.md • added Cloud Usage.md to walkthrough setting up ML training pipeline
• Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase • added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py • modified word_segmenter to save history plots and upload model to cloud storage if trained on vertex AI • added requirements.txt • added train.py for training on the cloud • fixed typo on README.md • added Cloud Usage.md to walkthrough setting up ML training pipeline
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me. Thanks!
b40e657 to
fe40364
Compare
|
@sffc @SahandFarhoodi Hi Shane and Sahand, this is the new polished code of both MLOps pipeline and CNN model (word_segmenter_cnn.py). I've also included a sample CNN model in the Models directory if anyone is interested to test it. I could also remove it if its unnecessary for now. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you Shenghong for all this work. I left some comments here and there, but most of them are small nit comments.
|
@sffc Hi Shane, may I ask if you could also help me review and merge the changes? Thank you |
• added Dockerfile and cloudbuild_yaml added to run cloud build scripts and containerize codebase
• added download_from_gcs, save_training_plot, upload_to_gcs in helpers.py
• modified word_segmenter.py to save history plots and upload model to cloud storage if trained on vertex AI
• added requirements.txt
• added train.py for training on the cloud
• fixed typo on README.md
• added Cloud Usage.md to walkthrough setting up ML training pipeline