Skip to content

Jupyter Notebook Magics for Google Cloud ML Engine

License

Notifications You must be signed in to change notification settings

gprieto/cloudml-magic

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cloudml-magic

cloudml-magic is a Jupyter Notebook Magics for interactively working with Google Cloud Machine Learning Engine. Your Tensorflow or Keras code on Notebook will run on ML Engine, just by running cells.

diagram

Prerequisites

Before you begin, prepare Google Cloud Platform project, enable billing and install Google Cloud SDK.

Also this magics use Application Default Credentials. To activate the credentials, enter

gcloud auth application-default login

Installation

To install this magics

pip install cloudmlmagic

To use this magics, enter the following command in your notebook.

in [1]: %load_ext cloudmlmagic

That's it!

How to use

%ml_init

This magic initializes your cloud ml job request. Do NOT forget to initialize before adding code or run.

Example:

in [2]: %ml_init -projectId PROJECTID -bucket BUCKET -region us-central1 -scaleTier BASIC -runtimeVersion 1.2

Install external libraries

If you want to run codes with external libraries like Keras, h5py, add following dict below the %ml_init magic.

{'install_requires': ['keras', 'h5py', 'Pillow']}

%ml_code

This magic adds the block into uploading package.

%ml_run

To run a training job, add this magic on your code block.

Run on local Machine
Do not add this magic, or add %ml_run

Run on Cloud ML Engine
add %ml_run cloud

About

Jupyter Notebook Magics for Google Cloud ML Engine

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%