Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mids scaling up/v4 #22

Open
wants to merge 45 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
f0b5254
Update README.md
alsavelv Dec 2, 2022
a45977e
Update Readme.md
alsavelv Dec 2, 2022
6239c93
Delete vnc1.png
alsavelv Dec 2, 2022
64eee7b
Delete vnc2.png
alsavelv Dec 2, 2022
66f7d92
Delete remmina2.png
alsavelv Dec 2, 2022
7dabaed
Delete configure_jetson.sh
alsavelv Dec 2, 2022
6b84ec8
Delete Xavier_NX_Install_SSD.mp4
alsavelv Dec 2, 2022
c62d980
Update Readme.md
alsavelv Dec 2, 2022
7bd6217
Update Readme.md
alsavelv Dec 2, 2022
61ee811
Update Readme.md
alsavelv Dec 2, 2022
796377f
Delete CreateUbuntuVMInVMware.mp4
alsavelv Dec 2, 2022
0f683e7
Add files via upload
alsavelv Dec 2, 2022
a85d0b0
Delete week01/lab directory
alsavelv Dec 2, 2022
433a09e
Update Readme.md
alsavelv Dec 2, 2022
618baf9
Update Readme.md
alsavelv Dec 2, 2022
f199ef6
Delete week03/demo directory
alsavelv Dec 2, 2022
63d5a09
Update README.md
alsavelv Dec 2, 2022
2a8b39a
Update README.md
alsavelv Dec 2, 2022
9a24fee
Update README.md
alsavelv Dec 2, 2022
a17cf7b
HW3 - new diagram
alsavelv Dec 2, 2022
46fb19a
Update README.md
alsavelv Dec 2, 2022
e396507
Add files via upload
alsavelv Dec 2, 2022
7ec061b
Update README.md
alsavelv Dec 2, 2022
fbec259
Update README.md
alsavelv Dec 2, 2022
dd30efd
Update README.md
alsavelv Dec 2, 2022
a7add15
Readings for week 3
alsavelv Dec 2, 2022
ca173ba
Moving some readings to week 2
alsavelv Dec 2, 2022
90ffb06
Update Readme.md
alsavelv Dec 2, 2022
f179d39
Update Readme.md
alsavelv Dec 2, 2022
cb246f8
Update README.md
alsavelv Dec 2, 2022
628602d
Update README.md
alsavelv Dec 2, 2022
4ae7540
Update README.md
alsavelv Dec 2, 2022
56ac379
Update README.md
alsavelv Dec 2, 2022
907b73d
Update README.md
alsavelv Dec 2, 2022
69d7e98
Update Readme.md
alsavelv Dec 11, 2022
3a32cb1
Update Readme.md
alsavelv Dec 11, 2022
4d8d9b1
Update Readme.md
alsavelv Dec 11, 2022
a7d5ffe
Update Readme.md
alsavelv Dec 11, 2022
73e0646
Update Readme.md
alsavelv Dec 11, 2022
e5cfbe5
Update README.md
alsavelv Dec 12, 2022
f676195
Delete week06/demo/gstreamer directory
alsavelv Dec 12, 2022
86ee772
Delete week06/demo/quantization/tf-trt directory
alsavelv Dec 12, 2022
2eae374
Update README.md
alsavelv Dec 12, 2022
408ddbc
Update README.md
alsavelv Dec 12, 2022
d5c9c94
Update Readme.md
alsavelv Dec 12, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified week01/Lecture_1.pptx
Binary file not shown.
17 changes: 5 additions & 12 deletions week01/README.md
Original file line number Diff line number Diff line change
@@ -1,21 +1,14 @@
# Lecture 1: Introduction to the class and Nvidia Jetson Device (Nano, Nano 4G or NX)
# Lecture 1: Introduction to the class and deep learning with transformers

Cloud computing. Big Data. Artificial intelligence. Deep learning frameworks and hardware. Datasets. Edge computing. Course project overview and sample.

It is very important that you have all the required equipment ready before the first sync session.

## Reading:
* Nvidia Jetpack
https://developer.nvidia.com/embedded/jetpack
* Nvidia Jetson family overview
https://www.nvidia.com/en-us/autonomous-machines/embedded-systems-dev-kits-modules/
* Jetson NX intro
https://developer.nvidia.com/embedded/jetson-xavier-nx-devkit
* Jetson Nano 2G User Guide
https://developer.nvidia.com/embedded/learn/jetson-nano-2gb-devkit-user-guide
* [Jetson Nano 4G User Guide](https://developer.nvidia.com/jetson-xavier-nx-developer-kit-user-guide)
* NGC Containers for Linux for Tegra (l4t)
https://catalog.ngc.nvidia.com/containers?filters=&orderBy=dateModifiedDESC&query=l4t
* Introduction: Hugging Face
https://huggingface.co/course/chapter0/1?fw=pt
* Transformer models
https://huggingface.co/course/chapter1/1?fw=pt
* Two days to a demo (skim through)
https://developer.nvidia.com/embedded/twodaystoademo
* Cloud 001: Introduction to SSH
Expand Down
Binary file removed week01/hw/CreateUbuntuVMInVMware.mp4
Binary file not shown.
482 changes: 18 additions & 464 deletions week01/hw/Readme.md

Large diffs are not rendered by default.

Binary file removed week01/hw/Xavier_NX_Install_SSD.mp4
Binary file not shown.
17 changes: 0 additions & 17 deletions week01/hw/configure_jetson.sh

This file was deleted.

Binary file removed week01/hw/remmina2.png
Binary file not shown.
Binary file removed week01/hw/vnc1.png
Binary file not shown.
Binary file removed week01/hw/vnc2.png
Binary file not shown.
33 changes: 0 additions & 33 deletions week01/lab/Dockerfile.yolov5

This file was deleted.

68 changes: 0 additions & 68 deletions week01/lab/Readme.md

This file was deleted.

23 changes: 22 additions & 1 deletion week02/Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ Introduction to Cloud Computing and Cloud AI—Defining the cloud. How clouds ar
* http://www.ibm.com/cloud-computing/us/en/what-is-cloud-computing.html
* https://azure.microsoft.com/en-us/overview/what-is-cloud-computing/
* https://cloud.google.com/learn/what-is-cloud-computing

* Types of clouds: https://www.globaldots.com/cloud-computing-types-of-cloud/
* Cloud service types: https://www.fingent.com/blog/cloud-service-models-saas-iaas-paas-choose-the-right-one-for-your-business

Expand All @@ -27,6 +26,28 @@ Introduction to Cloud Computing and Cloud AI—Defining the cloud. How clouds ar
* AWS API: https://docs.aws.amazon.com/
* AWS CLI: https://aws.amazon.com/cli/

### Virtual Machines
* https://www.ibm.com/cloud/learn/hypervisors
* https://www.stratoscale.com/blog/hyperconvergence/cloud-101-what-is-a-hypervisor/
* https://www.redhat.com/en/topics/virtualization/what-is-KVM


### Containers
* https://avatao.com/life-before-docker-and-beyond-a-brief-history-of-container-security/
* https://docs.docker.com/get-started/overview/
* https://mkdev.me/en/posts/the-tool-that-really-runs-your-containers-deep-dive-into-runc-and-oci-specifications
* https://www.docker.com/blog/what-is-containerd-runtime/


### Installing Docker
* https://docs.docker.com/get-docker/


### Kubernetes
* https://kubernetes.io/docs/concepts/
* https://kubernetes.io/docs/tutorials/kubernetes-basics/
* https://rancher.com/docs/k3s/latest/en/architecture/
* https://thenewstack.io/how-k3s-portworx-and-calico-can-serve-as-a-foundation-of-cloud-native-edge-infrastructure/

### Vision as a Service demo:
* https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/
Expand Down
26 changes: 3 additions & 23 deletions week02/hw/Readme.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# HW02: Docker, Cloud ML Services(Sagemaker) and Pricing
# HW02: Docker, Cloud ML Services (Sagemaker) and Pricing

*Complete Lab02 before starting HW02*

Expand Down Expand Up @@ -213,27 +213,7 @@ You can take an AMI image snapshot before terminating the instance.



# PART2 - NOTE: Sagemaker cannot be run on the free tier ~~Setup and run Sagemaker Example~~

~~This HW further builds on using public cloud services with a primer on AWS Sagemaker. Sagemaker is a fully managed Machine Learning Service enabling
to easily build, train and deploy ML models with an integrated Jupyter Notebook instance.~~

- ~~Readup details on Sagemaker. https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-preprocess-data.html~~

- ~~Create Sagemaker notebook instance. https://docs.aws.amazon.com/sagemaker/latest/dg/gs-console.html~~

- ~~Create a jupyter notebook and save it. https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-prepare.html~~

- ~~Run the end to end Example https://github.com/aws/amazon-sagemaker-examples/blob/master/sagemaker-python-sdk/1P_kmeans_highlevel/kmeans_mnist.ipynb
(This incl. downloading MNIST dataset to your account's default S3 Object storage)~~

- ~~Once complete, Login to your account and check the resources the example created~~

- ~~Cleanup the environment by deleting the deployed endpoint, Notebook instance and S3 to not incur AWS charges~~



# PART3 - Pricing
# PART2 - Pricing

#### Spot pricing

Expand Down Expand Up @@ -289,7 +269,7 @@ Please update the limit for VCPU on my account to be 32 VCPUs for the g4dn.2xlar



# PART4 - Turn in
# Turn in

### Submit text file on class portal homework submission page with answers to the following Questions

Expand Down
37 changes: 12 additions & 25 deletions week03/README.md
Original file line number Diff line number Diff line change
@@ -1,42 +1,29 @@
# Lecture 3
Virtual machines, containers, orchestration and Kubernetes, edge, and cloud native.
Object detection, COCO dataset, DETR model, ML pipelines, edge, and cloud native.

## Reading

### Virtual Machines
### Object detection

https://www.ibm.com/cloud/learn/hypervisors
https://huggingface.co/docs/api-inference/detailed_parameters#object-detection-task

https://www.stratoscale.com/blog/hyperconvergence/cloud-101-what-is-a-hypervisor/
https://cocodataset.org/#download

https://www.redhat.com/en/topics/virtualization/what-is-KVM
https://paperswithcode.com/task/object-detection

### DETR model

### Containers
https://huggingface.co/runwayml/stable-diffusion-v1-5

https://avatao.com/life-before-docker-and-beyond-a-brief-history-of-container-security/
https://huggingface.co/docs/transformers/model_doc/detr

https://docs.docker.com/get-started/overview/
https://arxiv.org/abs/2005.12872

https://mkdev.me/en/posts/the-tool-that-really-runs-your-containers-deep-dive-into-runc-and-oci-specifications
### Building ML pipelines

https://www.docker.com/blog/what-is-containerd-runtime/
https://aws.amazon.com/blogs/machine-learning/architect-and-build-the-full-machine-learning-lifecycle-with-amazon-sagemaker/


### Installing Docker

https://docs.docker.com/get-docker/


### Kubernetes

https://kubernetes.io/docs/concepts/

https://kubernetes.io/docs/tutorials/kubernetes-basics/

https://rancher.com/docs/k3s/latest/en/architecture/

https://thenewstack.io/how-k3s-portworx-and-calico-can-serve-as-a-foundation-of-cloud-native-edge-infrastructure/
https://azure.github.io/ACE_Azure_ML/slides/AML_service.pptx

### Miscellaneous

Expand Down
Loading