Merge pull request #91 from MonashDeepNeuron/dev

Dev
MonashDeepNeuron · Apr 20, 2024 · 77317f3 · 77317f3
2 parents 12cffb7 + 0205b8d
commit 77317f3
Show file tree

Hide file tree

Showing 155 changed files with 478 additions and 176 deletions.
diff --git a/src/.chapter7/challenges.md b/src/.chapter7/challenges.md
diff --git a/src/SUMMARY.md b/src/SUMMARY.md
@@ -2,72 +2,75 @@
 
 [Welcome](home.md)
 
-- [Installation & Set-up](./chapter1/getting-started.md)
+- [Installation & Set-up](./getting-started/getting-started.md)
 
-  - [GitHub](./chapter1/github.md)
-  - [Windows](./chapter1/windows.md)
-  - [Mac](./chapter1/mac.md)
-  - [Linux](./chapter1/linux.md)
-  - [WSL](./chapter1/wsl.md)
-  - [M3 MASSIVE](./chapter1/m3.md)
-  - [Nectar Cloud](./chapter1/nectar.md)
-  - [Challenges](./chapter1/challenges.md)
+  - [GitHub](./getting-started/github.md)
+  - [Windows](./getting-started/windows.md)
+  - [Mac](./getting-started/mac.md)
+  - [Linux](./getting-started/linux.md)
+  - [WSL](./getting-started/wsl.md)
+  - [M3 MASSIVE](./getting-started/m3.md)
+  - [Nectar Cloud](./getting-started/nectar.md)
+  - [Challenges](./getting-started/challenges.md)
 
-- [Intro to C](./chapter2/intro-to-c.md)
+- [Intro to C](./intro-to-c/intro-to-c.md)
 
-  - [Hello World](./chapter2/helloworld.md)
-  - [Compilation](./chapter2/compilation.md)
-  - [Types & Variables](./chapter2/vars.md)
-  - [Printing](./chapter2/printing.md)
-  - [Input](./chapter2/input.md)
-  - [Arrays & Strings](./chapter2/array.md)
-  - [Control Flow](./chapter2/ctrl-flow.md)
-  - [Loops](./chapter2/loops.md)
-  - [Functions](./chapter2/functions.md)
-  - [Challenges](./chapter2/challenges.md)
+  - [Hello World](./intro-to-c/helloworld.md)
+  - [Compilation](./intro-to-c/compilation.md)
+  - [Types & Variables](./intro-to-c/vars.md)
+  - [Printing](./intro-to-c/printing.md)
+  - [Input](./intro-to-c/input.md)
+  - [Arrays & Strings](./intro-to-c/array.md)
+  - [Control Flow](./intro-to-c/ctrl-flow.md)
+  - [Loops](./intro-to-c/loops.md)
+  - [Functions](./intro-to-c/functions.md)
+  - [Challenges](./intro-to-c/challenges.md)
 
-- [Operating Systems](./chapter3/chapter3.md)
+- [Operating Systems](./operating-systems/operating-systems.md)
 
-  - [Computer Architecture](./chapter3/computer-architecture.md)
-  - [Pointers](./chapter3/memory-pointers.md)
-  - [Dynamic Memory](./chapter3/dynamic-memory.md)
-  - [Structures & Macros](./chapter3/structs-macros.md)
-  - [Intro to Linux](./chapter3/linux-intro.md)
-  - [VMs & Containers](./chapter3/vms-containers.md)
-  - [Challenges](./chapter3/challenges.md)
+  - [Computer Architecture](./operating-systems/computer-architecture.md)
+  - [Pointers](./operating-systems/memory-pointers.md)
+  - [Dynamic Memory](./operating-systems/dynamic-memory.md)
+  - [Structures & Macros](./operating-systems/structs-macros.md)
+  - [Intro to Linux](./operating-systems/linux-intro.md)
+  - [VMs & Containers](./operating-systems/vms-containers.md)
+  - [Bash CMDs & Scripts](./operating-systems/bash-cmds-scripts.md)
+  - [Processes & Threads](./operating-systems/processes-threads.md)
+  - [Scheduling Algorithms](./operating-systems/scheduling.md)
+  - [Challenges](./operating-systems/challenges.md)
 
-- [M3 & SLURM](./chapter4/chapter4.md)
+- [M3 & SLURM](./m3-slurm/m3-slurm.md)
 
-  - [Batch Processing vs. Cloud Computing](./chapter4/batch-cloud.md)
-  - [Parallel & Distributed Computing](./chapter4/parallel-distributed.md)
-  - [M3 Login - SSH & Strudel](./chapter4/login.md)
-  - [Intro to SLURM](./chapter4/slurm_intro.md)
-  - [M3 Interface & Usage](./chapter4/m3-interface.md)
-  - [Software & Tooling](./chapter4/software-tooling.md)
-  - [Challenges](./chapter4/challenges.md)
+  - [Batch Processing vs. Cloud Computing](./m3-slurm/batch-cloud.md)
+  - [Parallel & Distributed Computing](./m3-slurm/parallel-distributed.md)
+  - [M3 Login - SSH & Strudel](./m3-slurm/login.md)
+  - [Intro to SLURM](./m3-slurm/slurm_intro.md)
+  - [M3 Interface & Usage](./m3-slurm/m3-interface.md)
+  - [Software & Tooling](./m3-slurm/software-tooling.md)
+  - [Challenges](./m3-slurm/challenges.md)
 
-- [Introduction to Parallel Computing](./chapter5/chapter5.md)
+- [Intro to Parallel Computing](./intro-to-parallel-comp/intro-to-parallel-comp.md)
 
-  - [Multithreading](./chapter5/multithreading.md)
-  - [Synchronisation](./chapter5/synchronisation.md)
-  - [Locks](./chapter5/locks.md)
-  - [Message Passing](./chapter5/message-passing.md)
-  - [Challenges](./chapter5/challenges.md)
+  - [OpenMP: Multithreading](./intro-to-parallel-comp/multithreading.md)
+  - [Synchronisation Issues](./intro-to-parallel-comp/synchronisation.md)
+  - [Dead & Live Locks](./intro-to-parallel-comp/locks.md)
+  - [MPI: Message Passing](./intro-to-parallel-comp/message-passing.md)
+  - [Challenges](./intro-to-parallel-comp/challenges.md)
 
-- [Parallellisation of Algorithms](./chapter6/chapter6.md)
+- [Parallellisation of Algorithms](./parallel-algos/parallel-algos.md)
 
-  - [Parallel Search](./chapter6/parallel-search.md)
-  - [Parallel Sort](./chapter6/parallel-sort.md)
-  - [Other Parallel Algorithms](./chapter6/other-parallel-algos.md)
-  - [Machine Learning & HPC](./chapter6/machine-learning-and-hpc.md)
-  - [Optimisation Algorithms](./chapter6/optim-algos.md)
-  - [Challenges](./chapter6/challenges.md)
+  - [Parallel Search](./parallel-algos/parallel-search.md)
+  - [Parallel Sort](./parallel-algos/parallel-sort.md)
+  - [Other Parallel Algorithms](./parallel-algos/other-parallel-algos.md)
+  - [Machine Learning & HPC](./parallel-algos/machine-learning-and-hpc.md)
+  - [Optimisation Algorithms](./parallel-algos/optim-algos.md)
+  - [Challenges](./parallel-algos/challenges.md)
 
-- [Apache Spark](./chapter7/chapter7.md)
-  - [Installation & Cluster Set-up](./chapter7/set-up.md)
-  - [Internal Architecture](./chapter7/internals.md)
-  - [Data Processing](./chapter7/data-processing.md)
-  - [Job Batching](./chapter7/job-batching.md)
-  - [Challenges](./chapter7/challenges.md)
+- [Apache Spark](./apache-spark/apache-spark.md)
+  - [Installation & Cluster Set-up](./apache-spark/set-up.md)
+  - [Internal Architecture](./apache-spark/internals.md)
+  - [Data Processing](./apache-spark/data-processing.md)
+  - [Job Batching](./apache-spark/job-batching.md)
+  - [Challenges](./apache-spark/challenges.md)
 
 [Acknowledgements](./acknowledgements.md)
diff --git a/src/chapter7/chapter7.md → src/apache-spark/apache-spark.md b/src/chapter7/chapter7.md → src/apache-spark/apache-spark.md
diff --git a/src/chapter7/challenges.md → src/apache-spark/challenges.md b/src/chapter7/challenges.md → src/apache-spark/challenges.md
diff --git a/src/chapter7/data-processing.md → src/apache-spark/data-processing.md b/src/chapter7/data-processing.md → src/apache-spark/data-processing.md
diff --git a/src/chapter7/imgs/jupyterlab.png → src/apache-spark/imgs/jupyterlab.png b/src/chapter7/imgs/jupyterlab.png → src/apache-spark/imgs/jupyterlab.png
diff --git a/src/chapter7/imgs/spark-architecture.png → src/apache-spark/imgs/spark-architecture.png b/src/chapter7/imgs/spark-architecture.png → src/apache-spark/imgs/spark-architecture.png
diff --git a/src/chapter7/imgs/spark-cluster-overview.png → ...che-spark/imgs/spark-cluster-overview.png b/src/chapter7/imgs/spark-cluster-overview.png → ...che-spark/imgs/spark-cluster-overview.png
diff --git a/src/chapter7/imgs/spark-sql.png → src/apache-spark/imgs/spark-sql.png b/src/chapter7/imgs/spark-sql.png → src/apache-spark/imgs/spark-sql.png
diff --git a/src/chapter7/internals.md → src/apache-spark/internals.md b/src/chapter7/internals.md → src/apache-spark/internals.md
diff --git a/src/chapter7/job-batching.md → src/apache-spark/job-batching.md b/src/chapter7/job-batching.md → src/apache-spark/job-batching.md
diff --git a/src/chapter7/set-up.md → src/apache-spark/set-up.md b/src/chapter7/set-up.md → src/apache-spark/set-up.md
diff --git a/src/chapter3/processes.md b/src/chapter3/processes.md
diff --git a/src/chapter3/scheduling.md b/src/chapter3/scheduling.md
diff --git a/src/chapter3/threads-concurrency.md b/src/chapter3/threads-concurrency.md
diff --git a/src/chapter3/vms-containers.md b/src/chapter3/vms-containers.md
diff --git a/src/chapter4/job-scripting.md b/src/chapter4/job-scripting.md
diff --git a/src/chapter1/aaf.png → src/getting-started/aaf.png b/src/chapter1/aaf.png → src/getting-started/aaf.png
diff --git a/src/chapter1/challenges.md → src/getting-started/challenges.md b/src/chapter1/challenges.md → src/getting-started/challenges.md
diff --git a/src/chapter1/getting-started.md → src/getting-started/getting-started.md b/src/chapter1/getting-started.md → src/getting-started/getting-started.md
diff --git a/src/chapter1/github.md → src/getting-started/github.md b/src/chapter1/github.md → src/getting-started/github.md
diff --git a/src/chapter1/hpcid.png → src/getting-started/hpcid.png b/src/chapter1/hpcid.png → src/getting-started/hpcid.png
diff --git a/src/chapter1/join_project.png → src/getting-started/join_project.png b/src/chapter1/join_project.png → src/getting-started/join_project.png
diff --git a/src/chapter1/linux.md → src/getting-started/linux.md b/src/chapter1/linux.md → src/getting-started/linux.md
diff --git a/src/chapter1/m3.md → src/getting-started/m3.md b/src/chapter1/m3.md → src/getting-started/m3.md
diff --git a/src/chapter1/mac.md → src/getting-started/mac.md b/src/chapter1/mac.md → src/getting-started/mac.md
diff --git a/src/chapter1/nectar-login.png → src/getting-started/nectar-login.png b/src/chapter1/nectar-login.png → src/getting-started/nectar-login.png
diff --git a/src/chapter1/nectar.md → src/getting-started/nectar.md b/src/chapter1/nectar.md → src/getting-started/nectar.md
diff --git a/src/chapter1/taskmanager.png → src/getting-started/taskmanager.png b/src/chapter1/taskmanager.png → src/getting-started/taskmanager.png
diff --git a/src/chapter1/windows.md → src/getting-started/windows.md b/src/chapter1/windows.md → src/getting-started/windows.md
diff --git a/src/chapter1/wsl.md → src/getting-started/wsl.md b/src/chapter1/wsl.md → src/getting-started/wsl.md
diff --git a/src/chapter2/array.md → src/intro-to-c/array.md b/src/chapter2/array.md → src/intro-to-c/array.md
diff --git a/src/chapter2/challenges.md → src/intro-to-c/challenges.md b/src/chapter2/challenges.md → src/intro-to-c/challenges.md
diff --git a/src/chapter2/compilation.md → src/intro-to-c/compilation.md b/src/chapter2/compilation.md → src/intro-to-c/compilation.md
diff --git a/src/chapter2/ctrl-flow.md → src/intro-to-c/ctrl-flow.md b/src/chapter2/ctrl-flow.md → src/intro-to-c/ctrl-flow.md
diff --git a/src/chapter2/functions.md → src/intro-to-c/functions.md b/src/chapter2/functions.md → src/intro-to-c/functions.md
diff --git a/src/chapter2/helloworld.md → src/intro-to-c/helloworld.md b/src/chapter2/helloworld.md → src/intro-to-c/helloworld.md
diff --git a/src/chapter2/imgs/lang-family-tree-light.png → ...ntro-to-c/imgs/lang-family-tree-light.png b/src/chapter2/imgs/lang-family-tree-light.png → ...ntro-to-c/imgs/lang-family-tree-light.png
diff --git a/src/chapter2/imgs/lang-family-tree.png → src/intro-to-c/imgs/lang-family-tree.png b/src/chapter2/imgs/lang-family-tree.png → src/intro-to-c/imgs/lang-family-tree.png
diff --git a/src/chapter2/input.md → src/intro-to-c/input.md b/src/chapter2/input.md → src/intro-to-c/input.md
diff --git a/src/chapter2/intro-to-c.md → src/intro-to-c/intro-to-c.md b/src/chapter2/intro-to-c.md → src/intro-to-c/intro-to-c.md
diff --git a/src/chapter2/loops.md → src/intro-to-c/loops.md b/src/chapter2/loops.md → src/intro-to-c/loops.md
diff --git a/src/chapter2/printing.md → src/intro-to-c/printing.md b/src/chapter2/printing.md → src/intro-to-c/printing.md
diff --git a/src/chapter2/structs.md → src/intro-to-c/structs.md b/src/chapter2/structs.md → src/intro-to-c/structs.md
diff --git a/src/chapter2/vars.md → src/intro-to-c/vars.md b/src/chapter2/vars.md → src/intro-to-c/vars.md
diff --git a/src/chapter5/challenges.md → src/intro-to-parallel-comp/challenges.md b/src/chapter5/challenges.md → src/intro-to-parallel-comp/challenges.md
diff --git a/src/chapter5/imgs/barrier-end.png → ...tro-to-parallel-comp/imgs/barrier-end.png b/src/chapter5/imgs/barrier-end.png → ...tro-to-parallel-comp/imgs/barrier-end.png
diff --git a/src/chapter5/imgs/barrier-wait.png → ...ro-to-parallel-comp/imgs/barrier-wait.png b/src/chapter5/imgs/barrier-wait.png → ...ro-to-parallel-comp/imgs/barrier-wait.png
diff --git a/src/chapter5/imgs/barrier.png → src/intro-to-parallel-comp/imgs/barrier.png b/src/chapter5/imgs/barrier.png → src/intro-to-parallel-comp/imgs/barrier.png
diff --git a/src/chapter5/imgs/deadlock.png → src/intro-to-parallel-comp/imgs/deadlock.png b/src/chapter5/imgs/deadlock.png → src/intro-to-parallel-comp/imgs/deadlock.png
diff --git a/src/chapter5/imgs/explicit-barrier.png → ...o-parallel-comp/imgs/explicit-barrier.png b/src/chapter5/imgs/explicit-barrier.png → ...o-parallel-comp/imgs/explicit-barrier.png
diff --git a/src/chapter5/imgs/fork-join.png → ...intro-to-parallel-comp/imgs/fork-join.png b/src/chapter5/imgs/fork-join.png → ...intro-to-parallel-comp/imgs/fork-join.png
diff --git a/src/chapter5/imgs/htop.png → src/intro-to-parallel-comp/imgs/htop.png b/src/chapter5/imgs/htop.png → src/intro-to-parallel-comp/imgs/htop.png
diff --git a/src/chapter5/imgs/mpi-routines.png → ...ro-to-parallel-comp/imgs/mpi-routines.png b/src/chapter5/imgs/mpi-routines.png → ...ro-to-parallel-comp/imgs/mpi-routines.png
diff --git a/src/chapter5/imgs/one-thread-counter.png → ...parallel-comp/imgs/one-thread-counter.png b/src/chapter5/imgs/one-thread-counter.png → ...parallel-comp/imgs/one-thread-counter.png
diff --git a/src/chapter5/imgs/program-structure.png → ...-parallel-comp/imgs/program-structure.png b/src/chapter5/imgs/program-structure.png → ...-parallel-comp/imgs/program-structure.png
diff --git a/src/chapter5/imgs/time.png → src/intro-to-parallel-comp/imgs/time.png b/src/chapter5/imgs/time.png → src/intro-to-parallel-comp/imgs/time.png
diff --git a/src/chapter5/imgs/two-threads-counter.png → ...arallel-comp/imgs/two-threads-counter.png b/src/chapter5/imgs/two-threads-counter.png → ...arallel-comp/imgs/two-threads-counter.png
diff --git a/src/chapter5/chapter5.md → ...o-parallel-comp/intro-to-parallel-comp.md b/src/chapter5/chapter5.md → ...o-parallel-comp/intro-to-parallel-comp.md
diff --git a/src/chapter5/locks.md → src/intro-to-parallel-comp/locks.md b/src/chapter5/locks.md → src/intro-to-parallel-comp/locks.md
diff --git a/src/chapter5/message-passing.md → ...intro-to-parallel-comp/message-passing.md b/src/chapter5/message-passing.md → ...intro-to-parallel-comp/message-passing.md
diff --git a/src/chapter5/multithreading.md → src/intro-to-parallel-comp/multithreading.md b/src/chapter5/multithreading.md → src/intro-to-parallel-comp/multithreading.md
diff --git a/src/chapter5/synchronisation.md → ...intro-to-parallel-comp/synchronisation.md b/src/chapter5/synchronisation.md → ...intro-to-parallel-comp/synchronisation.md
diff --git a/src/chapter4/batch-cloud.md → src/m3-slurm/batch-cloud.md b/src/chapter4/batch-cloud.md → src/m3-slurm/batch-cloud.md
diff --git a/src/chapter4/challenges.md → src/m3-slurm/challenges.md b/src/chapter4/challenges.md → src/m3-slurm/challenges.md
diff --git a/src/chapter4/imgs/aaf.png → src/m3-slurm/imgs/aaf.png b/src/chapter4/imgs/aaf.png → src/m3-slurm/imgs/aaf.png
diff --git a/src/chapter4/imgs/aaf_strudel.png → src/m3-slurm/imgs/aaf_strudel.png b/src/chapter4/imgs/aaf_strudel.png → src/m3-slurm/imgs/aaf_strudel.png
diff --git a/src/chapter4/imgs/auth_strudel.png → src/m3-slurm/imgs/auth_strudel.png b/src/chapter4/imgs/auth_strudel.png → src/m3-slurm/imgs/auth_strudel.png
diff --git a/src/chapter4/imgs/batch-processing.jpeg → src/m3-slurm/imgs/batch-processing.jpeg b/src/chapter4/imgs/batch-processing.jpeg → src/m3-slurm/imgs/batch-processing.jpeg
diff --git a/src/chapter4/imgs/data_parallelism.jpg → src/m3-slurm/imgs/data_parallelism.jpg b/src/chapter4/imgs/data_parallelism.jpg → src/m3-slurm/imgs/data_parallelism.jpg
diff --git a/.../imgs/distributed_memory_architecture.png → .../imgs/distributed_memory_architecture.png b/.../imgs/distributed_memory_architecture.png → .../imgs/distributed_memory_architecture.png
diff --git a/...mgs/distributed_memory_architecture_2.png → ...mgs/distributed_memory_architecture_2.png b/...mgs/distributed_memory_architecture_2.png → ...mgs/distributed_memory_architecture_2.png
diff --git a/src/chapter4/imgs/distributed_vs_shared.png → src/m3-slurm/imgs/distributed_vs_shared.png b/src/chapter4/imgs/distributed_vs_shared.png → src/m3-slurm/imgs/distributed_vs_shared.png
diff --git a/src/chapter4/imgs/filezilla_connect_m3.png → src/m3-slurm/imgs/filezilla_connect_m3.png b/src/chapter4/imgs/filezilla_connect_m3.png → src/m3-slurm/imgs/filezilla_connect_m3.png
diff --git a/src/chapter4/imgs/filezilla_sitemanager.png → src/m3-slurm/imgs/filezilla_sitemanager.png b/src/chapter4/imgs/filezilla_sitemanager.png → src/m3-slurm/imgs/filezilla_sitemanager.png
diff --git a/src/chapter4/imgs/gurobi.png → src/m3-slurm/imgs/gurobi.png b/src/chapter4/imgs/gurobi.png → src/m3-slurm/imgs/gurobi.png
diff --git a/src/chapter4/imgs/gurobi2.png → src/m3-slurm/imgs/gurobi2.png b/src/chapter4/imgs/gurobi2.png → src/m3-slurm/imgs/gurobi2.png
diff --git a/src/chapter4/imgs/htop.png → src/m3-slurm/imgs/htop.png b/src/chapter4/imgs/htop.png → src/m3-slurm/imgs/htop.png
diff --git a/src/chapter4/imgs/interactive-processing.png → src/m3-slurm/imgs/interactive-processing.png b/src/chapter4/imgs/interactive-processing.png → src/m3-slurm/imgs/interactive-processing.png
diff --git a/src/chapter4/imgs/login-compute-nodes.jpeg → src/m3-slurm/imgs/login-compute-nodes.jpeg b/src/chapter4/imgs/login-compute-nodes.jpeg → src/m3-slurm/imgs/login-compute-nodes.jpeg
diff --git a/src/chapter4/imgs/memory_architectures.jpg → src/m3-slurm/imgs/memory_architectures.jpg b/src/chapter4/imgs/memory_architectures.jpg → src/m3-slurm/imgs/memory_architectures.jpg
diff --git a/src/chapter4/imgs/mpi_datatypes.png → src/m3-slurm/imgs/mpi_datatypes.png b/src/chapter4/imgs/mpi_datatypes.png → src/m3-slurm/imgs/mpi_datatypes.png
diff --git a/src/chapter4/imgs/mpi_routines.png → src/m3-slurm/imgs/mpi_routines.png b/src/chapter4/imgs/mpi_routines.png → src/m3-slurm/imgs/mpi_routines.png
diff --git a/src/chapter4/imgs/parallel-distributed.png → src/m3-slurm/imgs/parallel-distributed.png b/src/chapter4/imgs/parallel-distributed.png → src/m3-slurm/imgs/parallel-distributed.png
diff --git a/...er4/imgs/parallel_computing_arrays_eg.png → ...urm/imgs/parallel_computing_arrays_eg.png b/...er4/imgs/parallel_computing_arrays_eg.png → ...urm/imgs/parallel_computing_arrays_eg.png
diff --git a/src/chapter4/imgs/parallel_scalability.jpg → src/m3-slurm/imgs/parallel_scalability.jpg b/src/chapter4/imgs/parallel_scalability.jpg → src/m3-slurm/imgs/parallel_scalability.jpg
diff --git a/src/chapter4/imgs/ping_pong.png → src/m3-slurm/imgs/ping_pong.png b/src/chapter4/imgs/ping_pong.png → src/m3-slurm/imgs/ping_pong.png
diff --git a/src/chapter4/imgs/putty_key_not_cached.png → src/m3-slurm/imgs/putty_key_not_cached.png b/src/chapter4/imgs/putty_key_not_cached.png → src/m3-slurm/imgs/putty_key_not_cached.png
diff --git a/src/chapter4/imgs/putty_start.png → src/m3-slurm/imgs/putty_start.png b/src/chapter4/imgs/putty_start.png → src/m3-slurm/imgs/putty_start.png
diff --git a/src/chapter4/imgs/scale-out-up.png → src/m3-slurm/imgs/scale-out-up.png b/src/chapter4/imgs/scale-out-up.png → src/m3-slurm/imgs/scale-out-up.png
diff --git a/src/chapter4/imgs/slurm-arch.gif → src/m3-slurm/imgs/slurm-arch.gif b/src/chapter4/imgs/slurm-arch.gif → src/m3-slurm/imgs/slurm-arch.gif
diff --git a/src/m3-slurm/imgs/slurm-on-m3.png b/src/m3-slurm/imgs/slurm-on-m3.png
diff --git a/src/chapter4/imgs/strudel1.png → src/m3-slurm/imgs/strudel1.png b/src/chapter4/imgs/strudel1.png → src/m3-slurm/imgs/strudel1.png
diff --git a/src/chapter4/imgs/strudel2.png → src/m3-slurm/imgs/strudel2.png b/src/chapter4/imgs/strudel2.png → src/m3-slurm/imgs/strudel2.png
diff --git a/src/chapter4/imgs/strudel_home.png → src/m3-slurm/imgs/strudel_home.png b/src/chapter4/imgs/strudel_home.png → src/m3-slurm/imgs/strudel_home.png
diff --git a/src/chapter4/imgs/task_parallelism.jpg → src/m3-slurm/imgs/task_parallelism.jpg b/src/chapter4/imgs/task_parallelism.jpg → src/m3-slurm/imgs/task_parallelism.jpg
diff --git a/src/chapter4/imgs/time.png → src/m3-slurm/imgs/time.png b/src/chapter4/imgs/time.png → src/m3-slurm/imgs/time.png
diff --git a/src/chapter4/login.md → src/m3-slurm/login.md b/src/chapter4/login.md → src/m3-slurm/login.md
diff --git a/src/chapter4/m3-interface.md → src/m3-slurm/m3-interface.md b/src/chapter4/m3-interface.md → src/m3-slurm/m3-interface.md
diff --git a/src/chapter4/chapter4.md → src/m3-slurm/m3-slurm.md b/src/chapter4/chapter4.md → src/m3-slurm/m3-slurm.md
diff --git a/src/chapter4/parallel-distributed.md → src/m3-slurm/parallel-distributed.md b/src/chapter4/parallel-distributed.md → src/m3-slurm/parallel-distributed.md
@@ -6,7 +6,7 @@ Nearly all modern computer systems utilise parallel computing to speed up the ex
 
 As you can see, in a scenario where a program (job) takes 3 seconds and 3 independent jobs have to be executed by a system, doing it serially in a single computer takes a total of 9 seconds. But doing it simultaneously across 3 computers will only take 3 seconds thus achieving a 3x speedup through parallel computing. 
 
-This is the fundamental principle that High Performance Computing is based on.
+This is the fundamental principle that High Performance Computing is based on. The trouble (or fun) is when your tasks have dependencies on each other which is gonna be the case for the vast majority of algorithms. That's when things like synchronisation issues, data sharing and all of that comes into play - which we'll explore in later chapters.
 
 ## What is Distributed Computing? 
 
@@ -52,4 +52,19 @@ And finally, not everything needs to be done on a parallel or distributed system
 ### Advantages of serial computing:
 - **More simple** to design & implement algorithms. Parallel algorithms can get quite complex, especially when dealing with more complicated instructions with dependencies.
 - **Less overhead** involved in managing a parallel & distributed job. No need to manage data sharing between threads, processes, nodes, etc...
-- **No synchronisation issues** & headaches involved in concurrent computing. Don't have to deal with race conditions, deadlocks, livelocks, etc...
+- **No synchronisation issues** & headaches involved in concurrent computing. Don't have to deal with race conditions, deadlocks, livelocks, etc...
+
+## Parallel Scalability
+The speed up achieved from parallelism is dictated by your algorithm. Notably the serial parts of your algorithm can not be sped up by increasing the number of processors. The diagram below looks at the benefits we can achieve from writing parallel code as the number of processes increases.
+
+![amdahl](./imgs/parallel_scalability.jpg)
+
+Amdahl's Law, formulated by computer architect Gene Amdahl in 1967, is a principle used to analyze the potential speedup of parallel computing. It states that the speedup of a program from parallelization is limited by the proportion of the program that must be executed serially. In other words, it helps to determine the maximum performance improvement that can be achieved by using parallel processing.
+
+The implications of Amdahl's Law for HPC is very significant:
+
+- **Limitation of Speedup:** Amdahl's Law highlights that even with an increase in the number of processors (parallelization), the overall speedup is limited by the sequential portion of the code. Thus, if a significant portion of the code is inherently serial, the potential speedup achievable through parallelization is restricted.
+- **Importance of Identifying Serial Sections:** In HPC, it's crucial to identify the sections of code that are inherently serial and cannot be parallelized. Optimizing these sections can lead to better overall performance. Conversely, focusing solely on parallelizing code without addressing these serial bottlenecks can result in suboptimal speedup.
+- **Efficiency vs. Scalability:** Amdahl's Law emphasizes the importance of balancing efficiency and scalability in parallel computing. While increasing the number of processors can improve performance to a certain extent, beyond a certain point, diminishing returns occur due to the overhead of synchronization, communication, and managing parallel tasks.
+- **Architectural Considerations:** HPC system architects must consider Amdahl's Law when designing hardware and software architectures. Designing systems that minimize the impact of serial portions of code and optimize parallel execution can lead to better overall performance.
+- **Algorithm Selection:** When choosing algorithms for HPC applications, it's essential to consider their parallelizability. Algorithms that can be efficiently parallelized are more suitable for HPC environments, as they can leverage the potential for speedup provided by parallel computing resources more effectively.