syllabus.tex

\documentclass{article}

\usepackage{PRIMEarxiv}     % From the template
\usepackage[table,xcdraw]{xcolor} % From Tables Generator
\usepackage[normalem]{ulem} % From Tables Generator
\useunder{\uline}{\ul}{}    % From Tables Generator
\usepackage[utf8]{inputenc} % allow utf-8 input
\usepackage[T1]{fontenc}    % use 8-bit T1 fonts
\usepackage{hyperref}       % hyperlinks
\usepackage{url}            % simple URL typesetting
\usepackage{booktabs}       % professional-quality tables
\usepackage{amsfonts}       % blackboard math symbols
\usepackage{nicefrac}       % compact symbols for 1/2, etc.
\usepackage{microtype}      % microtypography
\usepackage{lipsum}
\usepackage{fancyhdr}       % header
\usepackage{graphicx}       % graphics
\graphicspath{{media/}}     % organize your images and other figures under media/ folder

%Header
\pagestyle{fancy}
\thispagestyle{empty}
\rhead{ \textit{ }} 

% Update your Headers here
\fancyhead[LO]{Lindahl, Nels. Introduction to machine learning syllabus 2022 }
% \fancyhead[RE]{Firstauthor and Secondauthor} % Firstauthor et al. if more than 2 - must use \documentclass[twoside]{article}



  
%% Title
\title{An independent study based introduction to machine learning syllabus for 2022
%%%% Cite as
%%%% Update your official citation here when published 
\thanks{\textit{\underline{Citation}}: 
\textbf{Authors. Title. Pages.... DOI:000000/11111.}} 
}

\author{
  Lindahl, Nels \\
  Unaffiliated Researcher \\
  Denver, Colorado\\
   \texttt{nelsl@nelslindahl.com} \\
}


\begin{document}
\maketitle


\begin{abstract}
Machine learning as a field of academic study and inquiry happens to be highly active with people publishing a tremendous amount of content at the moment. It has also graced the public mind in general with increasing popular culture references and news reporting on scientific breakthroughs. The amount of content being generated is beyond any one person to be able to categorize and consume. To help with that situation this introduction to machine learning syllabus contains an 8 part self guided journey to set a foundation for you to begin to wade into the field of machine learning. This is an independent study based syllabus that is written without any requirement for understanding code or complex mathematics. Each section helps provide a guided subject walk with specific scholarly papers to provide depth. Working through this syllabus from start to finish would involve reading approximately 100 scholarly papers and books. That is a strong foundation to understanding machine learning from the perspective of a lot of different authors, thinkers, and skeptics.     
\end{abstract}


% keywords can be removed
\keywords{Machine Learning \and Syllabus \and Bayesian optimization \and ML Algorithms \and Machine learning approaches \and Neural networks \and Neuroscience \and ML ethics \and MLOps \and Reinforcement learning \and Supervised learning \and Unsupervised learning \and Semi-supervised learning \and ML fairness \and ML bias}


\section{Introduction}
You might remember the Substack post from week 57 titled, “How would I compose an ML syllabus?” We have now reached the point in the program where you are going to receive 8 straight Substack posts that would combine together to compose what I would provide somebody as an introduction to machine learning syllabus. We are going to begin to address the breadth and depth of the field of machine learning. Please do consider that machine learning is widely considered just a small slice of the totality of artificial intelligence research. As a spoken analogy, you could say that machine learning is just one slice of bread in the loaf that is artificial intelligence. I did seriously entertain the idea of organizing the previous 79 posts into a syllabus based format for maximum delivery efficiency. That idea gave way quickly as it would be visually and topically overwhelming and that is the opposite of how this content needs to be presented. Let’s take this in the direction it was originally intended to take. To that end, let’s consider the framework that back during the week 57 writing process I thought was important. My very high level introduction to the creation of a machine learning syllabus from back in week 57 on February 25, 2022, would center on 8 core topics:

\begin{itemize}
\item Week 80: Bayesian optimization (ML syllabus edition 1/8)
\item Week 81: A machine learning literature review (ML syllabus edition 2/8)
\item Week 82: ML algorithms (ML syllabus edition 3/8)
\item Week 83: Machine learning Approaches (ML syllabus edition 4/8)
\item Week 84: Neural networks (ML syllabus edition 5/8)
\item Week 85: Neuroscience (ML syllabus edition 6/8)
\item Week 86: Ethics, fairness, bias, and privacy (ML syllabus edition 7/8)
\item Week 87: My MLOps lecture (ML syllabus edition 8/8)
\end{itemize}

That is what we are going to cover. At the end of the process, I’ll have a first glance at an introduction to machine learning syllabus. My efforts are annotated and include some narrative compared to a pure outline based syllabus. Bringing content together that is foundational is an important part about building this collection. At this point, just describing the edge of where things are in the field of machine learning would create something that would only be current for a moment and would fade away as the technology frontier curve advances. Instead of going that route it will be better to build a strong foundation for people to consume that will support the groundwork necessary to move from introductory to advanced machine learning. Yes, you might have caught from that last sentence that at some point I’ll need to write the next syllabus as a companion to this one. Stay tuned for a future advanced machine learning syllabus to go along with this introductory to machine learning edition. Enough overview has now occurred. It’s time to get started…

\section{Week 80: Bayesian optimization}
I remember digging into Armstrong’s “Principles of forecasting” book which was published back in 2001 \cite{armstrong2001principles}. You can get a paper copy or find it online for a lot less than the \$429 dollars Springer wants for the eBook. I thought the price was a typo at first, but I don’t think it actually is a typo. It’s just another example of how publishers are confused about how much academic work should cost for students to be able to read. Within that weighty tome of knowledge you can find coverage of the concept of Bayesian pooling which people have used for, “Forecasting analogous time series.” That bit of mathematics is always where my thoughts wander when considering Bayesian optimization. I have spent a lot of time researching machine learning and I really do believe most of the statistical foundations you would need to understand the field could be found in the book, “Principles of forecasting: A handbook for researchers and practitioners.” 

I do not think you should pay \$429 dollars for it, but it is a wonderful book. Keep in mind that the book does not mention machine learning at all. It is from 2001 and does not really consider how forecasting tools would be extended within the field of machine learning. A lot of machine learning use cases are based on observation and the prediction of things. That is pretty much at the heart of the mathematics of forecasting. You need to understand the foundations of the statistical paradigm that Thomas Bayes introduced a couple hundred years ago in the 1700’s. The outcome of that journey will be the simple aside that we are about to work toward inferring some things. Yes, at this point in the journey we are about to work on inference. 

You could move directly to the point and examine Peter Frazier’s 2018 “A Tutorial on Bayesian Optimization” paper \cite{frazier2018tutorial}. You may want to extend that analysis to figure out all the \href{https://www.connectedpapers.com/main/c27078d60737ea10e8ca4f05acd114fef29c8276/graph}{connected papers}. Instead of wandering off into the vast collection of papers that are connected to that one I started to wonder about a very different set of questions. You may have wondered as well if Bayesian optimization is an equation. Within the field of machine learning it is treated more like an algorithm and people typically invoke or call it from previously coded efforts. It does not appear that generally within the field of machine learning people really do the math themselves. You are going to see a whole lot of extending things that are developed as part of a package or framework. Applied Bayesian optimization is going to fall into that format of delivery and application without question. 

The rest of this lecture on Bayesian optimization consists of three parts. First, 3 different videos you could watch. Second, 3 papers you could read to really dig into the subject and start to flush out your own research path. Third, an introduction to where you would find this type of effort expressed in code. Between those 3 different areas of consideration you can take your understanding of Bayesian optimization to the next level. 

\subsection{3 solid video explanations}
\begin{itemize}
\item “Bayesian Optimization - Math and Algorithm Explained”

\url{https://www.youtube.com/watch?v=ECNU4WIuhSE}
\item “Bayesian Optimization (Bayes Opt): Easy explanation of popular hyperparameter tuning method” 

\url{https://www.youtube.com/watch?v=M-NTkxfd7-8}
\item “Machine learning - Bayesian optimization and multi-armed bandits” 

\url{https://www.youtube.com/watch?v=vz3D36VXefI }
\end{itemize}

\subsection{3 highly cited papers for background:}
\begin{itemize}
\item \href{http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.467.8687&rep=rep1&type=pdf}{Pelikan, M., Goldberg, D. E., \& Cantú-Paz, E. (1999, July). BOA: The Bayesian optimization algorithm. In Proceedings of the genetic and evolutionary computation conference GECCO-99 (Vol. 1, pp. 525-532).} \cite{pelikan1999boa}
\item \href{https://ieeexplore.ieee.org/abstract/document/7352306}{Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., \& De Freitas, N. (2015). Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE, 104(1), 148-175.} \cite{shahriari2015taking}
\item \href{https://proceedings.neurips.cc/paper/2012/file/05311655a15b75fab86956663e1819cd-Paper.pdf}{Snoek, J., Larochelle, H., \& Adams, R. P. (2012). Practical Bayesian optimization of machine learning algorithms. Advances in neural information processing systems, 25.} \cite{snoek2012practical}
\end{itemize}

\subsection{Where would you find the code for this?}
\begin{itemize}
\item \href{https://blog.tensorflow.org/2020/01/hyperparameter-tuning-with-keras-tuner.html}{Tensorflow}
\item \href{https://github.com/keras-team/keras-tuner}{Keras}
\item \href{https://scikit-optimize.github.io/stable/}{Scikit-learn}
\item \href{https://colab.research.google.com/github/krasserm/bayesian-machine-learning/blob/master/bayesian_optimization.ipynb}{A Google Colab notebook}
\item \href{https://github.com/krasserm/}{The base Github for the above Google Colab notebook}
\end{itemize}
Closing out this lecture on Bayesian optimization has to end with a general bit of caution about the mathematics of machine learning. A lot of very complex mathematics including statistical devices are available to you within the machine learning space. Working toward a solid general understanding of what the underlying methods (especially the statistical methods) are doing is really important as a foundation for your future work. It is easy to allow the software to pick up the slack and to report outputs. Moving purely toward this type of effort allows the potential for problematic internal breakdowns of the mathematics to occur. You may very well get the outcome you wanted, but it is not explainable or repeatable in any way shape or form. Yes, I’m willing to accept that the majority of people working within the machine learning space could not take a step back and express their work in a pure mathematical way by abstracting away the code to a pure equation based form. That type of pure mathematical explanation by equation is not generally required in papers or read outs. Most of the time it comes down to the simple truth of working in production. 

\section{Week 81: A machine learning literature review}
You can find a lot of quality explanations of the differences between the various \href{https://www.ibm.com/cloud/blog/ai-vs-machine-learning-vs-deep-learning-vs-neural-networks}{flavors of machine learning}. This second lecture in the introduction to ML syllabus series should open with a series of the best literature reviews I could find and pull together to share. That will be the second part of this lecture. The third part will cover the intersection of programming languages. Some rather high quality textbooks and manuscripts exist within the field of machine learning. You can even find ones for free on GitHub and other places. Instead of starting with the obvious way to go by digging into some weighty tomes. I’m going to spend some time sharing readouts of some of the most highly cited machine learning papers. For a lot of people jumping into the field they are working on something in a different field of study and find a use case or a business related adventure that could benefit from machine learning. Typically at this point they are going to start digging into software and can get going very rapidly. That part of the journey requires no real deep dive into the relevant literature. It’s great that people can just jump in and find machine learning accessible. However, (you knew that was coming) the next phase in the journey is when people start wondering about the why and how of what is happening or they dig deep enough that they may want to know about the foundations of the technology or techniques they are using. At that point, depending on what is being done people will see a massive number of papers published and shared online. The vast majority are available to freely download and read. 
\subsection{Part 1: Highly cited machine learning papers}
Within this section I’m going to try to build out a collection of 10 things you could read to start getting a sense of what papers within the machine learning space are highly cited. That is not a measure of readability or how solid of a literature review for machine learning they provide. You will find that most of them do not have really lengthy literature sections. The authors make the citations they need to make for related work and jump into the main subject pretty quickly. I’m guessing that is a key part of why they are highly cited publications. To begin with; from what I can tell, the most highly cited and widely shared paper of all time in the machine learning or deep learning space has over 125,285 citations that Google Scholar is aware of and can index. That is the first paper in the list below.

\begin{enumerate}
\item \href{https://arxiv.org/abs/1512.03385?context=cs }{He, K., Zhang, X., Ren, S., \& Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).} This paper is cited a ton of times and has a pretty solid references section. If you read it after seeing the link above, then you would run into a bit of introduction on deep convolutional neural networks and then it would jump into some related work sections on residual representations, shortcut connections, and finally deep residual learning. While this paper is cited well over one hundred thousand times it is not designed to be an introduction to machine learning. It’s 12 pages and it provides a solid explanation of using deep residual learning for doing image recognition. To that end, this paper is highly on point and easy to read which is probably why so many people have cited it from 2016 to now. \cite{he2016deep}
\item  \href{https://www.science.org/doi/abs/10.1126/science.aaa8415}{Jordan, M. I., \& Mitchell, T. M. (2015). Machine learning: Trends, perspectives, and prospects. Science, 349(6245), 255-260.} Within the start of this review you are going to get a lot more of an introduction to what machine learning involves and I’m not surprised this work is highly cited. \cite{jordan2015machine}
\item  \href{https://doi.org/10.1038/nature14539 }{LeCun, Y., Bengio, Y. \& Hinton, G. Deep learning. Nature 521, 436–444 (2015).} This one is a very readable paper. It was certainly written to be widely read and is very consumable. It has 103 citations as well which is an intense number. \cite{lecun2015deep}
\item \href{https://arxiv.org/pdf/1502.03167.pdf }{Ioffe, S., \& Szegedy, C. (2015, June). Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning (pp. 448-456). PMLR.} \cite{ioffe2015batch}
\item \href{https://proceedings.neurips.cc/paper/2015/file/14bfa6bb14875e45bba028a21ed38046-Paper.pdf }{Ren, S., He, K., Girshick, R., \& Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region  proposal networks. Advances in neural information processing systems, 28.} \cite{ren2015faster}
\item  \href{https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf}{Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... \& Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.} \cite{vaswani2017attention}
\item \href{https://arxiv.org/pdf/1409.0473.pdf}{Bahdanau, D., Cho, K., \& Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.} \cite{bahdanau2014neural}
\item \href{https://doi.org/10.1038/nature14236 }{Mnih, V., Kavukcuoglu, K., Silver, D. et al. Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015).} \cite{mnih2015human}
\item \href{http://vision.stanford.edu/cs598_spring07/papers/Lecun98.pdf }{Y. Lecun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition," in Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998, doi: 10.1109/5.726791.} \cite{lecun1998gradient}
\item \href{https://arxiv.org/pdf/1412.6980.pdf}{Kingma, D. P., \& Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.} \cite{kingma2014adam}
\end{enumerate}

During part one of this lecture I covered 10 different machine learning papers that are highly cited. My top 10 list might very well not be your top 10 list. If you have a different one, then feel free to share it as well. I'm open to criticism and alternative methods. You can work the paper and reference journey to start to get a solid understanding of machine learning. That is one way to go about getting an introduction to the field. That method involves reading key pieces of literature and as you see footnotes and references that would help fill in your knowledge you take the time to work your way backward from anchor to anchor completing a highly personalized literature review. For academics or people highly focused on a special area within the academic space this is a tried and true method for learning. People are doing it all the time in business and in graduate schools all over the world. Another method exists as well and we will explore that more next.
\subsection{Part 2: General literature reviews, text books, and manuscripts about machine learning}
Sometimes you just want to have all the content packaged up and provided to you as a single serving introduction to machine learning. I’m aware that within this lecture I did not elect to take that single serving path. This field of study is large enough and includes a diverse enough set of knowledge that I think you need to approach it in a variety of different ways based on your specific learning needs. To that end I broke my machine learning literature review into two distinct parts. This second part is about where you could pick up one source and get started, but hopefully it won’t be the final destination in the lifeline learning journey that is understanding the ever changing field of machine learning. For those of you who have been reading this series for sometime you know that my go to introductory text is from the field of artificial intelligence and would be Stuart Russel and Peter Norvig’s classic “Artificial Intelligence: A Modern Approach” which is in its 4th edition based on the Berkeley website \cite{rusell2003artificial}. I have the 3rd edition on my bookshelf that I picked up on eBay. The 4th edition has a whole section devoted to machine learning including: learning from examples, probabilistic models, deep learning, and reinforcement learning. That is certainly a popular place to start for people who are starting to dig into machine learning and probably more importantly want a solid foundation in artificial intelligence as well. 

\begin{itemize}
\item You could go with a classic from 1997 and start with a book literally called “Machine Learning” by Tom Mitchell. \href{http://www.cs.cmu.edu/~tom/files/MachineLearningTomMitchell.pdf}{Mitchell, T. M. (1997). Machine learning. New York: McGraw-hill.} \cite{mitchell1997machine}
\item Maybe you were looking for something a little newer than 1997. You could jump over to the freely available Deep Learning book by \href{https://www.deeplearningbook.org/}{Ian Goodfellow, Yoshua Bengio, and Aaron Courville that was published back in 2016. Goodfellow, I., Bengio, Y., \& Courville, A. (2016). Deep learning. MIT press.} \cite{Goodfellow-et-al-2016}
\end{itemize}

A lot more books exist that could help give you an introduction to machine learning, but I’m going to close out with the three that I happen to like the best. That does not mean they are the only way to go about learning machine learning. 
\subsection{Part 3: All the code based introduction to machine learning efforts}
I’m going to let my TensorFlow bias run wild here for a moment and say that on my bookshelf right now are a few different works from Valliappa Lakshmanan. Within the TensorFlow community you will find a ton of well written and interesting sets of videos, courses, and other content that will help you dig into the field of machine learning. Outside of the TensorFlow content and the myriad of works by Lak I have a few other books on my bookshelf worth mentioning. I’m not sure why they are all published by O’Reilly, but that appears to be a theme of what made it to my bookshelf in terms of coding books. I know buying and subsequently keeping physical books is something that I do when I’m first learning something. I find it comforting to see them sitting next to me on my bookshelf in my office. 

\begin{itemize}
\item Grus, J. (2019). Data science from scratch: first principles with python. O'Reilly Media. \cite{grus2019data}
\item Hope, T., Resheff, Y. S., \& Lieder, I. (2017). Learning tensorflow: A guide to building deep learning systems. O'Reilly Media. \cite{hope2017learning} 
\item Graesser, L., \& Keng, W. L. (2019). Foundations of deep reinforcement learning: theory and practice in Python. Addison-Wesley Professional. \cite{graesser2019foundations}
\end{itemize}
\subsection{Part 4: Super brief conclusion}
Within this brief introduction to machine learning literature review we covered the top 10 articles I think you should start out reading and then we dug into the top 3 textbooks that stood out to me. During the first lecture you might also remember that in terms of forecasting and statistics another book was recommended. It had nothing to do with machine learning, but it's a solid foundational textbook for people interested in understanding the statistics of forecasting. 

\begin{itemize}
\item Armstrong, J. S. (Ed.). (2001). Principles of forecasting: a handbook for researchers and practitioners (Vol. 30). Boston, MA: Kluwer Academic. \cite{armstrong2001principles}
\end{itemize}

Other introduction to statistical methods books exist and one of them might be right for you if you need to brush up on some of the mathematics that you will encounter within the machine learning space. Beyond that, hopefully this lecture has given you a brief introduction to the treasure trove of literature available to give you an introduction to machine learning. 

\section{Week 82: ML algorithms}
Welcome to the lecture on ML algorithms. This topic was held until the 3rd installment of this series to allow a foundation for the concept of machine learning to develop. At some point, you are going to want to operationalize your knowledge of machine learning to do some things. For the vast majority of you one of these ML algorithms will be that something. Please take a step back and consider this very real scenario. Within the general scientific community getting different results every time you run the same experiment makes publishing difficult. That does not stop authors in the ML space. Replication and the process of verifying scientific results is often difficult or impossible without similar setups and the same data sets. Within the machine learning space where a variety of different ML algorithms exist that is a very normal outcome. Researchers certainly seem to have gotten very used to getting a variety of results. I’m not talking about using post theory science to publish based on allowing the findings to build knowledge instead of the other way around. You may very well get slightly different results every time one of these ML algorithms is invoked. You have been warned. Now let the adventure begin. 
One of the few Tweets that really made me think about the quality of ML research papers and the research patterns impacting quality was from \href{https://twitter.com/yaroslavvb/status/1484968489014104065}{Yaroslav Bulatov} who works on the PyTorch team back on January 22, 2022. That tweet referenced a paper on ArXiv called, “Descending through a Crowded Valley — Benchmarking Deep Learning Optimizers,” from 2021 \cite{schmidt2021descending}. That paper digs into the state of things where hundreds of optimization methods exist. It pulls together a really impressive list. The list itself was striking just in the volume of options available. My next thought was about just how many people are contributing to this highly overcrowded field of machine learning. That paper about deep learning optimizers covered a lot of ground and would be a good place to start digging around. We are going to approach this a little differently based on a look at the most common ones. 

Here are some (10) very common ML algorithms (this is not intended to be an exhaustive list):

\begin{enumerate}
\item XGBoost
\item Naive Bayes algorithm
\item Linear regression
\item Logistic regression
\item Decision tree
\item Support Vector Machine (SVM) algorithm
\item K-nearest neighbors (KNN) algorithm
\item K-means
\item Random forest algorithm
\item Diffusion
\end{enumerate}

I’m going to talk about each of these algorithms briefly or this would be a very long lecture. We certainly could go all hands and spend several hours all in together in a state of irregular operations covering these topics, but that is not going to happen today. To make this a more detailed syllabus version of the lecture I’m going to include a few references to relevant papers you can get access to and read after each general introduction. My selected papers might not be the key paper or the most cited. Feel free to make suggestions if you feel a paper better represents the algorithm. I’m open to suggestions. 
\paragraph{XGBoost} - Some people would argue with a great deal of passion that we could probably be one and done after introducing this ML algorithm. You can freely download the package for this one on \href{https://github.com/dmlc/xgboost}{GitHub}. It has over 20,000 stars on GitHub and has been forked over 8,000 times. People really seem to like this one and have used it to win competitions and generally get great results. Seriously, you will find references to XGBoost all over these days. It has gained a ton of attention and popularity. Not exactly to the level of being a pop culture reference, but within the machine learning community it is well known. The package is based on gradient boosting and provides parallel tree boating (GBDT, GBM). This package generally creates a series of models that boost the trees and help create overfitting in sequential efforts. You can read a paper from 2016 about it on arXiv called, “XGBoost: A Scalable Tree Boosting System”. The bottom line on this one is that you get a lot of benefits from gradient boosting built into a software package that can get you moving quickly toward your goal of success.
\begin{itemize}
\item \href{https://dl.acm.org/doi/pdf/10.1145/2939672.2939785}{Chen, T., \& Guestrin, C. (2016, August). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785-794).} \cite{chen2016xgboost}
\item \href{https://cran.microsoft.com/snapshot/2017-12-11/web/packages/xgboost/vignettes/xgboost.pdf}{Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., \& Chen, K. (2015). Xgboost: extreme gradient boosting. R package version 0.4-2, 1(4), 1-4.} \cite{chen2015xgboost}
\end{itemize}

\paragraph{Naive Bayes algorithm} - You knew I would have to have something Bayes related near the top of this list. This one is a type of classifier that helps evaluate the probability or relationship between classes. One of the classes with the highest probability will be considered the most likely class. It also assumes that those features are independent. I found a paper on this one that was cited about 4,146 times called, “An empirical study of the naive Bayes classifier”.

\begin{itemize}
\item \href{https://www.researchgate.net/profile/Irina-Rish/publication/228845263_An_Empirical_Study_of_the_Naive_Bayes_Classifier/links/00b7d52dc3ccd8d692000000/An-Empirical-Study-of-the-Naive-Bayes-Classifier.pdf}{Rish, I. (2001, August). An empirical study of the naive Bayes classifier. In IJCAI 2001 workshop on empirical methods in artificial intelligence (Vol. 3, No. 22, pp. 41-46).} \cite{rish2001empirical}
\end{itemize}
\paragraph{Linear regression} - This is the most basic algorithm and statistical technique in use here where based on a line (linear) a relationship can be charted for prediction between two things. A lot of the graphics you will see where a lot of content is mapped on a chart with a line dividing the general middle of the distribution would potentially be using some form of linear regression. 

\begin{itemize}
\item \href{https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0170478&type=printable}{Forkuor, G., Hounkpatin, O. K., Welp, G., \& Thiel, M. (2017). High resolution mapping of soil properties using remote sensing variables in south-western Burkina Faso: a comparison of machine learning and multiple linear regression models. PloS one, 12(1), e0170478.} \cite{forkuor2017high} 
\item \href{https://jastt.org/index.php/jasttpath/article/view/57/20}{Maulud, D., \& Abdulazeez, A. M. (2020). A review on linear regression comprehensive in machine learning. Journal of Applied Science and Technology Trends, 1(4), 140-147.} \cite{maulud2020review}
\end{itemize}
\paragraph{Logistic regression} - This type of statistical model allows an algorithmic analysis of the probability of success or failure. You could model other binary type questions. The good folks over at IBM have an entire set of pages set up to run through how \href{https://www.ibm.com/topics/logistic-regression }{logistic regression} could be a tool to help with decision making. This model is everywhere in simple analysis of things when people are trying to work toward a single decision. 

\begin{itemize}
\item \href{https://www.researchgate.net/profile/Ewout-Steyerberg/publication/331028284_A_systematic_review_shows_no_performance_benefit_of_machine_learning_over_logistic_regression_for_clinical_prediction_models/links/5c66bed192851c1c9de3251b/A-systematic-review-shows-no-performance-benefit-of-machine-learning-over-logistic-regression-for-clinical-prediction-models.pdf}{Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., \& Van Calster, B. (2019). A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. Journal of clinical epidemiology, 110, 12-22.} \cite{christodoulou2019systematic}
\item \href{https://core.ac.uk/download/pdf/82131402.pdf}{Dreiseitl, S., \& Ohno-Machado, L. (2002). Logistic regression and artificial neural network classification models: a methodology review. Journal of biomedical informatics, 35(5-6), 352-359.} \cite{dreiseitl2002logistic}
\end{itemize}
\paragraph{Decision tree} - Imagine diagramming decisions and coming to a fork where you have to decide to go one way or the other. That is how decision trees work based on inputs and corresponding outputs. Normally you will have a bunch of interconnected forks in the road and together they form up a decision tree. A lot of really great explanations of this exist online. One of my favorite ones is from \href{https://towardsdatascience.com/decision-trees-in-machine-learning-641b9c4e8052}{Towards Data Science} and was published way back in 2017.

\begin{itemize}
\item \href{https://citeseerx.ist.psu.edu/viewdoc/download?rep=rep1&type=pdf&doi=10.1.1.38.2702}{Dietterich, T. G., \& Kong, E. B. (1995). Machine learning bias, statistical bias, and statistical variance of decision tree algorithms (pp. 0-13). Technical report, Department of Computer Science, Oregon State University.} \cite{dietterich1995machine}
\end{itemize}
\paragraph{Support Vector Machine (SVM) algorithm} - You are going to need to imagine graphing out a bunch of data points then trying to come up with a line that separates them with a maximum margin. A solid explanation of this can be found within a \href{https://towardsdatascience.com/support-vector-machine-introduction-to-machine-learning-algorithms-934a444fca47 }{Towards Data Science} article from 2018.

\begin{itemize}
\item \href{https://www.ifi.uzh.ch/dam/jcr:00000000-7f84-9c3b-ffff-ffffc550ec57/what_is_a_support_vector_machine.pdf}{Noble, W. S. (2006). What is a support vector machine?. Nature biotechnology, 24(12), 1565-1567.} \cite{noble2006support}
\item \href{https://personal.ntu.edu.sg/elpwang/PDF_web/05_SVM_basic.pdf}{Wang, L. (Ed.). (2005). Support vector machines: theory and applications (Vol. 177). Springer Science \& Business Media.} \cite{wang2005support}
\item \href{https://www.ifi.uzh.ch/dam/jcr:00000000-7f84-9c3b-ffff-ffffbdb9a74e/SVM.pdf}{Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., \& Scholkopf, B. (1998). Support vector machines. IEEE Intelligent Systems and their applications, 13(4), 18-28.} \cite{hearst1998support}
\end{itemize}
\paragraph{K-nearest neighbors (KNN) algorithm} - Our friends over at \href{https://www.ibm.com/topics/knn }{IBM} are sharing all sorts of knowledge online including a bit about the KNN algorithm. Apparently, the best commentary explaining this one comes from \href{https://sebastianraschka.com/pdf/lecture-notes/stat479fs18/02_knn_notes.pdf}{Sebastian Raschka} back in the fall of 2018. This one is pretty much what you would expect from a technique that looks at distance between neighboring points. 

\begin{itemize}
\item \href{http://scholarpedia.org/article/K-nearest_neighbor}{Peterson, L. E. (2009). K-nearest neighbor. Scholarpedia, 4(2), 1883.} \cite{peterson2009k}
\item \href{https://www.researchgate.net/profile/Min-Ling-Zhang-2/publication/4196695_A_k-nearest_neighbor_based_algorithm_for_multi-label_classification/links/565d98f408ae1ef92982f866/A-k-nearest-neighbor-based-algorithm-for-multi-label-classification.pdf }{Zhang, M. L., \& Zhou, Z. H. (2005, July). A k-nearest neighbor based algorithm for multi-label classification. In 2005 IEEE international conference on granular computing (Vol. 2, pp. 718-721). IEEE.} \cite{zhang2005k}
\end{itemize}
\paragraph{K-means} - Some algorithms work to evaluate clusters and K-means is one of those. You can use this to try to help classify unlabeled data into clusters which can be helpful. 

\begin{itemize}
\item \href{https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9072123 }{Sinaga, K. P., \& Yang, M. S. (2020). Unsupervised K-means clustering algorithm. IEEE access, 8, 80716-80727.} \cite{sinaga2020unsupervised}
\end{itemize}
 
\paragraph{Random forest algorithm} - Most of the jokes that have been told within the machine learning space often relate to decision trees. The field is not full of a lot of jokes, but trees falling in a random forest are often included in that branch. People really liked the random forest algorithm for a time. You can imagine that a bunch of trees are created to engage in the prediction of classification. The random tree in the forest with the best classification production becomes the winner. This is great as it could find something that was noval or unexpected result based on the randomness.

\begin{itemize}
\item \href{https://arxiv.org/pdf/1511.05741.pdf }{Biau, G., \& Scornet, E. (2016). A random forest guided tour. Test, 25(2), 197-227.} \cite{biau2016random}
\end{itemize} 

\paragraph{Diffusion} - Previously I covered diffusion back in week 79 to try to figure out why it is becoming so popular. It is in no way as popular as XGBoost, but it has been gaining popularity. Over in the field of thermodynamics you could study gas molecules. Maybe you want to learn about how those gas molecules would diffuse from a high density to a low density area and you would also want to know how those gas molecules would reverse course. That is the basic theoretical part of the equation you need to absorb at the moment. Within the field of machine learning people have been building models that learn how based on degree of noise to diffuse the data and then reverse that process. That is basically the diffusion process in a nutshell. You can imagine that the cost to do this is computationally expensive. 

\begin{itemize}
\item \href{https://arxiv.org/pdf/1808.04519.pdf}{Wei, Q., Jiang, Y., \& Chen, J. Z. (2018). Machine-learning solver for modified diffusion equations. Physical Review E, 98(5), 053304.} \cite{wei2018machine}
\item \href{https://proceedings.neurips.cc/paper/2021/file/49ad23d1ec9fa4bd8d77d02681df5cfa-Paper.pdf}{Dhariwal, P., \& Nichol, A. (2021). Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems, 34, 8780-8794.} \cite{dhariwal2021diffusion}
 
\end{itemize}
Wrapping this lecture up should be pretty straightforward. Feel free to dig into some of those papers if anything grabbed your attention this week. A lot of algorithms exist in the machine learning space. I tried to grab algorithms that are timeless and will always be relevant when considering where machine learning as a field is going. 

\section{Week 83: Machine learning approaches}
During the last lecture we jumped in and looked at 10 machine learning algorithms. This week the content contained within this lecture will cover from a machine learning perspective reinforcement learning and 3 types of supervised learning. Those types of supervised learning will include the general use case of supervised learning, unsupervised learning, and the super interesting semi-supervised learning. Like the model for consideration used in the last lecture I’ll cover the topics in general and provide links to papers covering the topic to allow people looking for a higher degree of depth to dive deeper into academic papers to achieve that goal. My general preference here is to find academic papers that are both readable and are generally available for you to actually read with very low friction. Within the machine learning and artificial intelligence space a lot of papers are generally available and that is great for literature reviews and generally for scholarly work and practitioners working to implement the technology. My perspective is a mix between those two worlds which could be defined as a pracademic view of things. All right; here we go. 

\paragraph{Reinforcement learning} - Welcome to the world of machine learning. This is probably the first approach you are going to learn about in your journey. That’s right, it's time to consider for a brief moment the world of reinforcement learning. You are probably going to need to start to create some intelligent agents and you will want to figure out how to maximize the reward those agents could get. One method of achieving that result is called reinforcement learning. A lot of really great tutorials exist trying to explain this concept and one that I enjoyed was from \href{https://towardsdatascience.com/reinforcement-learning-101-e24b50e1d292}{Towards Data Science} way back in 2018. The nuts and bolts of this one involve trial and error with an intelligent agent trying to learn from mistakes using a maximization of reward function to avoid going down paths that don’t offer greater reward. The key takeaway here is that during the course of executing a model or algorithm a maximization function based on reward has to be in place to literally reinforce maximization during learning. I’m sharing references and links to 4 academic papers about this topic to help you dig into reinforcement learning with a bit of depth if you feel so inclined. 

\begin{itemize}
\item \href{https://www.jair.org/index.php/jair/article/view/10166/24110}{Kaelbling, L. P., Littman, M. L., \& Moore, A. W. (1996). Reinforcement learning: A survey. Journal of artificial intelligence research, 4, 237-285.} \cite{kaelbling1996reinforcement}
\item \href{https://login.cs.utexas.edu/sites/default/files/legacy_files/research/documents/1 intro up to RL:TD.pdf}{Sutton, R. S., \& Barto, A. G. (1998). Introduction to reinforcement learning.} \cite{sutton1998introduction}
\item \href{https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.308.549&rep=rep1&type=pdf}{Szepesvári, C. (2010). Algorithms for reinforcement learning. Synthesis lectures on artificial intelligence and machine learning, 4(1), 1-103.} \cite{szepesvari2010algorithms}
\item \href{https://arxiv.org/pdf/1312.5602.pdf }{Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., \& Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602.} \cite{mnih2013playing}
\end{itemize}

\paragraph{Supervised learning} - You knew it would only be a matter of time before we went out to some content from our friends over at \href{https://www.ibm.com/cloud/learn/supervised-learning#toc-unsupervis-Fo3jDcmY }{IBM}. They note that within a world where you have some labeled datasets and are training an algorithm to engage in classification or perhaps regression, but probably classification. In some ways the supervised element here is the labeling and guiding of the classification. Outside of somebody or a lot of people sitting and labeling training data the supervision is not from somebody outright sitting and watching the machine learning model run step by step. Some ethical considerations need to be taken into account at this point. A lot of people have worked to engage in data labeling. A ton of services exist to help bring people together to help do this type of work. Back in 2018 Maximilian Gahntz published a piece in \href{https://towardsdatascience.com/the-invisible-workers-of-the-ai-era-c83735481ba}{Towards Data Science} that talked about the invisible workers that are doing all that labeling in large curated datasets. Within the world of supervised learning being able to get high quality labeled data really impacts the ability to make solid models. It’s our ethical duty as researchers to consider what that work involves and who is doing that work. Another article in the \href{https://www.technologyreview.com/2020/12/11/1014081/ai-machine-learning-crowd-gig-worker-problem-amazon-mechanical-turk/}{MIT Technology Review} back in 2020 covered the idea of how gig workers are powering a lot of this labeling. The first academic article linked below with Saiph Savage as a co-author will cover the same topic and you should consider giving it a read to better understand how machine learning is built from dataset to model. After that article, the next two are general academic articles about predicting good probabilities and empirical comparisons to help ground your understanding of supervised learning. 

\begin{itemize}
\item \href{https://arxiv.org/pdf/1712.05796.pdf}{Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., \& Bigham, J. P. (2018, April). A data-driven analysis of workers' earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1-14).} \cite{hara2018data}
\item \href{https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.60.7135&rep=rep1&type=pdf}{Niculescu-Mizil, A., \& Caruana, R. (2005, August). Predicting good probabilities with supervised learning. In Proceedings of the 22nd international conference on Machine learning (pp. 625-632).} \cite{niculescu2005predicting}
\item \href{http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf}{Caruana, R., \& Niculescu-Mizil, A. (2006, June). An empirical comparison of supervised learning algorithms. In Proceedings of the 23rd international conference on Machine learning (pp. 161-168).} \cite{caruana2006empirical}
\end{itemize}

\paragraph{Unsupervised learning} - It’s a good thing that you were paying very close attention to the explanation of supervised learning above. Imagine that the humans or in some cases the vast collectives of humans labeling training sets just stopped doing that. Within the unsupervised learning world the classification within the machine learning problem space is going to be handed differently. Labeling and the creation of classification has to be a part of the modeling methodology. This topic always makes me think of the wonderful time capsule of a technology show about startups called Silicon Valley (2014 to 2019) that was broadcast by HBO. They had an algorithm explained at one point as being able to principally identify food as hot dog or not hot dog. That’s it the model only could do the one task. It was not capable of correctly identifying all food as that is a really complex task. Trying to use unsupervised learning for example, based on tags and other information identifying different types of food in photographs is something that people have certainly done with unsupervised learning approaches. I’m only sharing one paper about this approach and its from 2001. 

\begin{itemize}
\item \href{https://link.springer.com/content/pdf/10.1023/A:1007617005950.pdf}{Hofmann, T. (2001). Unsupervised learning by probabilistic latent semantic analysis. Machine learning, 42(1), 177-196.} \cite{hofmann2001unsupervised}
\end{itemize}

\paragraph{Semi-supervised learning} - All 3 of these different types of learning supervised, unsupervised, and semi-supervised are related. They are different methods of attacking a problem space related to learning as part of the border landscape of machine learning. You can imagine that people wanted to try to create a hybrid model when a limited set of labeled data is used to help begin the modeling process. That is the essence of the process of building out a semi-supervised learning approach. You could read more about that over on \href{https://towardsdatascience.com/supervised-learning-but-a-lot-better-semi-supervised-learning-a42dff534781}{Towards Data Science}. I’m sharing 3 different academic papers related to this topic that cover a literature review, a book about it, and the more advanced topic of pseudo labeling. 

\begin{itemize}
\item \href{https://minds.wisconsin.edu/bitstream/handle/1793/60444/TR1530.pdf?sequence=1 }{Zhu, X. J. (2005). Semi-supervised learning literature survey. } \cite{zhu2005semi}
\item \href{https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=4787647}{Chapelle, O., Scholkopf, B., \& Zien, A. (2009). Semi-supervised learning (chapelle, o. et al., eds.; 2006)[book reviews]. IEEE Transactions on Neural Networks, 20(3), 542-542.} \cite{chapelle2009semi}
\item \href{https://www.kaggle.com/blobs/download/forum-message-attachment-files/746/pseudo_label_final.pdf}{Lee, D. H. (2013, June). Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In Workshop on challenges in representation learning, ICML (Vol. 3, No. 2, p. 896).} \cite{lee2013pseudo}
\end{itemize}

\paragraph{Conclusion} - This lecture covered reinforcement learning and 3 types of supervised learning. You could spend a lot of time digging into academic articles and books related to these topics. Generally, I believe you will start to want to look at use cases and direct your attention to highly specific examples of applied machine learning at this point. Fortunately, a lot of those papers exist and you won’t be disappointed. 

\section{Week 84: Neural networks}
You may find in the literature that this topic of neural networks is sometimes called the zoo or more specifically, “the neural network zoo.” Corresponding to the articles that make this reference is a wonderful included graphic that shows a ton of different neural networks and can really give you a sense of how they work at the most fundamental level. Two papers that make this reference and include that wonderful graphic are from researchers at the Asimov institute that had papers published in 2016 and 2022. Both of those papers are great places to start learning about neural networks. 

\begin{itemize}
\item \href{https://www.asimovinstitute.org/neural-network-zoo/}{Van Veen, F., \& Leijnen, S. (2016). The neural network zoo. The Asimov Institute.} \cite{van2016neural}
\item \href{https://www.mdpi.com/2504-3900/47/1/9}{Leijnen, S., \& Veen, F. V. (2020). The neural network zoo. Multidisciplinary Digital Publishing Institute Proceedings, 47(1), 9.} \cite{leijnen2020neural}
\end{itemize}

That brief introduction aside. We are now going to focus on specific types of neural networks and next week our focus will shift to the topic of neuroscience. I have separated the two topics on purpose. Briefly, I had considered trying to combine the two topics as one set of content, but I think it would have become unwieldy in terms of trying to present a distinct point of view on both topics. Digging into neural networks is really about digging into deep learning and trying to understand it as a subfield of machine learning. Keep in mind that while machine learning is exciting it's just a small part of the broader grouping of artificial intelligence as a field of study. I’m going to provide a brief introduction and some links to scholarly articles for 9 types of neural networks that you might run into. This list is in no way comprehensive and is built and ordered based on my interests as a researcher. A lot of speciality models and methods exist. One of them could end up displacing something on the list if it proves highly effective. I’m open to suggestions of course for different models or even orders of explanation.

\begin{enumerate}
\item Artificial Neural Networks (ANN)
\item Simulated Neural Networks (SNN)
\item Recurrent Neural Networks (RNN)
\item Generative Adversarial Network (GAN) 
\item Convolutional Neural Network (CNN)
\item Deep Belief Networks (DBN)
\item Self Organizing Neural Network (SONN)
\item Deeply Quantized Neural Networks (DQNN)
\item Modular Neural Network (MNN)
\end{enumerate}

\paragraph{Artificial Neural Networks (ANN)} - This is the model that is generally shortened to just neural networks and it is a very literal title. An ANN is really an attempt or more accurately a computational model designed to either mimic or create a neural network akin to what is used within a biological brain using hardware or software. You can assume this model to be fundamental to any consideration of neural networks, but you are going to quickly want to dig into other more targeted models based on your specific use case. What you are trying to accomplish will certainly help you focus on a model or method that best meets the needs of that course of action. However, in the abstract people will consider how to build ANNs and what they could be used for as the technology progresses.

\begin{itemize}
\item \href{https://www.cse.msu.edu/~jain/ArtificialNeuralNetworksATutorial.pdf}{Jain, A. K., Mao, J., \& Mohiuddin, K. M. (1996). Artificial neural networks: A tutorial. Computer, 29(3), 31-44.} \cite{jain1996artificial}
\item \href{https://www.researchgate.net/profile/Terrence-Fine/publication/3078997_Fundamentals_of_Artificial_Neural_Networks-Book_Reviews/links/56ebf73a08aee4707a3849a6/Fundamentals-of-Artificial-Neural-Networks-Book-Reviews.pdf}{Hassoun, M. H. (1995). Fundamentals of artificial neural networks. MIT press.} \cite{hassoun1995fundamentals}
\end{itemize}

\paragraph{Simulated Neural Networks (SNN)} - As you work along your journey in the deep learning space and really start to dig into neural networks you will run into those ANNs and very quickly a subset of machine learning adjacent to that type of model called the simulated neural networks. Creating a neural network that truly mimics the depth and capacity of the brain is something to strive for right now and with that constraint it makes sense that work is being done to simulate the best possible representation we can achieve currently or a very special use case that limits the simulation. Using models that generate a simulation based on some complex sets of mathematics, these SNNs are being created to challenge certain use cases. One of the papers shared below is associated with figuring out the shelf life of processed cheese for example. 

\begin{itemize}
\item \href{https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.57.9281&rep=rep1&type=pdf}{Kudela, P., Franaszczuk, P. J., \& Bergey, G. K. (2003). Changing excitation and inhibition in simulated neural networks: effects on induced bursting behavior. Biological cybernetics, 88(4), 276-285.} \cite{kudela2003changing}
\item \href{https://ir.uitm.edu.my/id/eprint/34381/1/34381.pdf}{Goyal, S., \& Goyal, G. K. (2012). Application of simulated neural networks as non-linear modular modeling method for predicting shelf life of processed cheese. Jurnal Intelek, 7(2), 48-54.} \cite{goyal2012application}
\end{itemize}

\paragraph{Recurrent Neural Networks (RNN)} - At some point you will want to move from simulating and modeling to accomplishing the hard work of applied machine learning for a specific use case. One of the models you will see being used actively are variations and direct implementations of recurrent neural networks. Within this type of model patterns are going to be identified within the data and the modeling will be based on those patterns to engage in a prediction of the most likely next scenario. This is a useful approach for speech recognition or handwriting analysis. You probably have run into an RNN at some point today with your smartphone or a connected home speaker. A lot of very interesting applied use cases exist for RNNs.

\begin{itemize}
\item \href{https://arxiv.org/pdf/1506.00019.pdf}{Lipton, Z. C., Berkowitz, J., \& Elkan, C. (2015). A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019.} \cite{lipton2015critical} 
\item \href{https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8066291}{Yin, C., Zhu, Y., Fei, J., \& He, X. (2017). A deep learning approach for intrusion detection using recurrent neural networks. Ieee Access, 5, 21954-21961.} \cite{yin2017deep}
\end{itemize}

\paragraph{Generative Adversarial Network (GAN)} - For me personally, this is where things get interesting. Instead of looking at one neural network this GAN model creates the possibility of gamification or more to the point direct competition between models in an adversarial way. Two generative models or potentially more can be compared to figure out an optimal approach. I think this is a very interesting methodology and one that could yield very interesting futur results. You can read a lot about this and see the early code published about 8 years ago from Ian Goodfellow over on \href{https://github.com/goodfeli/adversarial}{GitHub}.

\begin{itemize}
\item \href{https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf}{Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... \& Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27.} \cite{goodfellow2014generative}
\item \href{https://arxiv.org/pdf/1809.07294.pdf}{Yi, X., Walia, E., \& Babyn, P. (2019). Generative adversarial network in medical imaging: A review. Medical image analysis, 58, 101552.} \cite{yi2019generative}
\item \href{https://www.sciencedirect.com/science/article/pii/S2667096820300045}{Aggarwal, A., Mittal, M., \& Battineni, G. (2021). Generative adversarial network: An overview of theory and applications. International Journal of Information Management Data Insights, 1(1), 100004.} \cite{aggarwal2021generative}
\end{itemize}

\paragraph{Convolutional Neural Network (CNN)} - You will run into use cases where you want to dig into visual imagery and that is where CNNs will probably pop up very quickly. You are building a model or algorithm that based on weights and biases can evaluate a series of images or potentially other content. The process of how layers are made and what exactly fuels a CNN is a very interesting process of abstraction. 

\begin{itemize}
\item \href{https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6197001/pdf/CIN2018-6973103.pdf}{Albawi, S., Mohammed, T. A., \& Al-Zawi, S. (2017, August). Understanding of a convolutional neural network. In 2017 international conference on engineering and technology (ICET) (pp. 1-6). Ieee.} \cite{albawi2017understanding}
\item \href{https://arxiv.org/pdf/1511.08458}{O'Shea, K., \& Nash, R. (2015). An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458.} \cite{o2015introduction}
\end{itemize}

\paragraph{Deep Belief Networks (DBN)} - You may have run into this one in the news recently with all the coverage related to drug discovery. DBNs are frequently described as graphical in nature and generative. The reason it works for something as influential and interesting as drug discovery is that you can produce all the possible values for potential new drugs in a use case and evaluate those results. This is an area where I think the things being produced will be extremely beneficial assuming the methodology is used in positive ways. 

\begin{itemize}
\item \href{https://era.ed.ac.uk/bitstream/handle/1842/4588/MurrayI_On the Quantitative Analysis.pdf?sequence=1&isAllowed=y}{Salakhutdinov, R., \& Murray, I. (2008, July). On the quantitative analysis of deep belief networks. In Proceedings of the 25th international conference on Machine learning (pp. 872-879).} \cite{salakhutdinov2008quantitative}
\item \href{http://scholarpedia.org/article/Deep_belief_networks}{Hinton, G. E. (2009). Deep belief networks. Scholarpedia, 4(5), 5947.} \cite{hinton2009deep} 
\end{itemize}

\paragraph{Self Organizing Neural Network (SONN)} - Imagine a neural network model based on feature maps or Kohonen maps that is unsupervised and self-organizing. Within that explanation you are going to get a self organizing neural network model. This could be used for adaptive pattern recognition or just regular pattern recognition. The two references shared below will spell out how this works in more detail if you are interested. 

\begin{itemize}
\item \href{https://search.iczhiku.com/paper/bELWExDU1wAMpDkP.pdf}{Carpenter, G. A., \& Grossberg, S. (1988). The ART of adaptive pattern recognition by a self-organizing neural network. Computer, 21(3), 77-88.} \cite{carpenter1988art}
\item \href{https://www.google.com/books/edition/Pattern_Recognition_by_Self_organizing_N/2u1fH0mxfz0C?hl=en&gbpv=0}{Carpenter, G. A., \& Grossberg, S. (Eds.). (1991). Pattern recognition by self-organizing neural networks. MIT Press.} \cite{carpenter1988art}
\end{itemize}

\paragraph{Deeply Quantized Neural Networks (DQNN)} - Within a neural network model when you are creating weights you could elect to use only very small ones from 1 to 8 bits and to that end you would be on your way to a deeply quantized neural network. Development tools exist for this type of effort like the Google team’s \href{https://github.com/google/qkeras}{qKeras} and \href{https://github.com/larq/larq }{Larq}. Getting open access to papers on this topic is a little harder than some of the others, but you can pretty quickly get to the code on how to implement this type of neural network. 

\begin{itemize}
\item \href{https://arxiv.org/ftp/arxiv/papers/2106/2106.15350.pdf}{Dogaru, R., \& Dogaru, I. (2021). LB-CNN: An Open Source Framework for Fast Training of Light Binary Convolutional Neural Networks using Chainer and Cupy. arXiv preprint arXiv:2106.15350.} \cite{dogaru2021lb}
\end{itemize}

\paragraph{Modular Neural Network (MNN)} - Within this model you are going to want to create independent neural networks and moderate them. Within this framework each independent neural network is a module of the whole. This one always makes me think of building blocks for some reason, but that is a simplistic representation given the ability for moderation required to make this work. 

\begin{itemize}
\item \href{https://arxiv.org/pdf/1609.07088.pdf}{Devin, C., Gupta, A., Darrell, T., Abbeel, P., \& Levine, S. (2017, May). Learning modular neural network policies for multi-task and multi-robot transfer. In 2017 IEEE international conference on robotics and automation (ICRA) (pp. 2169-2176). IEEE.} \cite{devin2017learning}
\item \href{https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.54.8248}{Happel, B. L., \& Murre, J. M. (1994). Design and evolution of modular neural network architectures. Neural networks, 7(6-7), 985-1004.} \cite{happel1994design}
\end{itemize}

\paragraph{Conclusion} - This is an intense way of starting to dig into neural networks and you will very quickly see that the use cases outside of pure machine learning or artificial intelligence are driving this field forward. A lot of these use cases are within the medical field or health care in general and are super interesting and somewhat related to neuroscience. That is where the next lecture will head in this series. Discussion will move from specific types of neural networks and the research associated with them to the broader topic of neuroscience and how it relates to machine learning. 

\section{Week 85: Neuroscience}
Neuroscience is a complex topic to dig into in general. Studying the nervous system is a complex thing to do before you add in the concept of machine learning or artificial intelligence. Within the context of machine learning it gets even more interesting for academic researchers, practitioners, and anybody building neural networks. Understanding that context of complexity within any inquiry into neuroscience, it will make sense here to focus on 5 scholarly articles that could help provide a solid context here for the relationship between neuroscience and machine learning. Within this section of inquiry the articles are really going to bring forward the complexity of the issue. The scholarly articles selected to cover neuroscience include a lot of focus on how the two subjects work together and the future of that collaboration.  

\begin{enumerate}
\item \href{https://www.nature.com/articles/d41586-019-02212-4 }{Savage, N. (2019). How AI and neuroscience drive each other forwards. Nature, 571(7766), S15-S15.} \cite{savage2019ai}
\item \href{https://www.nature.com/articles/s41593-019-0520-2}{Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., ... \& Kording, K. P. (2019). A deep learning framework for neuroscience. Nature neuroscience, 22(11), 1761-1770.} \cite{richards2019deep}
\item \href{https://www.frontiersin.org/articles/10.3389/fncom.2016.00094/pdf}{Marblestone, A. H., Wayne, G., \& Kording, K. P. (2016). Toward an integration of deep learning and neuroscience. Frontiers in computational neuroscience, 94.} \cite{marblestone2016toward}
\item \href{https://archive-ouverte.unige.ch/unige:33936/ATTACHMENT01}{Richiardi, J., Achard, S., Bunke, H., \& Van De Ville, D. (2013). Machine learning with brain graphs: predictive modeling approaches for functional imaging in systems neuroscience. IEEE Signal processing magazine, 30(3), 58-70.} \cite{richiardi2013machine}  
\item \href{https://www.jneurosci.org/content/jneuro/38/7/1601.full.pdf}{Vu, M. A. T., Adalı, T., Ba, D., Buzsáki, G., Carlson, D., Heller, K., ... \& Dzirasa, K. (2018). A shared vision for machine learning in neuroscience. Journal of Neuroscience, 38(7), 1601-1607.} \cite{vu2018shared}
\end{enumerate}

\section{Week 86: Ethics, fairness, bias, and privacy}
This set of topics was either going to be the foundation to start this series or it was going to be collected as a set of thoughts at the end. You can tell that obviously I demurred from starting with ethics, fairness, bias, and privacy in machine learning until the full foundation was set for the topics under consideration. These topics are not assembled as an afterthought and are very important to any journey within the machine learning space. This technology in terms of machine learning and artificial intelligence has the potential to be near omnipresent in day to day life and certainly within anything where decision making or anything digital persists. Each of these topics is going to receive a solid overview followed by a series of scholarly articles like the previous lectures. You are now well aware from seeing dozens of other scholarly articles that these topics do not appear in each and every work and while they are conceptually foundational as intellectual guardrails they are not consistently presented that way in literature reviews or considerations for the practical work occurring within the machine learning space. I would clearly argue and have for years that just because you can do a thing does not mean that you should. You have to consider the consequences and realities of bringing that thing forward in a world where models and methods are so readily shared on GitHub and other platforms. 
Overlap certainly occurs between the topics of ethics, fairness, bias, and privacy within the machine learning academic space. I have tried to sort the articles to help enhance readability within the different categories, but you will see some overlap. 

\paragraph{Ethics} - This topic got covered back in week 65. I’m going to rework part of that content here so if it feels familiar that is consistent with it appearing before about 20 weeks ago. Anybody preparing machine learning content should be comfortable with presenting ethics as a topic of consideration. I firmly believe and hope you would support that effort after coming along for this journey so far into this independent study syllabus. Ethics should be covered as a part of every machine learning course. Perhaps the best way to sum it up as an imperative would be to say, “Just because you can do a thing does not mean you should.” Machine learning opens the door to some incredibly advanced possibilities for drug discovery, medical image screening, or just spam detection to protect your inbox. The choices people make with machine learning use cases is where the technology and ethics have to be aligned. Full stop. That is the point I’m trying to make today and this essay could stop right here.

No one really solid essay or set of essays on AI/ML ethics jumped out and caught my attention this week during my search. Part of my search involved digging into results from Google Scholar that yielded a ton of different options to read about \href{https://scholar.google.com/scholar?q=ethics+in+machine+learning&hl=en&as_sdt=0&as_vis=1&oi=scholart}{“ethics in machine learning”}. A lot of those articles cover how to introduce ethics to machine learning courses and about the need to consider ethics when building machine learning implementations. Given that those two calls to action are the first things that come up and they are certainly adjacent to the primary machine learning content being shared it might make you take a moment to pause and consider how much the field of machine learning should deeply consider the idea that just because it can do something does not mean you should. Some use cases are pretty basic and the ethics of what is happening is fairly settled. Other use cases walk right up to the edge of what is reasonable in terms of fairness and equity.

\begin{itemize}
\item \href{https://www.nature.com/articles/s41599-020-0501-9.pdf}{Lo Piano, S. (2020). Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward. Humanities and Social Sciences Communications, 7(1), 1-7.} \cite{lo2020ethical}  
\item \href{https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/849782a6-06bf-4ce8-9144-a93de4455d1c/content}{Greene, D., Hoffmann, A. L., \& Stark, L. (2019). Better, nicer, clearer, fairer: A critical assessment of the movement for ethical artificial intelligence and machine learning.} \cite{greene2019better}  
\end{itemize}

\paragraph{Fairness and Bias} - Implementing machine learning algorithms generally involves working with imperfect data sets that have different biases that have to be accounted for and ultimately corrected. 

\begin{itemize}
\item \href{https://arxiv.org/pdf/1808.00023.pdf }{Corbett-Davies, S., \& Goel, S. (2018). The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023.} \cite{corbett2018measure}
\item \href{https://arxiv.org/pdf/1810.08810.pdf }{Chouldechova, A., \& Roth, A. (2018). The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810.} \cite{chouldechova2018frontiers}
\item \href{https://fairmlbook.org/pdf/fairmlbook.pdf}{Barocas, S., Hardt, M., \& Narayanan, A. (2017). Fairness in machine learning. Nips tutorial, 1, 2.} \cite{barocas2017fairness}
\item \href{https://arxiv.org/pdf/1908.09635.pdf}{Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., \& Galstyan, A. (2021). A survey on bias and fairness in machine learning. ACM Computing Surveys (CSUR), 54(6), 1-35.} 
\item \href{https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/d062bd2a-df54-48d4-b27e-76d903b9caaa/content}{Yapo, A., \& Weiss, J. (2018). Ethical implications of bias in machine learning.} 
\end{itemize}

\paragraph{Privacy} - No conversation about machine learning would be complete without a consideration of privacy. A part of the ethical considerations surrounding the use of machine learning algorithms is inherently privacy of data and privacy of the outputs. 

\begin{itemize}
\item \href{https://arxiv.org/pdf/1412.7584.pdf }{Ji, Z., Lipton, Z. C., \& Elkan, C. (2014). Differential privacy and machine learning: a survey and review. arXiv preprint arXiv:1412.7584.} \cite{ji2014differential}
\item \href{https://arxiv.org/pdf/2007.07646.pdf}{Rigaki, M., \& Garcia, S. (2020). A survey of privacy attacks in machine learning. arXiv preprint arXiv:2007.07646.} \cite{rigaki2020survey}
\end{itemize}

\paragraph{Conclusion} - I wanted to refocus my efforts on the macro considerations related to ethics in machine learning at this point. I remembered that Rob May shared a weekend commentary as a part of the \href{https://inside.com/campaigns/inside-ai-31781/sections/inside-ai-commentary-by-robmay-275419}{Inside AI} newsletter recently about the dark side of reducing friction in taking action with advanced technology. Rob even went as far as sharing an article from one of my favorite technology related sources \href{https://www.theverge.com/2022/3/17/22983197/ai-new-possible-chemical-weapons-generative-models-vx}{“The Verge”} about just how easy and low friction it was to use machine learning to suggest new chemical weapon builds. That is a very real example of where reducing friction to doing a thing opens the door to very problematic actions that illustrate the need for a foundational set of ethics.

\section{Week 87: MLOps}
This lecture is going to be provided in two parts. First, I’m going to provide you with a few scholarly articles that dig into what MLOps involves and how researchers are addressing the topic. Second, I’ll provide you my insights on the topic of MLOps which I have been presenting for the last few years. When you get to the point of applying ML techniques in production you will end up needing MLOps. 
\subsection{MLOps research papers}
\begin{itemize}
\item \href{https://arxiv.org/pdf/2103.08942.pdf[Zugriffam09.09.2021}{Alla, S., \& Adari, S. K. (2021). What is mlops?. In Beginning MLOps with MLFlow (pp. 79-124). Apress, Berkeley, CA.} \cite{alla2021mlops}
\item \href{https://www.researchgate.net/profile/Yue-Yu-126/publication/349802712_Towards_MLOps_A_Case_Study_of_ML_Pipeline_Platform/links/61dd00575c0a257a6fdd62f3/Towards-MLOps-A-Case-Study-of-ML-Pipeline-Platform.pdf}{Zhou, Y., Yu, Y., \& Ding, B. (2020, October). Towards mlops: A case study of ml pipeline platform. In 2020 International conference on artificial intelligence and computer engineering (ICAICE) (pp. 494-500). IEEE.} \cite{zhou2020towards}
\item \href{https://arxiv.org/pdf/2102.07750.pdf}{Renggli, C., Rimanic, L., Gürel, N. M., Karlaš, B., Wu, W., \& Zhang, C. (2021). A data quality-driven view of mlops. arXiv preprint arXiv:2102.07750.} \cite{renggli2021data}
\item \href{https://www.mdpi.com/2076-3417/11/19/8861/pd}{Ruf, P., Madan, M., Reich, C., \& Ould-Abdeslam, D. (2021). Demystifying mlops and presenting a recipe for the selection of open-source tools. Applied Sciences, 11(19), 8861.} \cite{ruf2021demystifying}
\end{itemize}

\subsection{My insights about MLOps}

% This table was built using Table Generator
% Please add the following required packages to your document preamble:
% \usepackage[table,xcdraw]{xcolor}
% If you use beamer only pass "xcolor=table" option, i.e. \documentclass[xcolor=table]{beamer}
% \usepackage[normalem]{ulem}
% \useunder{\uline}{\ul}{}
\begin{table}[ht]
\centering
\begin{tabular}{lllllll}
\textbf{\#} & \textbf{ML and MLOps GitHub Repositories}                                     & \textbf{Branches} & \textbf{Issues} & \textbf{Stars} & \textbf{Forks} & \textbf{Contribs} \\
1           & {\color[HTML]{0563C1} {\ul https://github.com/tensorflow/tensorflow}}         & 42                & 3,800           & 154,162        & 84,300         & 2,933            \\
2           & {\color[HTML]{0563C1} {\ul https://github.com/pytorch/pytorch}}               & 4,620             & 5,000           & 47,011         & 12,500         & 1,785            \\
3           & {\color[HTML]{0563C1} {\ul https://github.com/scikit-learn/scikit-learn}}     & 23                & 1,600           & 44,924         & 21,200         & 1,936            \\
4           & {\color[HTML]{0563C1} {\ul https://github.com/kubeflow/kubeflow}}             & 23                & 209             & 10,066         & 1,600          & 220              \\
5           & {\color[HTML]{0563C1} {\ul https://github.com/mlflow/mlflow}}                 & 72                & 571             & 8,583          & 1,900          & 290              \\
6           & {\color[HTML]{0563C1} {\ul https://github.com/iterative/dvc}}                 & 4                 & 521             & 7,543          & 709            & 202              \\
7           & {\color[HTML]{0563C1} {\ul https://github.com/cortexlabs/cortex}}             & 51                & 185             & 7,408          & 566            & 20               \\
8           & {\color[HTML]{0563C1} {\ul https://github.com/h2oai/h2o-3}}                   & 1,900             & 127             & 5,261          & 1,800          & 140              \\
9           & {\color[HTML]{0563C1} {\ul https://github.com/pachyderm/pachyderm}}           & 1,530             & 614             & 4,931          & 478            & 127              \\
10          & {\color[HTML]{0563C1} {\ul https://github.com/optuna/optuna}}                 & 4                 & 147             & 4,283          & 112            & 483              \\
11          & {\color[HTML]{0563C1} {\ul https://github.com/Netflix/metaflow}}              & 19                & 100             & 4,167          & 347            & 30               \\
12          & {\color[HTML]{0563C1} {\ul https://github.com/wandb/client}}                  & 703               & 222             & 2,816          & 62             & 199              \\
13          & {\color[HTML]{0563C1} {\ul https://github.com/polyaxon/polyaxon}}             & 14                & 103             & 2,764          & 265            & 80               \\
14          & {\color[HTML]{0563C1} {\ul https://github.com/allegroai/clearml}}             & 1                 & 69              & 2,228          & 331            & 23               \\
15          & {\color[HTML]{0563C1} {\ul https://github.com/SeldonIO/seldon-core}}          & 240               & 231             & 2,165          & 483            & 105              \\
16          & {\color[HTML]{0563C1} {\ul https://github.com/tensorflow/tfx}}                & 368               & 202             & 1,362          & 416            & 100              \\
17          & {\color[HTML]{0563C1} {\ul https://github.com/maiot-io/zenml/}}               & 4                 & 8               & 1,020          & 51             & 7                \\
18          & {\color[HTML]{0563C1} {\ul https://github.com/microsoft/MLOps}}               & 9                 & 10              & 707            & 247            & 28               \\
19          & {\color[HTML]{0563C1} {\ul https://github.com/mlrun/mlrun}}                   & 7                 & 20              & 294            & 76             & 28               \\
20          & {\color[HTML]{0563C1} {\ul https://github.com/Hydrospheredata/hydro-serving}} & 30                & 21              & 214            & 35             & 15               \\
21          & {\color[HTML]{0563C1} {\ul https://github.com/bodywork-ml/bodywork-core}}     & 5                 & 0               & 143            & 9              & 2                \\
22          & {\color[HTML]{0563C1} {\ul https://github.com/MLReef/mlreef}}                 & 1                 & 0               & 14             & 0              & 8               
\end{tabular}
\caption{Highly used ML and MLops repositories on Github (verified between 3/17/2021 and 3/19/2021)}
\label{tab:my-table1}
\end{table}

Some of the major players within the information technology space are trying to break into the machine learning operations (or MLOps) space. Like anything else, picking the right tools to get things done is about matching the right technology and use case to achieve the best possible results. We are really starting to see some solid maturity in the MLOps space. The next stage will be either a round of purchasing where established players buy up the upstart players building MLOps or the established players will build out the necessary elements to move past the newer players in the enterprise level market.

Let's look at the first technology in Table 1~\ref{tab:my-table1} which happens to be TensorFlow. You should not be surprised to see that TensorFlow has by far the largest influence at 154,162 stars. Getting a star requires a GitHub user to click the star function. People have really placed a lot of attention on TensorFlow. It has 2,933 contributors that means that almost 3,000 people are contributing to TensorFlow. From that point you can see that PyTorch drops off considerably. It's going from around 154k stars to just 47k stars. The number of contributors drops off significantly as well. Now, you're down to around 1,785. Now on the PyTorch example, they do have 4,620 branches which honestly I don't know why you would want to look at that many branches. No human wants to manage that many branches of anything. That is unmanageable in terms of iteration. You can see that scikit-learn has roughly 44,000 stars and has 1,936 contributors. So you can kind of see here that the three major projects that are out there for machine learning are definitely adopted. People are using them and they're making forks of it, they're making versions of it, and they're starting to really dig into it out in the wild of software development right now.

So now if we take it to the next level and look a little deeper in terms of what's happening with the MLOps part of it. You're gonna see a major drop-off. Remember TensorFlow had 154,162 stars. Now you're starting to see the number of stars drop off considerably. You're starting to see that number of stars at 10,000 or less. You are starting to see kubeflow, mlflow, and some of these things that you know are complex stuff like metaflow from Netflix and you're only gonna see 4,000 stars and each of these things is gonna have sub 500 contributors. We haven't seen everyone trying to implement MLOps swarm in and start using these things. One of the reasons for that rapid decline in interest has to be the previously described bucket 1 where you can just connect to an API and functionally someone else is running part of the day to day MLOps. 

% This table was built using Table Generator
% Please add the following required packages to your document preamble:
% \usepackage[table,xcdraw]{xcolor}
% If you use beamer only pass "xcolor=table" option, i.e. \documentclass[xcolor=table]{beamer}
% \usepackage[normalem]{ulem}
% \useunder{\uline}{\ul}{}
\begin{table}[ht]
\centering
\begin{tabular}{lllllll}
\textbf{\#} & \textbf{GitHub   repository links}                                            & \textbf{Branches} & \textbf{Issues} & \textbf{Stars} & \textbf{Forks} & \textbf{Contribs} \\
1           & {\color[HTML]{0563C1} {\ul https://github.com/tensorflow/tensorflow}}         & 66                & 2,119           & 167,058        & 87,100         & 3,165             \\
2           & {\color[HTML]{0563C1} {\ul https://github.com/pytorch/pytorch}}               & 6,501             & 9,015           & 57,940         & 16,100         & 2,398             \\
3           & {\color[HTML]{0563C1} {\ul https://github.com/scikit-learn/scikit-learn}}     & 27                & 1,526           & 51,037         & 23,300         & 2,453             \\
4           & {\color[HTML]{0563C1} {\ul https://github.com/mlflow/mlflow}}                 & 149               & 808             & 12,424         & 2,900          & 471               \\
5           & {\color[HTML]{0563C1} {\ul https://github.com/kubeflow/kubeflow}}             & 37                & 161             & 11,757         & 2,000          & 257               \\
6           & {\color[HTML]{0563C1} {\ul https://github.com/iterative/dvc}}                 & 7                 & 627             & 10,142         & 965            & 248               \\
7           & {\color[HTML]{0563C1} {\ul https://github.com/cortexlabs/cortex}}             & 55                & 110             & 7,783          & 594            & 22                \\
8           & {\color[HTML]{0563C1} {\ul https://github.com/optuna/optuna}}                 & 16                & 90              & 6,778          & 736            & 177               \\
9           & {\color[HTML]{0563C1} {\ul https://github.com/h2oai/h2o-3}}                   & 2,401             & 64                & 5,922          & 1,900          & 161               \\
10          & {\color[HTML]{0563C1} {\ul https://github.com/Netflix/metaflow}}              & 53                & 184             & 5,888          & 530            & 59                \\
11          & {\color[HTML]{0563C1} {\ul https://github.com/pachyderm/pachyderm}}           & 968               & 692             & 5,607          & 532            & 152               \\
12          & {\color[HTML]{0563C1} {\ul https://github.com/wandb/client}}                  & 406               & 455             & 4,515          & 348            & 107               \\
13          & {\color[HTML]{0563C1} {\ul https://github.com/allegroai/clearml}}             & 3                 & 261             & 3,493          & 468            & 50                \\
14          & {\color[HTML]{0563C1} {\ul https://github.com/SeldonIO/seldon-core}}          & 294               & 139             & 3,312          & 693            & 153               \\
15          & {\color[HTML]{0563C1} {\ul https://github.com/polyaxon/polyaxon}}             & 16                & 108             & 3,135          & 306            & 93                \\
16          & {\color[HTML]{0563C1} {\ul https://github.com/maiot-io/zenml/}}               & 49                & 22              & 2,267          & 193            & 45                \\
17          & {\color[HTML]{0563C1} {\ul https://github.com/tensorflow/tfx}}                & 502               & 208             & 1,803          & 604            & 139               \\
18          & {\color[HTML]{0563C1} {\ul https://github.com/MLReef/mlreef}}                 & 3                 & 0               & 1,393          & 320            & 9                 \\
19          & {\color[HTML]{0563C1} {\ul https://github.com/microsoft/MLOps}}               & 10                & 11              & 1,166          & 397            & 28                \\
20          & {\color[HTML]{0563C1} {\ul https://github.com/mlrun/mlrun}}                   & 23                & 35              & 782            & 154            & 54                \\
21          & {\color[HTML]{0563C1} {\ul https://github.com/bodywork-ml/bodywork-core}}     & 1                 & 20              & 399            & 19             & 2                 \\
22          & {\color[HTML]{0563C1} {\ul https://github.com/Hydrospheredata/hydro-serving}} & 13                & 2               & 260            & 42             & 22               
\end{tabular}
\caption{Highly used ML and MLops repositories on Github (verified on 8/12/2022)}
\label{tab:my-table2}
\end{table}

You probably noticed that the previous set of analysis was looking at data from 2021. I’m sure you wanted to see some updated data to see if things had changed significantly. I went back and reran the same table build to create a Table 2~\ref{tab:my-table2} 2022 version. A few of the repositories changed order in terms of total stars, but for the most part things are relatively the same.

\section{Conclusion}
Machine learning is an interesting and ever expanding domain within the greater world of artificial intelligence studies. Thank you for digging into this independent study introduction to machine learning syllabus. Please keep in mind that some of the links may have stopped working over time as the internet is not durable in terms of document permanence. That is why I have included in most cases two different formats of the reference as APA sytle within the text and BibTeX in the reference file you can download from my \href{https://github.com/nelslindahlx/Introduction-to-machine-learning-syllabus-2022}{GitHub} repository that contains all the content and files from this effort. 

\section{Bonus Papers}
This section includes a few additional papers that I have enjoyed and thought you might as well. They are not sorted in any particular order. This section may see the most updates between first publication and any updates of this syllabus. I’m sure that papers will get recommended to be included and if they don’t naturally fit into the main structure without overloading the reader, then they will end up here in the bonus papers section. .

\begin{itemize}
\item \href{https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf}{Marcus, G. (2018). Deep learning: A critical appraisal. arXiv preprint arXiv:1801.00631.} \cite{marcus2018deep}
\item \href{https://arxiv.org/pdf/1912.02292.pdf}{Nakkiran, P., Kaplun, G., Bansal, Y., Yang, T., Barak, B., \& Sutskever, I. (2021). Deep double descent: Where bigger models and more data hurt. Journal of Statistical Mechanics: Theory and Experiment, 2021(12), 124003.} \cite{nakkiran2021deep} 
\item \href{https://openreview.net/pdf?id=H18WqugAb}{Lake, B., \& Baroni, M. (2018). Still not systematic after all these years: On the compositional skills of sequence-to-sequence recurrent networks.} \cite{lake2018still}
\item \href{https://arxiv.org/pdf/2104.12871.pdf}{Mitchell, M. (2021). Why AI is harder than we think. arXiv preprint arXiv:2104.12871.} \cite{mitchell2021ai} 
\item \href{http://proceedings.mlr.press/v137/biderman20a/biderman20a.pdf}{Biderman, S., \& Scheirer, W. J. (2020). Pitfalls in machine learning research: Reexamining the development cycle.} \cite{biderman2020pitfalls} 
\item \href{https://arxiv.org/pdf/1812.01074.pdf}{Henderson, P., \& Brunskill, E. (2018). Distilling information from a flood: A possibility for the use of meta-analysis and systematic review in machine learning research. arXiv preprint arXiv:1812.01074}. \cite{henderson2018distilling}
\end{itemize}


\section*{Acknowledgments}
This work product is a product of independent research based on my interest in sharing and learning about machine learning. I appreciate all of the kind words and suggestions Substack readers of \href{https://nelslindahl.substack.com/}{The Lindahl Letter} have provided over the last two years as well. If you are new to The Lindahl Letter, then please consider subscribing. New editions arrive every Friday. 

%Bibliography
\bibliographystyle{unsrt}  
\bibliography{references}  


\end{document}