Skip to content

Akomand/AEOP_Research_2021

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Summer 2021 AEOP Research Guide

Welcome to the Army Educational Outreach Program for Summer 2021 at the University of Arkansas!

Team 1: Question Answering

Week 1 will be a crash course on basic machine learning concepts from basic classifiers to deep neural networks. Week 2 will be crash course on NLP and a practical application of deep neural networks to text processing. Week 3-6 will be focused on researching a topic, performing experiments, and writing a paper. There will be workshops on paper reading and writing as well.

Program Schedule

Week Activity
Week 1 Introduction to Machine Learning, Tools, and Research

Tuesday: Introduction Machine Learning & Research
Wednesday: Univariate and Multivariate Linear Regression
Thursday: Logistic Regression
Friday: Neural Networks
Week 2 Introduction to Natural Language Processing

Monday: Text preprocessing and data exploration
Tuesday: Topic Modeling
Wednesday: Sequence Models & Attention
Thursday: Transformers
Friday: Fine-tuning pre-trained models
Week 3 Reading Research Papers and Writing in LaTex

Monday: Reading Research (HW: Read 1 paper)
Tuesday: Researching a topic of interest
Wednesday: Writing Workshop
Thursday: Paper Presentations
Friday: Fine-tuning models w/ HuggingFace
Week 4 Project work week, Read Papers

Monday: Choose a direction for paper
Tuesday: Explore Datasets
Wednesday: Preprocess text data
Thursday: Run models
Friday: Run models
Week 5 Writing Paper week

Monday: Begin writing Introduction of paper
Tuesday: Write background section
Wednesday: Write experiments section
Thursday: Write Abstract and Conclusion section
Friday: Writing Workshop
Week 6 Wrapping up the project and finish writing paper

Monday: Polish up paper and look into publication
Tuesday: Q&A day
Wednesday: Q&A day
Thursday: Tips for future research and Q&A
Friday: Final Presentation

Introduction to Machine Learning

3Blue1Brown Youtube Channel for linear algebra and neural networks intuition: https://www.youtube.com/c/3blue1brown/playlists

Research Resources

Google Scholar: https://scholar.google.com/
Arxiv (Search for research papers): https://arxiv.org/
Connected Papers: https://www.connectedpapers.com/
Paperswithcode: https://paperswithcode.com/
IEEE Xplore: https://ieeexplore.ieee.org/Xplore/home.jsp

Writing Resources

Overleaf (online LaTex editor): https://www.overleaf.com

Programming/Implementation

PyTorch website: https://pytorch.org/
HuggingFace Transformers: https://huggingface.co/transformers/