MapReduce, Spark, Java, and Scala for Data Algorithms Book

Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.

Use the MapReduce's Java interface to distributed crawle the data of Chinese universities and learn basic knowledge of hdfs.

Tutorials on Big Data essentials: Hadoop, MapReduce, Spark. Explore a variety of tutorials and demonstrations on Big Data technologies, primarily in the form of Jupyter notebooks. Most notebooks are self-contained and live—ready to run with a click.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Big data projects implemented by Maniram yadav

K-Means algorithm implementation with Hadoop and Spark for the course of Cloud Computing of the MSc AIDE at the University of Pisa.

A collection of mapreduce problems and solutions

This contain how to install Hadoop on google colab and how to run map-reduce in Hadoop

Hadoop MapReduce word counting with Java

Projects done in the Cloud Computing course.

中文文本挖掘|舆情分析|Hadoop|Java|MapReduce

Source code for the examples in the book Cloud Computing Solutions Architect: A Hands-On Approach by Arshdeep Bahga and Vijay Madisetti

Student projects in Big Data field.

Data Engineering Course

Helm chart for Apache Hadoop using multi-arch docker images

2021 Spring (Distributed Computing Systems) 分布式系统与编程

Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton

Search Engine projects