Hi there 👋

• 🔭 I am Zhang Jie (张 杰).

• In 05/2024, I joined Disney Streaming as a Staff Software Engineer, where I mainly focus on data ingestion and data governance.

• I was a Senior Software Engineer at Roku Big Data Platform team for 4.5 years, where I provided data infrastructure solutions both in large scale real time streaming processing and data lake batch processing.

• Tech Stack: Flink, Spark, Kafka, Presto, Iceberg, Hive, Hadoop, Airflow, Kubernetes, Docker, AWS Stack, DataDog, Jupyter Notebook, Superset, Looker.

Real Time Streaming Processing ✅

Built a Flink & Kubenetes powered real time streaming platform which provides capabilities to build Flink streaming applications and run them on Kubernetes clusters seamlessly. Onboarded other engineering teams and promoted best streaming practices.

Data Lake Batch Processing ✅

Built and maintained a Spark & Hive & S3 & Airflow based data lake, architected and implemented distributed data ingestion and processing pipelines.