Learn how to process data in real-time by building fluency in modern data engineering tools, such as Apache Spark, Kafka, Spark Streaming, and Kafka Streaming. You'll start by understanding the components of data streaming systems. You'll then build a real-time analytics application. Students will also compile data and run analytics, as well as draw insights from reports generated by the streaming console.

PREREQUISITE KNOWLEDGE
To be successful in this program, you should have intermediate Python and SQL skills, as well as experience with ETL.

Foundations of Data Streaming
Learn the fundamentals of stream processing, including how to work with the Apache Kafka ecosystem, data schemas, ApacheAvro, Kafka Connect and REST proxy, KSQL, and Faust Stream Processing.

OPTIMIZE CHICAGO PUBLIC TRANSIT
Streaming API Development and Documentation
Grow expertise in the components of streaming data systems, and learn how to build a real-time analytics application. Understand the dimensions of Spark streaming, ingest streaming data to Apache Spark Structured Streaming, and integrate Spark streams into Kafka.

ANALYZE SAN FRANCISCO CRIME RATE