Programming Study日本語

Disclosure: We earn a commission from Udemy when you buy a course through links on this page.

Real time Data Pipeline using GCP & Confluent platforms

Real time Data Pipeline using GCP & Confluent platforms

Udemy · English

About this course

Language
English
Category
Provider
Udemy
Data updated

Course OverviewIn this hands-on course, participants will follow a step-by-step approach to build a real-time streaming analytics data pipeline that integrates Confluent Kafka with Google Cloud Platform services. Learners will design a real time streaming pipeline that streams data from Kafka into Google Cloud Storage, processes it with GCP Cloud Run Function, stores it in GCP Cloud SQL Postgres DB, and finally visualizes operational insights using Looker Studio. This practical journey ensures participants not only grasp the concepts but also apply them directly in a cloud-native environment. Google Cloud Platform ExperienceOn the GCP side, participants will gain exposure to key services including Cloud Run Functions, Secrets Manager, Cloud SQL Postgres DB, and Looker Studio. They will also learn essential skills in logging, monitoring, troubleshooting, and configuration, which are critical for building secure, scalable, and reliable streaming applications in the cloud. Confluent Kafka ExperienceOn the Kafka side, learners will set up a fully managed Kafka cluster, create topics for message streaming, configure a Datagen Source Connector to simulate real-world data ingestion, and integrate with GCP Functions Sink Connector. This provides valuable hands-on experience with enterprise-grade Kafka infrastructure—without the complexity of managing it manually. Learning OutcomesBy the end of the course, participants will have: Built a working, scalable real time streaming data pipeline. Gained insights into cloud-native architectures and streaming design patterns. Acquired hands-on skills directly applicable to real-world projects and professional roles. Who Should AttendThis hands-on course is…

Courses in the same category