Streamlining Data Flow: Building Cloud-Based Data Pipelines - Data Engineering Process Fundamentals

Alvin Sherman Library, Research, and Information Technology Center, Nova University, 3100 Ray Ferrero Junior Boulevard, Davie, 33314

GDG Broward County - FL

Ready to transform raw data into actionable insights? This session dives into building a real-world cloud-based data pipeline for unstructured data. We'll showcase the power of data engineering to empower informed business decisions. Python, Jupyter Notebooks, VS Code, Cloud Infrastructure, Data Lakes, Data warehouse, Data Pipeline, Data Visualization, GitHub, Looker Studio.

Jun 29, 5:00 – 6:00 PM

8 RSVP'd

Key Themes

Career DevelopmentCloudCommunity BuildingData

About this event

Ready to transform raw data into actionable insights? This session dives into building a real-world cloud-based data pipeline for unstructured data. We'll showcase the power of data engineering to empower informed business decisions. Technologies: Python, SQL, Jupyter Notebooks, VS Code, Cloud Infrastructure, Data Lakes, Data Warehouse, Data Pipeline, Data Visualization, GitHub, Looker Studio.

This event is both online and in-person event, part of the SQL Saturday South Florida Conference.

Full Event Link: https://sqlsaturday.com/2024-06-29-sqlsaturday1080

RSVP from this page for the online event:

This session guides you through the essential stages of building a cloud-based data pipeline:

Agenda:

  • Discovery: We'll embark on a journey of discovery, identifying data sources, understanding business needs, and defining the scope of your data pipeline.
  • Design and Planning: Here, we'll transform insights into a well-defined blueprint. We'll discuss architecture considerations, data flow optimization, and technology selection for your cloud pipeline.
  • Data Pipeline and Orchestration: Get ready to orchestrate the magic! This stage delves into building the pipeline itself, selecting the right tools, and ensuring seamless data movement between stages.
  • Data Modeling and Data Warehouse: Data needs a proper home! We'll explore data modeling techniques and the construction of a robust data warehouse in the cloud, optimized for efficient analysis.
  • Data Analysis and Visualization: Finally, we'll unlock the power of your data. Learn how to connect your cloud pipeline to tools for insightful analysis and compelling data visualizations.

Why Attend:

  • Process Power: Learn a structured, process-oriented approach to building and managing efficient cloud data pipelines.
  • Data to Insights: Discover how to unlock valuable information from your data using Python for data analysis.
  • The Art of Visualization: Master the art of presenting your data insights through compelling data visualizations.
  • Future-Proof Your Skills: Gain in-demand cloud data engineering expertise, including data analysis and visualization techniques.  

This session equips you with the knowledge and practical skills to build a data pipelines, a crucial skill for data-driven organizations. You'll not only learn the "how" but also the "why" behind each step, empowering you to confidently design, implement, and analyze data pipelines that drive results. 


Speaker

  • Oscar Garcia

    ozkary.com

    VP of product development

Organizer

  • oscar garcia

    GDG Organizer

Contact Us