Join us for a technical walkthrough on setting up ingestion pipelines for both batch and streaming data loading data directly into Google BigQuery. We’ll cover the specifics on how to create Dataflow jobs designed to reduce the complexity, pain, and engineering time of onboarding a new dataset to BigQuery. We’ll also demonstrate how to gain insights from the data quickly using BigQuery showing concepts such as schema creation and query and cost analysis.

This presentation will cover a variety of Google Cloud technologies including:
- Dataflow
- BigQuery
- PubSub
- Cloud Shell
- GCS

This is part 2 of our 3 part series on building an end-to-end data pipeline in Google Cloud. You don't have to have been to the prior meetings to get the benefits of this session.