Introduction to working with Big Data - Hands On

Portland State University, 1825 Southwest Broadway, Portland, 97201

Learn to work with large datasets in this hands-on workshop. We will be exploring the fundamentals of data engineering and the unique challenges of working with large datasets.

May 31, 12:00 – 2:00 AM

18
RSVP'd

RSVP Now

Key Themes

Data

About this event

Join us for an exciting workshop on working with big data. This workshop will be lead by GDG member Yaakov Bressler.


Themes we'll cover:

  • Data storage
  • Incremental data processing
  • Data orchestration
  • Data quality tests


What we'll cover:

  • Organizing large datasets (100's GB) in a data lake architecture
  • Processing large datasets with idempotency
    • incrementally
    • with a data warehouse
    • without a data warehouse ("headerless")
  • Process data with streaming approach (stretch goal)
  • (Will update this list as we finalize)


Bring your laptop!



Prerequisites: (Complete at least 1 day in advance)

  • Familiarity with python programming language
  • Familiarity with SQL
  • Python installed on your machine
    • Install poetry (dependency management)
    • Install pyenv (python version manager)
  • Install duckdb


NOTE:

Due to limited space, we have very few spots available for this workshop. (Priority will be given to PSU students or alumni.) Feel free to join the waitlist and we'll let you know when space opens up.

When

When

Friday, May 31, 2024
12:00 AM – 2:00 AM UTC

Speaker

  • Yaakov Bressler

    Headspace

    Senior Data Engineer

Facilitator

  • Keylan Petty

    Portland State University

    College of Computer Science

Host

  • Tyler C de Laguna

    GDG Portland Chapter

    Head

Organizers

  • Kyle Beechly

    Developer

  • Ian O'Gorman

    Software Developer

  • Louise Suen Morgan

    Ex-Meta

    Marketing Lead

  • Tyler C de Laguna

    Software Engineer

  • Yaakov Bressler

    Headspace

    Sr. Data Engineer

  • Isil Berkun

    Founder of DigiFab AI

  • Allison Richey

    Analyst

  • Cody Pika Tavita McGraw

    Guide on the Side, Llc.

    Event Organizer

  • Abigail Weisenbloom

    Developer

  • Evan Pierce

    Developer

  • Shouryan Nikam

    Tektronix

    Software Engineer

Contact Us