Build a 3D Flight Simulator with AI

Bored of integrating chatbots? Start building worlds! This workshop shows you how to connect 3D geospatial data to generative vision models.

The Reality Terraformer

You will build a 3D flight simulator. The simulator uses real topology from Google Maps. You will write the flight logic and user interface with AI assistance. The main feature is a system that repaints the world in real-time. You can fly over your city and turn it into a sci-fi metropolis or a different planet. The best part? You can run this entirely from Chrome!

The Generative Bridge

We connect a 3D engine to a Python pipeline. We fetch satellite imagery from Google Earth Engine and use Vertex AI to edit the terrain based on your text prompts. The new textures project back onto the 3D globe as you fly.

Our Stack

- Google Maps Photorealistic 3D Tiles

- Google Earth Engine

- Vertex AI

- Gemini 3.1

- Python Backend

Workflow

- Architecture. We deconstruct the pipeline between the 3D engine and the vision model.

- Guided Build. We write the HUD and the flight physics together.

- Individual Challenges. You take control. You can add biome selectors or work on memory management for the browser.

Requirements

Bring a laptop and a power cable. Tablets and phones are not supported for this session.

Update on Location: Good news! You won't have to pack up and move halfway through the event. We are hosting the full 'Build with AI' Codelab session and our concluding Social Hour together at Roberto's Cantina on Murphy St in Sunnyvale.