introduction to Gemini Embeddings 2

GDG Oxford

We will dissect the model's native multimodal architecture, focusing on how it maps text, images, video, audio, and docu...

Jun 13, 11:00 AM – 12:00 PM (UTC)

8 RSVP'd

Key Themes

AIAI - GeminiBuild with AIGoogle CloudWorkshop / hands-on session

About this event

We will dissect the model's native multimodal architecture, focusing on how it maps text, images, video, audio, and documents into a single, unified embedding space with an 8,192-token input capacity. Key topics include:

  • Matryoshka Representation Learning (MRL): The mechanics behind flexible output dimensions (ranging from 128 to 3072 dimensions) and how to leverage variable-size embeddings to optimize vector database footprints and query latency without critical loss in retrieval accuracy.

  • Cross-Modal Semantic Alignment: An analysis of the mathematical alignment between disparate modalities and multilingual data across more than 100 languages.

  • Pipeline De-duplication for RAG: Evaluating how native multimodal ingestion reduces pipeline complexity, removing the need for disjointed upstream parsing or auxiliary embedding systems in Retrieval-Augmented Generation architectures.

Part 2: Code Lab

A hands-on, developer-focused workshop dedicated to implementing and scaling retrieval infrastructure using the Gemini API and Google AI Studio. Participants will programmatically build and configure:

  • Multimodal Vector Generation: Ingesting and embedding mixed-input datasets containing text, document layouts, and multimedia files.

  • MRL Dimension Scaling: Writing logic to truncate and normalize vector output dimensions dynamically based on performance and storage constraints.

  • Cross-Modal Search Engine: Building an end-to-end index and retrieval script to execute semantic queries across different media types, establishing a grounded backbone for advanced RAG workflows.

Organizers

  • Gregory McGann

    United Nations

    GDG Oxford

  • Juhi Kore

    Board Member

  • Lea Corsetti

    Board Member