Build With AI Kisii 2026: Part 2 - Evaluating Multi-Agent Systems: From "Vibe Checks" to Data-Driven

GDG Kisii

Join GDG Kisii for yet another hands-on workshop to explore the latest in Google’s AI technologies. Learn how to build, deploy, and scale AI-powered applications using Gemini and the latest developer tools.

Mar 28, 3:00 – 4:45 PM (UTC)

55 RSVP'd

Key Themes

AIAI - Vertex AIBuild with AIGoogle CloudWorkshop / hands-on session

About this event

Build with AI 2026 is a global series of community-led events designed to help developers learn and apply Google’s latest artificial intelligence technical potential.Level: Intermediate to AdvancedPrerequisites:Completion of "Building Multi-Agent Systems with ADK" workshop (or equivalent experience)Understanding of CI/CD conceptsGoogle Cloud Platform account with billing enabledFamiliarity with Python and basic DevOps practicesDeployed multi-agent system (Researcher, Judge, Content Builder, Orchestrator)Learning ObjectivesBy the end of this workshop, participants will be able to:Understand Agent Evaluation PrinciplesDifferentiate between "vibe checks" and systematic evaluationDistinguish between offline experimentation and continuous evaluationApply LLM-as-a-Judge concepts to agent quality assessmentImplement Evaluation MetricsConfigure Vertex AI evaluation metrics (adaptive rubrics, tool-use quality, hallucination detection)Create custom trajectory-based metrics for tool usageCombine code-based and model-based gradersDeploy Safe Testing InfrastructureUse Cloud Run revision tags for shadow deploymentTest agents in production without affecting usersImplement environment parity for system-level evaluationBuild CI/CD Evaluation PipelinesAutomate evaluation in Cloud BuildImplement deploy-assess-promote workflowsSet up rollback strategies for failed evaluationsSee you there!!

Speaker

  • Mustapha Adekunle

    Nomba

    Data Engineer

Moderators

  • Anne Mburu

    Data Scientist

  • Paul Ogolla

    Kito

    Software Engineer

Partners

FieLabs logo

FieLabs

GDSC Kisii University logo

GDSC Kisii University

Organizers

  • Faith Wanyangu

    GDG Lead

  • Anne Mburu

    WTM Lead | Speakers Coordinator Lead

  • Lina Mwakitawa

    WTM Ambassador | Media and Communication Lead

  • Paul Ogolla

    Technical Lead

  • Bridget Waweru

    Lead- Design and Creative

  • Andrew Mbugua

    Software Engineer

  • PATRICIA CHUMBA

    GDG

    Logistics Management

  • Alfonce Micah Yano

    Media & Designs

  • Blonche Akong'o

    Kisii University

    Designer

  • Collins Jumah

    Cloud Lead

  • Gaudencia Omondi

    Social Media