Join GDG Cloud Oslo for an exciting, hands-on hack-along focused on running Large Language Models (LLMs) securely in your local environment using Google's open weights model, Gemma. Dive into the mechanics of local LLMs, exploring essential practices to ensure security, predictability, and robustness. This workshop will provide architectural patterns and Java-based code examples, but feel free to use your preferred language to implement these security measures.

To kickstart the workshop, we have prepared complete architectural patterns and code examples implemented in Java. However, this is a polyglot-friendly event! We highly welcome and encourage you to take these blueprints and implement the same security and predictability patterns in Python, Go, TypeScript, Rust, or any language of your choice.

🚀 Agenda

• Part 1: Gemma Intro & The Anatomy of Local LLMs
  Get up to speed with Google's Gemma model family. We'll discuss why running models locally is a game-changer, how the architecture works, and why local execution helps keep your data private.

• Part 2: The Core Challenge – Security & Predictability
  Using practical concepts and real-world vulnerabilities (inspired by OWASP Top 10 for LLMs), we will discuss why AI models can sometimes behave unpredictably. Learn how to tame non-deterministic outputs, avoid injection risks, and configure boundaries to ensure predictable behavior.

• Part 3: Hands-On Hack-Along! 💻
  Bring your laptops! We will provide ready-to-run Java architectural patterns to guide your implementation. You can dive straight into the Java codebase or use it as a reference blueprint to rebuild the same secure LLM pipelines in your favorite programming language.

🎒 What to Bring

• Your laptop and charger.

• Your IDE of choice configured for your preferred language (Java, Python, Node, etc.).

• A curious mindset ready to code and break things safely!

• (Optional) Pre-install Ollama or Docker if you want a head start on running Gemma locally.

Food and drinks will be provided! Space is limited, so make sure to RSVP early.