Mixture-of-Experts in Deep Learning: Applications and Theory

3551 Cullen Blvd, 3551 Cullen Boulevard, Houston, 77004

GDG Houston

Mixture-of-Experts is a powerful approach that leverages the strengths of multiple specialized models to tackle complex problems, offering improved performance and efficiency in various machine learning applications. In this talk, Dr. Lin will cover the basics of MoE and its recent development in large language models. Furthermore, he will briefly introduce the theory behind MoE under different se

Jun 26, 4:00 – 5:00 PM

5 RSVP'd

Key Themes

Build with AI

About this event

Mixture-of-Experts is a powerful approach that leverages the strengths of multiple specialized models to tackle complex problems, offering improved performance and efficiency in various machine learning applications. In this talk, Dr. Lin will cover the basics of MoE and its recent development in large language models. Furthermore, he will briefly introduce the theory behind MoE under different setups to better understand its performance in practice.

When

When

Wednesday, June 26, 2024
4:00 PM – 5:00 PM UTC

Speaker

  • Lin Sen

    University Of Houston

    Professor

Facilitator

  • Rabimba Karanjai

    Rice University

    Graduate Researcher

Host

  • Rabimba Karanjai

    Rice University

    Graduate Researcher

Partner

University Of Houston - Computer Science Graduate Student Association (CSGSA) logo

University Of Houston - Computer Science Graduate Student Association (CSGSA)

Organizers

  • Vishal Pallerla

    Organizer

  • Rabimba Karanjai

    Google Developer Expert

Contact Us