Road to Devfest Workshop 2: Building Model and Training With Pytorch

Important Resources

- https://github.com/Bridge-Labs-Tech/ghana-ai-hackathon-25/tree/main/workshop-2

- https://www.youtube.com/watch?v=wyPoIGIgW_A

Dataset preparation

- Multimodarity

- Data augmentation

- Dataset Loaders

Model Creation (Overview of different models)

- Overview of the Transformer

- Creating a Transformer model

Training the Model

- Resuming

- Saving checkpoints

- Moving model to s3 storage

- Kaggle Notebook

Tips and Considerations

- When do you really need AI?

- Specialized vs General Model?

Resources

- Multimodal Learning with Transformers

- MMT: Multi-way Multi-modal Transformer for Multimodal Learning