Scan AI

Instructor led workshop

This workshop teaches you techniques for training deep neural networks on multi-GPU technology to shorten the training time required for data-intensive applications. Working with deep learning tools, frameworks, and workflows to perform neural network training, you’ll learn concepts for implementing Horovod multi-GPUs to reduce the complexity of writing efficient distributed software and to maintain accuracy when training a model across many GPUs.

Learning Objectives

At the conclusion of the workshop, you’ll understand:
• Stochastic gradient descent (SGD), a crucial tool in parallelised training
• Batch size and its effect on training time and accuracy
• Transforming a single-GPU implementation to a Horovod multi-GPU implementation
• Techniques for maintaining high accuracy when training across multiple GPUs

Workshop Details

Duration:
8 hours

Price:
£75 per person

Prerequisites:
Experience with gradient descent model training

Technologies:
TensorFlow, Keras, Horovod

Assessment Type:
Code-based

Certificate:
Upon completion of the assessment, participants will receive an NVIDIA DLI certificate to recognise their subject matter competency and support professional career growth.

Hardware Requirements:
Desktop or laptop computer capable of running the latest version of Chrome or Firefox. Each participant will be provided with dedicated access to a fully configured, GPU-accelerated server in the cloud.”

Agenda:
10:00-10:15 Intro
10:15-12:00 Stochastic Gradient Descent
12:00-13:00 Lunch Break
13:00-14:20 Introduction to Distributed Training
14:20-14:30 Coffee Break
14:30-15:00 Run:AI Presentation
15:00-16:15 Algorithmic Challenges of Distributed SGD
16:15-16:30 Q&A

Register now