Fundamentals of Deep
Training you to solve the World’s most challenging problems.
Instructor led workshop
This workshop teaches you techniques for training deep neural networks on multi-GPU technology to shorten the training time required for data-intensive applications. Working with deep learning tools, frameworks, and workflows to perform neural network training, you’ll learn concepts for implementing Horovod multi-GPUs to reduce the complexity of writing efficient distributed software and to maintain accuracy when training a model across many GPUs.
At the conclusion of the workshop, you’ll understand:
• Stochastic gradient descent (SGD), a crucial tool in parallelised training
• Batch size and its effect on training time and accuracy
• Transforming a single-GPU implementation to a Horovod multi-GPU implementation
• Techniques for maintaining high accuracy when training across multiple GPUs
£75 per person
Experience with gradient descent model training
TensorFlow, Keras, Horovod
Upon completion of the assessment, participants will receive an NVIDIA DLI certificate to recognise their subject matter competency and support professional career growth.
Desktop or laptop computer capable of running the latest version of Chrome or Firefox. Each participant will be provided with dedicated access to a fully configured, GPU-accelerated server in the cloud.”
10:15-12:00 Stochastic Gradient Descent
12:00-13:00 Lunch Break
13:00-14:20 Introduction to Distributed Training
14:20-14:30 Coffee Break
14:30-15:00 Run:AI Presentation
15:00-16:15 Algorithmic Challenges of Distributed SGD