ONLINE: Intel® AI HPC Workshop #2: Deep Learning Module

The demand of using Deep Learning techniques in many scientific domains is rapidly emerging and the requirements for large compute and memory resources is increasing. One of the consequences is the need of the high-performance computing capability for processing and inferring the valuable information inherent in the data. The Leibniz Supercomputing Centre (LRZ) has recently installed its new high-end system, SuperMUC-NG. Based on Intel^® technology, it targets among others also workloads at the crossroads of AI and HPC.

In this session you will learn various optimization methods to improve the runtime performance of Deep Learning algorithms on Intel^® architecture. We cover how to accelerate the training of deep neural networks with TensorFlow, thanks to the highly optimized Intel^® Deep Neural Network Library (DNNL). We also demonstrate techniques on how to leverage deep neural network training on multiple nodes on an HPC cluster.

Schedule:

13:30 - 14:45   Deep Learning – Optimized training instances

• Performance Optimized Deep Learning Frameworks solutions from Intel^®
  • TensorFlow and PyTorch optimizations for CPU via Intel^® DNNL
  • Distributed (data parallel) deep learning training with Horovod on a CPU cluster
  • Large memory (100 GB to 1.5 TB) training with TensorFlow
  • Federated Learning

 14:45 – 15:15 Hands On Session

• Intel^®-Optimized Tensorflow

15:15-15:30:    Coffee Break

15:30-16:30    Deep Learning – Optimized inference instances

• Performance Optimized Deep Learning Inference using the Intel^®distribution of the OpenVINO toolkit
  • What is OpenVINO?
  • Case studies from industry
  • Model Serving
  • Creating an inference pipeline for OpenVINO

 16:30 - 17:00    Hands On Session

• AI Inference with the Intel Distribution of OpenVINO

Basic knowledge of Python

Participation (or comparable previous knowledge) in

• Introduction to GNU/Linux and SSH
• Introduction to the LRZ HPC Infrastructure

G Anthony Reina (Intel®), Ravi Panchumarthy (Intel®)

If you attended this course, please don't forget to rate it. We highly appreciate your feedback:
https://survey.lrz.de/index.php/313151