Week 1 : Practical Aspects of Deep Learning

Week 2: Optimization Algorithms

Week 3: Hyperparameter Tuning, Batch Normalization and Programming Frameworks

References:

• Introduction to gradients and automatic differentiation (TensorFlow Documentation)
• tf.GradientTape (TensorFlow Documentation)
• Intro to optimization in deep learning: Gradient Descent (paperspace.com)

Week 3:

• Introduction to gradients and automatic differentiation (TensorFlow Documentation)
• tf.GradientTape (TensorFlow Documentation)