← Back to all courses
Course 04 of 10

Deep Learning

Neural Networks, CNN, RNN, Transformers
18 classes4+ projects20 days · June 202604 Deep-Learning

Build and train neural networks from first principles to modern architectures — CNNs for vision, RNNs and LSTMs for sequences, and the Transformers behind today's AI.

How links work here: every class, project, notes, code and interview-prep link for this course opens the main course folder on GitHub — https://github.com/waleedkhokar/python-ai-engineering-journey/tree/main/04%20Deep-Learning — so you always land in the right place, never on a guessed sub-folder.

What You Will Learn

Neural NetworksActivation FunctionsBackpropagationRegularizationCNNsRNNs & LSTMTransformersTransfer LearningGANsComputer VisionNLP

All Classes

Every class in this course, in order — with exactly what each class teaches. Notes, code and interview prep for each class live in the course folder on GitHub.

00

Setup & Environment

PyTorch, TensorFlow, GPU / CUDA, Jupyter, the libraries you need.

01

Deep Learning Fundamentals

AI vs ML vs DL, neural networks, tensors, computational graphs, the deep learning workflow.

02

Neural Networks Basics

Neurons, layers, weights, bias, forward propagation, nn.Module, nn.Linear.

03

Activation Functions

Sigmoid, Tanh, ReLU, Leaky ReLU, ELU, Softmax, vanishing gradients.

04

Loss Functions & Optimizers

MSE, MAE, cross-entropy, SGD, Momentum, Adam, learning-rate schedules.

05

Backpropagation

The forward pass, gradients, the chain rule, requires_grad, .backward(), the optimizer step.

06

Regularization

Dropout, weight decay, L1 / L2, early stopping, batch norm, layer norm.

07

CNNs

Convolution, filters, feature maps, stride, padding, pooling, image classification.

08

RNNs

Sequential data, hidden state, many-to-one and many-to-many, vanishing gradients.

09

LSTM & GRU

Forget, input and output gates, cell state, GRU, long-term dependencies.

10

Transformers

Attention, self-attention, multi-head attention, positional encoding, encoder / decoder.

11

Transfer Learning

Pretrained models, feature extraction, fine-tuning, ResNet, VGG, EfficientNet.

12

Autoencoders

Encoder, latent space, decoder, reconstruction, anomaly detection, denoising.

13

GANs

Generator, discriminator, adversarial training, mode collapse, DCGAN.

14

Computer Vision

Image preprocessing, augmentation, classification, detection, segmentation, OCR.

15

NLP with Deep Learning

Embeddings, RNN / LSTM for NLP, text classification, sentiment, seq2seq, attention.

16

Model Deployment

Save and load models, inference, FastAPI, Docker, batch and real-time inference.

17

Deep Learning Projects

ANN, CNN, transfer learning and NLP projects, end to end.

Projects in this course

Build them all — each project lives in the course folder on GitHub.

Interview Preparation

Every class in this course includes interview preparation. Open the course folder on GitHub for the full material.

Common Interview Questions

The questions interviewers actually ask on this course's topics, with clear, structured answers.

Open Interview Prep

Coding Challenges

Hands-on problems for each class, so you can prove the skill, not just describe it.

Open Interview Prep

Common Mistakes to Avoid

The errors beginners make with these topics — and how professionals avoid them.

Open Interview Prep

Best Practices

How working engineers write this code in production: clean, tested and maintainable.

Open Interview Prep
← Previous Course
03 · Machine Learning