Overview
Learn the fundamentals and principal AI concepts about clustering, dimensionality reduction, reinforcement learning and deep learning to solve real-life problems.
In this course you will learn the basics of several machine learning topics to help you solve real life challenges. Unsupervised learning techniques such as clustering and dimensionality reduction are useful to make sense of large and/or high dimensional datasets that are not annotated. Deep learning is a supervised learning technique that is useful to train neural networks to solve more complicated classification and regression tasks. Finally, reinforcement learning techniques can be used to train AI agents that interact with an environment.
Using hands-on and interactive exercises you will get insight into the fundamental algorithms and basic concepts of:
Clustering is used to identify similar data/objects and patterns from your engineering datasets. It is a technique that is especially useful if you don’t have labeled or annotated data. We explain various approaches to clustering and cover how similarity and dissimilarity measures are used.
Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset. We discuss feature selection and feature extraction techniques such as Principal Component Analysis (PCA), and how and when to apply it.
Deep Learning is a family of machine learning methods based on artificial neural networks. You will learn how to build and train deep neural networks consisting of fully connected neural networks of multiple hidden layers.
Reinforcement learning teaches an AI to interact with an environment. We cover basic reinforcement learning concepts and techniques, such as how to model the system using a Markov Decision Process, and how to train an optimal policy using tabular Q-learning using the Bellman equation.
This course is designed by a team of TU Delft machine learning experts from various backgrounds, highlighting the various topics from their individual perspectives.
What You'll Learn:
- Describe the main classes of clustering techniques
- Implement k-means and hierarchical clustering
- Motivate the need and choice of dimensionality reduction techniques
- Implement Principal Component Analysis (PCA) for feature extraction
- Explain how deep neural networks work and their advantages
- Train deep neural networks for classification and regression tasks
- Explain the basic concepts and techniques of reinforcement learning
- Describe how reinforcement learning could be applied in real world applications
Quote from Learners
"Among the most valuable aspects of this course was its comprehensive coverage of cutting-edge AI topics. The deep dive into unsupervised learning, deep learning, and reinforcement learning equipped me with a robust understanding of the core mechanisms driving AI innovations today. What stood out about this course was its relevance and applicability to real-world scenarios. The practical, hands-on approach allowed me to apply theoretical knowledge to actual projects." - Tea Larson Hetrick, computer programmer and student from United States
Details
Course Syllabus:
Topic 1: Introduction
This is an introduction to the course with an overview of the topics.
Topic 2: Clustering
Clustering techniques are used to identify similar data/objects and patterns from your engineering datasets.
You will learn about the problem of clustering, the main classes of clustering techniques and how we can implement k-means and hierarchical clustering.
- Introduction to clustering
- Formalizing the problem of clustering
- Similarity and dissimilarity measures
- k-means clustering
- Hierarchical clustering
Topic 3: Dimensionality Reduction
Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset as much as possible.
You will learn what dimensionality reduction is, why it is needed and how to use it. You will learn about Principal Component Analysis dimensionality reduction technique and how and when to apply it.
- What is dimensionality reduction?
- Why dimensionality reduction techniques are used
- Feature selection vs. feature extraction techniques
- Principal component analysis feature-extraction technique
Topic 4: Introduction to Deep Learning
Deep learning is a broader family of machine learning methods based on artificial neural networks.
You will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about fully connected neural networks, some theoretical aspects of deep learning, the back-propagation algorithm, Adam, and much more.
- What neural networks are
- Architecture of fully connected neural networks
- Capabilities of neural networks
- The benefits of deep architectures
- Training deep neural networks with stochastic gradient descent and Adam
Topic 5: Introduction to Reinforcement Learning
Reinforcement learning teaches an AI to interact with an environment.
You will be introduced to basic reinforcement learning concepts and techniques, and how they could be applied in real world applications.
- How an AI interacts with the environment
- The formalization of this as a Markov Decision Process
- An agent’s behavior as a policy
- The optimal policy found using tabular Q-learning
- Why tabular reinforcement learning does not scale well
- Neural networks for deep reinforcement learning to scale up to interesting applications
Admission
This is a Massive Open Online Course (MOOC) that runs on edX.
Prerequisites
- Basic linear algebra
- Basic Python programming skills
