Introduction
Although most of the applications of Machine Learning today are based on supervised learning (and as a result, this is where most of the investments go to), the vast majority of the available data is actually unlabeled: we have the input features X, but we do not have the labels y. Yann LeCun famously said that “if intelligence was a cake, unsupervised learning would be the cake, supervised learning would be the icing on the cake, and reinforcement learning would be the cherry on the cake”. In other words, there is a huge potential in unsupervised learning that we have only barely started to sink our teeth into.
For example, say you want to create a system that will take a few pictures of each item on a manufacturing production line and detect which items are defective. You can fairly easily create a system that will take pictures automatically, and this might give you thousands of pictures every day. You can then build a reasonably large dataset in just a few weeks. But wait, there are no labels! If you want to train a regular binary classifier that will predict whether an item is defective or not, you will need to label every single picture as “defective” or “normal”. This will generally require human experts to sit down and manually go through all the pictures. This is a long, costly and tedious task, so it will usually only be done on a small subset of the available pictures. As a result, the labeled dataset will be quite small, and the classifier’s performance will be disappointing. Moreover, every time the company makes any change to its products, the whole process will need to be started over from scratch. Wouldn’t it be great if the algorithm could just exploit the unlabeled data without needing humans to label every picture? Enter unsupervised learning.Previously we looked at the most common unsupervised learning task: dimensionality reduction. In this chapter, we will look at a few more unsupervised learning tasks band algorithms:
- Clustering: the goal is to group similar instances together into clusters. This is a great tool for data analysis, customer segmentation, recommender systems, search engines, image segmentation, semi supervised learning, dimensionality reduction, and more.
- Anomaly detection: the objective is to learn what “normal” data looks like, and use this to detect abnormal instances, such as defective items on a production line or a new trend in a time series.
- Density estimation: this is the task of estimating the probability density function (PDF) of the random process that generated the dataset. This is commonly used for anomaly detection: instances located in very low-density regions are likely to be anomalies. It is also useful for data analysis and visualization.
Applications and Use Cases:
Unsupervised learning finds applications in a myriad of fields, from anomaly detection in cybersecurity to pattern recognition in image processing. We’ll explore some fascinating real-world use cases of unsupervised learning, highlighting how clustering and dimensionality reduction techniques are leveraged to extract valuable insights from data.
Challenges and Best Practices:
While unsupervised learning offers immense opportunities, it also presents challenges such as choosing the right algorithms, handling outliers, and interpreting results accurately. We’ll discuss some best practices for overcoming these challenges and maximizing the effectiveness of unsupervised learning in practical scenarios.
Conclusion:
In conclusion, unsupervised learning serves as a cornerstone in the realm of machine learning, offering powerful tools for extracting meaningful patterns and structures from unlabeled data. By understanding the principles of clustering and dimensionality reduction, we can unlock new possibilities for data analysis, exploration, and decision-making. Whether you’re a data scientist, researcher, or enthusiast, embracing unsupervised learning opens doors to a world of discovery and innovation.
Ready for some cake? We will start with clustering, using K-Means and DBSCAN, and then we will discuss Gaussian mixture models and see how they can be used for density estimation, clustering, and anomaly detection.