In the feature selection process, we aim to identify a subset of the original features using various algorithms. Our goal is to select the features that contain the most relevant information about the problem at hand. To achieve this, we will utilize a set of general statistical measures. …

What’s a Decision Tree? A Decision Tree is a hierarchical learning model that divides the space using decision rules. It is a supervised machine learning algorithm used for both classification and regression problems. A Decision Tree can be represented as a flowchart-like structure where each internal node represents a feature (or attribute), each branch…

Linear Discriminant Analysis or LDA is another reduction dimensionality reduction technique for feature extraction. LDA operates in classifications, where the objective of the feature extraction transformation is to highlight the discriminative class information in a lower-dimensional space. The solution proposed by Fisher is to maximize a function that represents the…

As a Data Scientist, one of the most significant challenges in a project is dealing with large datasets that contains numerous dimensions or features. This complexity significantly hampers the data interpretations process. Obviously, a minimum number of features is needed to build a good model, however, when we have a…