Difference between revisions of "SVM"
| (7 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| − | < | + | == Support Vector Machines == |
| + | <font>Support Vector Machines (SVM) are a class of machine learning algorithms used for classification and regression tasks. In a classification problem, SVMs aim to find an optimal hyperplane that separates different classes of data points with the largest possible margin. The hyperplane is a decision boundary that maximizes the distance between the nearest data points from each class, known as support vectors. SVMs can handle both linearly separable and non-linearly separable data by employing various kernel functions. The idea behind SVMs is to transform input data into a higher-dimensional feature space using the kernel trick, which allows the algorithm to find a linear separation in this transformed space. This transformation enables SVMs to handle complex decision boundaries that may not be linear in the original feature space. During the training phase, SVMs aim to find the optimal hyperplane by solving a quadratic optimization problem. The objective is to minimize the classification error while maximizing the margin. The margin is defined as the perpendicular distance between the hyperplane and the support vectors. By maximizing the margin, SVMs tend to produce a more robust and generalized model. In addition to binary classification, SVMs can be extended to handle multi-class problems using techniques such as one-vs-one or one-vs-all classification. SVMs also have a formulation for regression tasks, known as Support Vector Regression (SVR), where the objective is to fit the data while limiting the deviations within a certain margin. SVMs have several advantages, such as their ability to handle high-dimensional data, effective generalization, and resistance to overfitting. They can be computationally expensive, particularly with large datasets, and the selection of the appropriate kernel and its parameters can be challenging.</font> | ||
| + | |||
| + | |||
| + | <u><b>The following are some useful YouTube videos:</b></u> | ||
| + | <html> | ||
| + | <head> | ||
| + | <title>YouTube Video Click-to-Play</title> | ||
| + | </head> | ||
| + | <body> | ||
| + | <div id="video-container"> | ||
| + | </div> | ||
| + | |||
| + | <script> | ||
| + | function loadVideo(videoId) { | ||
| + | var container = document.getElementById('video-container'); | ||
| + | var videoUrl = 'https://www.youtube.com/embed/' + videoId; | ||
| + | |||
| + | var iframe = document.createElement('iframe'); | ||
| + | iframe.src = videoUrl; | ||
| + | iframe.width = 960; | ||
| + | iframe.height = 540; | ||
| + | iframe.setAttribute('allow', 'autoplay'); | ||
| + | container.innerHTML = ''; // Clear existing content | ||
| + | container.appendChild(iframe); | ||
| + | } | ||
| + | </script> | ||
| + | </body> | ||
| + | </html> | ||
| + | |||
| + | === <u>Part 1</u> === | ||
| + | <font><i>A run down of what SVMs are and what they can be used for. All of the necessary background to get started with using SVMs.</i></font> <br> | ||
| + | <html> | ||
| + | <head> | ||
| + | <title>YouTube Video Click-to-Play</title> | ||
| + | </head> | ||
| + | <body> | ||
| + | <div id="video-container"> | ||
| + | <button onclick="loadVideo('efR1C6CvhmE')">SVM: Main Ideas</button> <font size="1" color="blue">← Click-to-play</font> | ||
| + | </div> | ||
| + | </body> | ||
| + | </html> | ||
| + | [https://www.youtube.com/watch?v=efR1C6CvhmE Support Vector Machines Main Ideas] <br> | ||
| + | |||
| + | |||
| + | === <u>Part 2</u> === | ||
| + | <font><i>A mathematical description of the Polynomial Kernel and how SVMs use this type of kernel to classify data. This video describes how the Polynomial Kernel classifies data in a set number of dimensions.</i></font> <br> | ||
| + | <html> | ||
| + | <head> | ||
| + | <title>YouTube Video Click-to-Play</title> | ||
| + | </head> | ||
| + | <body> | ||
| + | <div id="video-container"> | ||
| + | <button onclick="loadVideo('Toet3EiSFcM')">SVM: The Polynomial Kernel</button> <font size="1" color="blue">← Click-to-play</font> | ||
| + | </div> | ||
| + | |||
| + | <script> | ||
| + | function loadVideo(videoId) { | ||
| + | var container = document.getElementById('video-container'); | ||
| + | var videoUrl = 'https://www.youtube.com/embed/' + videoId; | ||
| + | |||
| + | var iframe = document.createElement('iframe'); | ||
| + | iframe.src = videoUrl; | ||
| + | iframe.width = 960; | ||
| + | iframe.height = 540; | ||
| + | iframe.setAttribute('allow', 'autoplay'); | ||
| + | container.innerHTML = ''; // Clear existing content | ||
| + | container.appendChild(iframe); | ||
| + | } | ||
| + | </script> | ||
| + | </body> | ||
| + | </html> | ||
| + | [https://www.youtube.com/watch?v=Toet3EiSFcM The Polynomial Kernel] <br> | ||
| + | |||
| + | |||
| + | === <u>Part 3</u> === | ||
| + | <font><i>A mathematical description of the Radial Kernel and how SVMs use this type of kernel to classify data. This video describes how the RBF classifies data in infinite dimensions.</i></font> <br> | ||
<html> | <html> | ||
<head> | <head> | ||
| Line 6: | Line 82: | ||
<body> | <body> | ||
<div id="video-container"> | <div id="video-container"> | ||
| − | <button onclick="loadVideo()">Click to | + | <button onclick="loadVideo('Qc5IyLW_hns')">SVM: The Radial (RBF) Kernel</button> <font size="1" color="blue">← Click-to-play</font> |
</div> | </div> | ||
<script> | <script> | ||
| − | function loadVideo() { | + | function loadVideo(videoId) { |
var container = document.getElementById('video-container'); | var container = document.getElementById('video-container'); | ||
| − | var videoUrl = 'https://www.youtube.com/embed/ | + | var videoUrl = 'https://www.youtube.com/embed/' + videoId; |
var iframe = document.createElement('iframe'); | var iframe = document.createElement('iframe'); | ||
iframe.src = videoUrl; | iframe.src = videoUrl; | ||
| − | iframe.width = | + | iframe.width = 960; |
| − | iframe.height = | + | iframe.height = 540; |
iframe.setAttribute('allow', 'autoplay'); | iframe.setAttribute('allow', 'autoplay'); | ||
container.innerHTML = ''; // Clear existing content | container.innerHTML = ''; // Clear existing content | ||
| Line 25: | Line 101: | ||
</body> | </body> | ||
</html> | </html> | ||
| + | [https://www.youtube.com/watch?v=Qc5IyLW_hns The Radial (RBF) Kernel] <br> | ||
| + | <br> | ||
Latest revision as of 19:40, 22 May 2023
Support Vector Machines
Support Vector Machines (SVM) are a class of machine learning algorithms used for classification and regression tasks. In a classification problem, SVMs aim to find an optimal hyperplane that separates different classes of data points with the largest possible margin. The hyperplane is a decision boundary that maximizes the distance between the nearest data points from each class, known as support vectors. SVMs can handle both linearly separable and non-linearly separable data by employing various kernel functions. The idea behind SVMs is to transform input data into a higher-dimensional feature space using the kernel trick, which allows the algorithm to find a linear separation in this transformed space. This transformation enables SVMs to handle complex decision boundaries that may not be linear in the original feature space. During the training phase, SVMs aim to find the optimal hyperplane by solving a quadratic optimization problem. The objective is to minimize the classification error while maximizing the margin. The margin is defined as the perpendicular distance between the hyperplane and the support vectors. By maximizing the margin, SVMs tend to produce a more robust and generalized model. In addition to binary classification, SVMs can be extended to handle multi-class problems using techniques such as one-vs-one or one-vs-all classification. SVMs also have a formulation for regression tasks, known as Support Vector Regression (SVR), where the objective is to fit the data while limiting the deviations within a certain margin. SVMs have several advantages, such as their ability to handle high-dimensional data, effective generalization, and resistance to overfitting. They can be computationally expensive, particularly with large datasets, and the selection of the appropriate kernel and its parameters can be challenging.
The following are some useful YouTube videos:
Part 1
A run down of what SVMs are and what they can be used for. All of the necessary background to get started with using SVMs.
Support Vector Machines Main Ideas
Part 2
A mathematical description of the Polynomial Kernel and how SVMs use this type of kernel to classify data. This video describes how the Polynomial Kernel classifies data in a set number of dimensions.
Part 3
A mathematical description of the Radial Kernel and how SVMs use this type of kernel to classify data. This video describes how the RBF classifies data in infinite dimensions.