{"id":6236,"date":"2019-09-12T09:36:49","date_gmt":"2019-09-12T13:36:49","guid":{"rendered":"https:\/\/blog.brainstation.io\/?p=6236"},"modified":"2021-01-28T17:03:39","modified_gmt":"2021-01-28T22:03:39","slug":"machine-learning-supervised-unsupervised-reinforcement","status":"publish","type":"post","link":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement","title":{"rendered":"Machine Learning 101: Supervised, Unsupervised, Reinforcement, and Beyond"},"content":{"rendered":"\n

Machine learning is an essential part of being a Data Scientist<\/a>. In simplest terms, machine learning uses algorithms to discover patterns and make predictions. <\/span>It’s one of the more popular methods used to process large amounts of raw data and will only increase in popularity as more companies try to make data-driven decisions.<\/p>\n\n\n\n

Machine learning<\/a> encompasses a vast set of ideas, tools, and techniques that Data Scientists and other professionals use. We’ve explained these concepts more broadly<\/a>, but this time, let’s take a look<\/span> at some of the specific components, and how they can be used to solve problems.<\/span><\/p>\n\n\n\n

Supervised Machine Learning<\/strong><\/h2>\n\n\n\n

The most straightforward tasks fall under the umbrella of <\/span>supervised learning<\/b>. <\/span><\/p>\n\n\n\n

In supervised learning, we have access to examples of correct input-output pairs that we can show to the machine during the training phase. The common example of handwriting recognition is typically approached as a supervised learning task. We show the computer a number of images of handwritten digits along with the correct labels for those digits, and the computer learns the patterns that relate images to their labels.<\/span><\/p>\n\n\n\n

Learning how to perform tasks in this way, by explicit example, is relatively easy to understand and straightforward to implement, but there is a crucial task: We can only do it if we have access to a dataset of correct input-output pairs. In the handwriting example, this means that at some point we need to send a human in to classify the images in the training set. This is laborious work and often infeasible, but where the data does exist, supervised learning algorithms can be extremely effective at a broad range of tasks.<\/span><\/p>\n\n\n\n

Regression and Classification<\/h2>\n\n\n\n

Supervised machine learning tasks can be broadly classified into two subgroups: <\/span>regression<\/b> and <\/span>classification<\/b>. Regression is the problem of estimating or predicting a continuous quantity. What will be the value of the S&P 500 one month from today? How tall will a child be as an adult? How many of our customers will leave for a competitor this year? These are examples of questions that would fall under the umbrella of regression. To solve these problems in a supervised machine learning framework, we would gather past examples of \u201cright answer\u201d input\/output pairs that deal with the same problem. For the inputs, we would identify <\/span>features<\/b> that we believe would be predictive of the outcomes that we wish to predict. <\/span><\/p>\n\n\n\n

For the first problem, we might try to gather as features the historical prices of stocks under the S&P 500 on given dates along with the value of the S&P 500 one month later. This would form our training set, from which the machine would try to determine some functional relationship between the features and eventual S&P 500 values.<\/span><\/p>\n\n\n\n

Classification <\/b>deals with assigning observations into discrete categories, rather than estimating continuous quantities. In the simplest case, there are two possible categories; this case is known as <\/span>binary classification<\/b>. Many important questions can be framed in terms of binary classification. Will a given customer leave us for a competitor? Does a given patient have cancer? Does a given image contain a hot dog? Algorithms for performing binary classification are particularly important because many of the algorithms for performing the more general kind of classification where there are arbitrary labels are simply a bunch of binary classifiers working together. For instance, a simple solution to the handwriting recognition problem is to simply train a bunch of binary classifiers: a 0-detector, a 1-detector, a 2-detector, and so on, which output their certainty that the image is of their respective digit. The classifier just outputs the digit whose classifier has the highest certainty.<\/span><\/p>\n\n\n\n

Unsupervised Machine Learning<\/strong><\/h1>\n\n\n\n

On the other hand, there is an entirely different class of tasks referred to as <\/span>unsupervised learning<\/b>. Supervised learning tasks find patterns where we have a dataset of \u201cright answers\u201d to learn from. Unsupervised learning tasks find patterns where we don\u2019t. This may be because the \u201cright answers\u201d are unobservable, or infeasible to obtain, or maybe for a given problem, there isn\u2019t even a \u201cright answer\u201d per se.<\/span><\/p>\n\n\n\n

Clustering and Generative Modeling<\/h2>\n\n\n\n

A large subclass of unsupervised tasks is the problem of <\/span>clustering<\/b>. Clustering refers to grouping observations together in such a way that members of a common group are similar to each other, and different from members of other groups. A common application here is in marketing, where we wish to identify segments of customers or prospects with similar preferences or buying habits. A major challenge in clustering is that it is often difficult or impossible to know how many clusters should exist, or how the clusters should look.<\/span><\/p>\n\n\n\n

\"machine<\/a><\/figure>\n\n\n\n

A very interesting class of unsupervised tasks is <\/span>generative modeling<\/b>. Generative models are models that imitate the process that generates the training data. A good generative model would be able to generate new data that resembles the training data in some sense. This type of learning is unsupervised because the <\/span>process <\/span><\/i>that generates the data is not directly observable \u2013 only the data itself is observable.<\/span><\/p>\n\n\n\n

Recent developments in this field have led to startling and occasionally horrifying advances in image generation. The image here is created by training a kind of unsupervised learning model called a Deep Convolutional Generalized Adversarial Network model to generate images of faces and asking it for images of a smiling man.<\/p>\n\n\n\n

Reinforcement Learning, Hybrids, and More<\/strong><\/h2>\n\n\n\n

A newer type of learning problem that has gained a great deal of traction recently is called <\/span>reinforcement learning<\/b>. In reinforcement learning, we do not provide the machine with examples of correct input-output pairs, but we do provide a method for the machine to quantify its performance in the form of a <\/span>reward signal<\/span><\/i>. Reinforcement learning methods resemble how humans and animals learn: the machine tries a bunch of different things and is rewarded when it does something well.<\/span><\/p>\n\n\n\n

Reinforcement learning is useful in cases where the solution space is enormous or infinite, and typically applies in cases where the machine can be thought of as an agent interacting with its environment. One of the first big success stories for this type of model was by a small team that <\/span>trained a reinforcement learning model to play Atari video games using only the pixel output from the game as input<\/span>. The model was eventually able to outperform human players at three of the games, and the company that created the model <\/span>was acquired by Google for over $500M <\/span>shortly thereafter.<\/span><\/p>\n\n\n\n

To implement supervised learning to the problem of playing Atari video games, we would require a dataset containing millions or billions of example games played by real humans for the machine to learn from. By contrast, reinforcement learning works by giving the machine a reward according to how well it is performing at its task. Simple video games are well suited to this type of task since the score works well as a reward. The machine proceeds to learn by simulation which patterns maximize its reward.<\/p>\n\n\n\n

Often, hybrid approaches lead to good results. For instance, an important task in some areas is the task of <\/span>anomaly detection<\/b>. An anomaly detection algorithm monitors some signal and indicates when something <\/span>weird<\/span><\/i> happens. A good example is fraud detection. We want an algorithm that monitors a stream of credit card transactions and flags weird ones. But what does weird mean? This problem is suited to a sort of hybrid supervised\/unsupervised approach. There are certainly some known patterns that we would like the algorithm to be able to detect, and we can train a supervised learning model by showing it examples of the known fraud patterns. But we also want to be able to detect previously unknown examples of potential fraud or otherwise abnormal activity, which might be accomplished by methods of unsupervised learning.<\/span><\/p>\n\n\n\n

Machine Learning Basics Can Have a Big Impact<\/strong><\/h2>\n\n\n\n

Many of the most advanced tools require a great deal of sophisticated knowledge, in advanced mathematics, statistics, and software engineering. For a beginner wanting to get started, it might seem overwhelming, especially if you want to work with some of the exciting new models.<\/span><\/p>\n\n\n\n

The good news is that you can do a lot with the basics, which are widely accessible. A variety of supervised and unsupervised learning models are implemented in R and Python, which are freely available and straightforward to set up on your own computer, and even simple models like linear or logistic regression can be used to perform interesting and important machine learning tasks.<\/p>\n\n\n\n

Check out our Machine Learning Certificate course<\/a> to learn the basics and get started. If you want more, <\/i>apply now to BrainStation\u2019s Data Science Diploma program.<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Everything you wanted to know about machine learning (but were afraid to ask). <\/p>\n","protected":false},"author":7,"featured_media":9673,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[343,1066],"tags":[513,332,405,512,514],"yoast_head":"\nMachine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond<\/title>\n<meta name=\"description\" content=\"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Machine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond\" \/>\n<meta property=\"og:description\" content=\"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement\" \/>\n<meta property=\"og:site_name\" content=\"BrainStation\u00ae Blog\" \/>\n<meta property=\"article:published_time\" content=\"2019-09-12T13:36:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-01-28T22:03:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"690\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"BrainStation\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/brainstation.io\/blog\/#website\",\"url\":\"https:\/\/brainstation.io\/blog\/\",\"name\":\"BrainStation\u00ae Blog\",\"description\":\"The Digital Learning Company\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/brainstation.io\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#primaryimage\",\"url\":\"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png\",\"contentUrl\":\"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png\",\"width\":2000,\"height\":690,\"caption\":\"Machine Learning basics\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#webpage\",\"url\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement\",\"name\":\"Machine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond\",\"isPartOf\":{\"@id\":\"https:\/\/brainstation.io\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#primaryimage\"},\"datePublished\":\"2019-09-12T13:36:49+00:00\",\"dateModified\":\"2021-01-28T22:03:39+00:00\",\"author\":{\"@id\":\"https:\/\/brainstation.io\/blog\/#\/schema\/person\/9f37983a6c4da6cf5dd422481ac8cf11\"},\"description\":\"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.\",\"breadcrumb\":{\"@id\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/brainstation.io\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Machine Learning 101: Supervised, Unsupervised, Reinforcement, and Beyond\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/brainstation.io\/blog\/#\/schema\/person\/9f37983a6c4da6cf5dd422481ac8cf11\",\"name\":\"BrainStation\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/brainstation.io\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/80c14b8388838ae1453aec36606b232d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/80c14b8388838ae1453aec36606b232d?s=96&d=mm&r=g\",\"caption\":\"BrainStation\"},\"description\":\"BrainStation is a global leader in digital skills training, empowering businesses and brands to succeed in the digital age. Established in 2012, BrainStation has worked with over 250 instructors from the most innovative companies, developing cutting-edge, real-world digital education that has empowered more than 50,000 professionals and some of the largest corporations in the world.\",\"url\":\"https:\/\/brainstation.io\/blog\/author\/brainstation\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Machine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond","description":"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement","og_locale":"en_US","og_type":"article","og_title":"Machine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond","og_description":"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.","og_url":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement","og_site_name":"BrainStation\u00ae Blog","article_published_time":"2019-09-12T13:36:49+00:00","article_modified_time":"2021-01-28T22:03:39+00:00","og_image":[{"width":2000,"height":690,"url":"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"BrainStation","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/brainstation.io\/blog\/#website","url":"https:\/\/brainstation.io\/blog\/","name":"BrainStation\u00ae Blog","description":"The Digital Learning Company","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/brainstation.io\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#primaryimage","url":"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png","contentUrl":"https:\/\/d2re7sjnpekmig.cloudfront.net\/prod\/wp-content\/uploads\/2018\/07\/BS_MACHINE_LEARNING_AND_BEYOND-e1568301534224.png","width":2000,"height":690,"caption":"Machine Learning basics"},{"@type":"WebPage","@id":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#webpage","url":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement","name":"Machine Learning 101 | Supervised, Unsupervised, Reinforcement & Beyond","isPartOf":{"@id":"https:\/\/brainstation.io\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#primaryimage"},"datePublished":"2019-09-12T13:36:49+00:00","dateModified":"2021-01-28T22:03:39+00:00","author":{"@id":"https:\/\/brainstation.io\/blog\/#\/schema\/person\/9f37983a6c4da6cf5dd422481ac8cf11"},"description":"Looking to understand the basics of machine learning? Our resident Data Scientist outlines basic tools, concepts, and approaches.","breadcrumb":{"@id":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/brainstation.io\/blog\/machine-learning-supervised-unsupervised-reinforcement#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/brainstation.io\/blog"},{"@type":"ListItem","position":2,"name":"Machine Learning 101: Supervised, Unsupervised, Reinforcement, and Beyond"}]},{"@type":"Person","@id":"https:\/\/brainstation.io\/blog\/#\/schema\/person\/9f37983a6c4da6cf5dd422481ac8cf11","name":"BrainStation","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/brainstation.io\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/80c14b8388838ae1453aec36606b232d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/80c14b8388838ae1453aec36606b232d?s=96&d=mm&r=g","caption":"BrainStation"},"description":"BrainStation is a global leader in digital skills training, empowering businesses and brands to succeed in the digital age. Established in 2012, BrainStation has worked with over 250 instructors from the most innovative companies, developing cutting-edge, real-world digital education that has empowered more than 50,000 professionals and some of the largest corporations in the world.","url":"https:\/\/brainstation.io\/blog\/author\/brainstation"}]}},"_links":{"self":[{"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/posts\/6236"}],"collection":[{"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/comments?post=6236"}],"version-history":[{"count":15,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/posts\/6236\/revisions"}],"predecessor-version":[{"id":12632,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/posts\/6236\/revisions\/12632"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/media\/9673"}],"wp:attachment":[{"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/media?parent=6236"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/categories?post=6236"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brainstation.io\/blog\/wp-json\/wp\/v2\/tags?post=6236"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}