吴恩达机器学习学习笔记——Week 1——1. 导论（Introduction）

在网易云课堂和Coursera上学完了一遍吴恩达机器学习，受益匪浅，特此记录一下学习笔记，权当复习。

为什么要同时使用网易云课堂和Coursera? 主要是想结合两者的优点：网易云课堂（https://study.163.com/course/introduction/1210076550.htm）看教学视频，带双语字幕；Coursera（https://www.coursera.org/learn/machine-learning/home/welcome）上则可以做课堂练习、单元测试、编程作业。

在此，先允许我向吴恩达老师、Coursera、网易云课堂致以诚挚的谢意！

 

一、课件及课堂练习

1. 机器学习应用示例：数据挖掘、不能显式编程的应用场合、自适应（推荐）系统

 

2. 机器学习的定义

 

3. 机器学习算法： 监督学习、非监督学习、强化学习

 

4.  监督学习：示例1 —— 房价的预测（回归法）

 

5. 监督学习：示例2 —— 疾病诊断（分类法）

 

6. 非监督学习：数据集中不含标记

 

7. 非监督学习应用示例——新闻自动分组（如Google News）、基因学研究、计算集群的管理、社交网络分析、市场划分、天文数据分析、语音识别、

 

二、内容概要

1. 机器学习：通过经验E提升性能P，以更好的完成任务T

What is Machine Learning?

Two definitions of Machine Learning are offered. Arthur Samuel described it as: "the field of study that gives computers the ability to learn without being explicitly programmed." This is an older, informal definition.

Tom Mitchell provides a more modern definition: "A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E."

Example: playing checkers.

E = the experience of playing many games of checkers

T = the task of playing checkers.

P = the probability that the program will win the next game.

In general, any machine learning problem can be assigned to one of two broad classifications:

Supervised learning and Unsupervised learning.

 

2. 监督学习：回归、分类，数据集含有标记

Supervised Learning

In supervised learning, we are given a data set and already know what our correct output should look like, having the idea that there is a relationship between the input and the output.

Supervised learning problems are categorized into "regression" and "classification" problems. In a regression problem, we are trying to predict results within a continuous output, meaning that we are trying to map input variables to some continuous function. In a classification problem, we are instead trying to predict results in a discrete output. In other words, we are trying to map input variables into discrete categories.

Example 1:

Given data about the size of houses on the real estate market, try to predict their price. Price as a function of size is a continuous output, so this is a regression problem.

We could turn this example into a classification problem by instead making our output about whether the house "sells for more or less than the asking price." Here we are classifying the houses based on price into two discrete categories.

Example 2:

(a) Regression - Given a picture of a person, we have to predict their age on the basis of the given picture

(b) Classification - Given a patient with a tumor, we have to predict whether the tumor is malignant or benign.

 

3. 非监督学习：聚类、嘈杂环境下语音识别问题（即，鸡尾酒会（Cocktail Party）问题），数据集不含标记

Unsupervised Learning

Unsupervised learning allows us to approach problems with little or no idea what our results should look like. We can derive structure from data where we don't necessarily know the effect of the variables.

We can derive this structure by clustering the data based on relationships among the variables in the data.

With unsupervised learning there is no feedback based on the prediction results.

Example:

Clustering: Take a collection of 1,000,000 different genes, and find a way to automatically group these genes into groups that are somehow similar or related by different variables, such as lifespan, location, roles, and so on.

Non-clustering: The "Cocktail Party Algorithm", allows you to find structure in a chaotic environment. (i.e. identifying individual voices and music from a mesh of sounds at a cocktail party).

 

三、单元测试

(1). A computer program is said to learn from experience E with respect to some task T and some performance measure P if its performance on T, as measured by P, improves with experience E.

Suppose we feed a learning algorithm a lot of historical weather data, and have it learn to predict weather. In this setting, what is T?

1. The weather prediction task.
2. The process of the algorithm examining a large amount of historical weather data.
3. None of these.
4. The probability of it correctly predicting a future date's weather.

(2). The amount of rain that falls in a day is usually measured in either millimeters (mm) or inches. Suppose you use a learning algorithm to predict how much rain will fall tomorrow.

Would you treat this as a classification or a regression problem?

1. Classification
2. Regression

(3). Suppose you are working on stock market prediction. You would like to predict whether or not a certain company will declare bankruptcy within the next 7 days (by training on data of similar companies that had previously been at risk of bankruptcy). Would you treat this as a classification or a regression problem?

1. Regression
2. Classification

(4). Some of the problems below are best addressed using a supervised learning algorithm, and the others with an unsupervised learning algorithm. Which of the following would you apply supervised learning to? (Select all that apply.) In each case, assume some appropriate dataset is available for your algorithm to learn from.

1. Given data on how 1000 medical patients respond to an experimental drug (such as effectiveness of the treatment, side effects, etc.), discover whether there are different categories or "types" of patients in terms of how they respond to the drug, and if so what these categories are.
2. Examine a web page, and classify whether the content on the web page should be considered "child friendly" (e.g., non-pornographic, etc.) or "adult."
3. Given a large dataset of medical records from patients suffering from heart disease, try to learn whether there might be different clusters of such patients for which we might tailor separate treatments.
4. In farming, given data on crop yields over the last 50 years, learn to predict next year's crop yields.

5. Which of these is a reasonable definition of machine learning?

1. Machine learning is the field of allowing robots to act intelligently.
2. Machine learning learns from labeled data.
3. Machine learning is the science of programming computers.
4. Machine learning is the field of study that gives computers the ability to learn without being explicitly programmed.