Machine learning

Four branches of machine learning

Supervised learning

  1. optical character recognition
  2. speech recognition
  3. image classification
  4. language translation
  5. Sequence generate

Given a picture, predict a caption describing it.

  1. Syntax tree prediction

Given a sentence, predict its decomposition into a syntax tree.

  1. Object detection
  2. Image segmentation

Given a picture, draw a pixel-level mask on a specific object.

Unsupervised learning

  1. dimensionality reduction.
  2. clustering

Self-supervised learning

Supervised learning without human-annotated labels.

  1. autoencoder

Reinforcement learning

An agent receives information about its environment and learns to choose actions that will maximize some reward.

The universal workflow of machine learning

  1. Defining the problem and assembling a dataset.
  2. Choosing a measure of success.
  3. Deciding on an evaluation protocol.
  4. Preparing your data.
  5. Developing a model that does better than a baseline.
  6. Scaling up: developing a model that overfits.
  7. Regularizing your model and tuning your hyperparameters.

Overfitting

Reducing the network’s size

The general workflow to find an appropriate model size is to start with relatively few layers and parameters, and increase the size of the layers or add new layers until you see diminishing returns with regard to validation loss.

Adding weight regularization

Put constrains on the complexity of a network by forcing its weights to take only small values, which makes the distribution of weight values more regular.

  1. L1 regularization——The cost added is proportional to the absolute value of the weight coefficients.
  2. L2 regularization——******the square of the value of the weight coefficients.

Adding dropout

Dropout, applied to a layer, consists of randomly dropping out (setting to zero) a number of output features of the layer during training.

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值