神经网络
Adam婷
笔者在人工智能/机器学习领域中默默探索,时而迷惘,时而欣喜。
展开
-
ReZero is All You Need: Fast Convergence at Large Depth
ReZero is All You Need: Fast Convergence at Large DepthAbstractDeep networks have enabled significant performance gains across domains, but they often suffer from vanishing/exploding gradients. Thi...原创 2020-03-29 10:17:40 · 1590 阅读 · 1 评论 -
使用Keras中的Autoencoders进行极端罕见事件分类
In this post, we will learn how to implement an autoencoder for building a rare-event classifier. We will use a real-world rare event dataset from here.BackgroundWhat is an extreme rare event?In a...原创 2019-05-19 00:35:23 · 1558 阅读 · 1 评论 -
深度学习要点 - 按顺序进行序列建模(使用python)
Introduction大规模的深度学习通过创建前所未有的聊天机器人和机器人来扰乱许多行业。另一方面,刚刚开始深度学习的人会阅读神经网络的基础知识及其各种架构,如CNN和RNN。但是从简单的概念到深度学习的工业应用似乎有了很大的提升。在构建深度学习应用程序时,几乎需要了解批量标准化,丢失和注意等概念。在本文中,我们将介绍语音识别和自然语言处理中当前最先进应用中使用的两个重要概念 - 即序列到...原创 2019-04-25 09:17:08 · 1476 阅读 · 0 评论 -
基于深度强化学习的路径规划笔记
MazePathFinder using deep Q Networks该程序将由几个封锁(由块颜色表示)组成的图像作为输入,起始点由蓝色表示,目的地由绿色表示。 它输出一个由输入到输出的可能路径之一组成的图像。 下面显示的是程序的输入和输出。输入图像被馈送到由2个conv和2个fc层组成的模型,其输出对应于底部和右侧动作的Q值。 代理根据哪个Q值更大而向右或向下移动,并且使用代理的新位置...原创 2019-04-24 20:57:31 · 30261 阅读 · 19 评论 -
PyTorch入门 - 了解如何构建快速准确的神经网络(4个案例研究!)
IntroductionPyTorch v TensorFlow - 你有多少次在社交媒体上看到这个极化问题? 近年来深度学习的兴起得益于这些框架的普及。 两者都有坚定的支持者,但去年开始出现明显的赢家。PyTorch是2018年最受欢迎的框架之一。它很快成为学术界和业界研究人员首选的深度学习框架。 在过去几周使用PyTorch之后,我可以确认它是高度灵活的,并且是一个易于使用的深度学习库。...原创 2019-04-19 23:19:34 · 568 阅读 · 0 评论 -
每个机器学习爱好者必知的GAN五大有趣应用!
IntroductionCan you guess what’s common among all the faces in this image?None of these people are real! These faces were generated by a computer vision technique called GANs, or Generative Adversa...原创 2019-04-19 00:03:54 · 921 阅读 · 0 评论 -
Nuts and Bolts of Reinforcement Learning:时间差异(TD)学习简介
Introduction当DeepMind提出一种在ATARI游戏中达到超人级别的算法时,Q-learning成为数据科学中的家喻户晓的名字。 它是强化学习(RL)的核心组成部分之一。 每当我读到RL时,我经常会遇到Q-learning。但是,Q学习与我们的时差学习主题有什么关系呢? 让我举一个例子来说明时间差异学习是什么。Rajesh计划在他的车里从德里前往斋浦尔。 快速查看Google地...原创 2019-04-27 19:14:28 · 870 阅读 · 0 评论 -
使用Python中的OpenAI Gym进行深度Q-Learning的实践介绍
Introduction我一直对游戏着迷。 看似无限的选择可以在紧迫的时间线下执行一个动作 - 这是一个惊心动魄的经历。 没有什么比得上它了。因此,当我读到DeepMind想出的令人难以置信的算法(如AlphaGo和AlphaStar)时,我被迷住了。 我想学习如何在自己的机器上制作这些系统。 这使我进入深度强化学习的世界(Deep RL)。即使您不参与游戏,Deep RL也很重要。 只需查...原创 2019-04-27 18:45:37 · 2945 阅读 · 0 评论 -
Weight Initialization in Neural Networks: A Journey From the Basics to Kaiming
我想邀请您加入我的探索,通过不同的方法初始化神经网络中的图层权重。 通过各种简短的实验和思想练习,我们将逐步发现为什么在训练深度神经网络时足够的重量初始化非常重要。 在此过程中,我们将介绍研究人员多年来提出的各种方法,并最终深入研究最适合您最有可能使用的当代网络架构的方法。接下来的例子来自我自己重新实现的一套笔记本,Jeremy Howard在最新版本的fast.ai的深度学习第二部分课程中介绍...原创 2019-04-18 01:08:45 · 283 阅读 · 0 评论 -
How to do Semantic Segmentation using Deep learning(如何使用深度学习进行语义分割)
This article is a comprehensive overview including a step-by-step guide to implement a deep learning image segmentation model.update: We just launched a new product: [Nanonets Object Detection APIs]...原创 2019-04-14 23:30:36 · 746 阅读 · 0 评论 -
Semantic Segmentation with Deep Learning(深度学习的语义分割)
Semantic Segmentation with Deep Learning–A guide and codeWhat is semantic segmentation?Most people in the deep learning and computer vision communities understand what image classification is: we wa...原创 2019-04-14 22:59:34 · 2199 阅读 · 1 评论 -
Latent Constraints: Conditional Generation from Unconditional Generative Models
Latent Constraints: Conditional Generation from Unconditional Generative ModelsJesse Engel, Matthew Hoffman, Adam Roberts arXiv linkAbstract: Deep generative neural networks have proven effective a...翻译 2019-04-14 20:07:12 · 459 阅读 · 0 评论 -
Gentle Dive into Math Behind Convolutional Neural Networks
Autonomous driving, healthcare or retail are just some of the areas where Computer Vision has allowed us to achieve things that, until recently, were considered impossible. Today the dream of a self ...翻译 2019-04-14 17:23:58 · 508 阅读 · 0 评论 -
使用DCGAN生成动漫风格的人脸并探索其潜在的特征表征
Step by step experimenting DCGAN with visualization of its resultsHello everyone , It’s been a while ! Today, I want to write about my result of learning and experimenting another Deep Learning techn...翻译 2019-04-14 16:26:49 · 3076 阅读 · 2 评论 -
使用深度学习从视频构建人脸检测模型(Python实现)
Introduction“计算机视觉和机器学习已经真正开始起飞,但对于大多数人来说,计算机在观看图像时看到的整体想法相对模糊。” - Mike Kreiger近年来,计算机视觉领域的精彩领域跻身于自己的联盟之列。世界各地已经广泛使用了大量的应用程序 - 我们刚刚开始!我在这个领域最喜欢的事情之一是我们的社区拥抱开源概念的想法。即使是大型科技巨头也愿意与每个人分享新的突破和创新,这样技术...原创 2019-04-21 23:30:01 · 893 阅读 · 0 评论 -
Faster R-CNN (object detection) implemented by Keras for custom data from Google’s Open Images Datas
Faster R-CNN (object detection) implemented by Keras for custom data from Google’s Open Images Dataset V4IntroductionAfter exploring CNN for a while, I decided to try another crucial area in Comput...翻译 2019-04-14 11:46:37 · 354 阅读 · 0 评论 -
使用可视化方法理解卷积神经网络(CNN)的指南
Introduction“How did your neural network produce this result?” This question has sent many data scientists into a tizzy. It’s easy to explain how a simple neural network works, but what happens when ...原创 2019-05-07 11:22:12 · 2321 阅读 · 1 评论 -
用于Keras极端罕见事件分类的LSTM自动编码器
Here we will learn the details of data preparation for LSTM models, and build an LSTM Autoencoder for rare-event classification.This post is a continuation of my previous post Extreme Rare Event Clas...原创 2019-05-19 00:58:01 · 5124 阅读 · 9 评论 -
机器学习研究人员需要学习的10个神经网络架构
Why do we need Machine Learning?Machine learning is needed for tasks that are too complex for humans to code directly. Some tasks are so complex that it is impractical, if not impossible, for humans ...原创 2019-05-15 20:55:15 · 707 阅读 · 0 评论 -
U-Net深度学习灰度图像的彩色化
U-Net深度学习灰度图像的彩色化本文介绍了使用深度学习训练神经网络从单通道灰度图像生成3通道彩色图像的实验。在我看来,虽然它们因主题而异,但结果令人震惊,模型产生了幻觉,原始主题应该是什么颜色。将灰度1通道图像增强为3通道彩色图像。Div2k(https://data.vision.ee.ethz.ch/cvl/DIV2K/)训练数据集用于训练,本文中的这些图像基于Div2K验证集。这...原创 2019-07-26 16:35:04 · 10256 阅读 · 5 评论 -
Context-Aware U-Net for Biomedical Image Segmentation
Context-Aware U-Net for Biomedical Image SegmentationJiaxu Leng , Ying Liu , Tianlin Zhang , Pei Quan , Zhenyu CuiSchool of Computer and Control Engineering, University of Chinese Academy of Science...原创 2019-07-29 18:41:50 · 1193 阅读 · 3 评论 -
图神经网络的简要介绍(基础知识,DeepWalk和GraphSage)
A Gentle Introduction to Graph Neural Networks (Basics, DeepWalk, and GraphSage)图形神经网络的简要介绍(基础知识,DeepWalk和GraphSage)Recently, Graph Neural Network (GNN) has gained increasing popularity in various ...原创 2019-07-07 08:59:11 · 3230 阅读 · 0 评论 -
Relational inductive biases, deep learning, and graph networks(关系归纳偏差、深度学习和图形网络)
Relational inductive biases, deep learning, and graph networksPeter W. Battaglia1, Jessica B. Hamrick1, Victor Bapst1, Alvaro Sanchez-Gonzalez1, Vinicius Zambaldi1, Mateusz Malinowski1, Andrea Tacche...原创 2019-07-15 12:29:32 · 4971 阅读 · 0 评论 -
TensorFlow Production Example(RNN)
# -*- coding: utf-8 -*-# TensorFlow Production Example (Training)#----------------------------------## We pull together everything and create an example# of best tensorflow production tips##...原创 2019-07-08 23:10:53 · 175 阅读 · 0 评论 -
Perform address matching with a Siamese RNN model
Here, we show how to perform address matchingwith a Siamese RNN model# -*- coding: utf-8 -*-# Siamese Address Similarity with TensorFlow (Driver File)#------------------------------------------#...原创 2019-07-08 23:06:52 · 197 阅读 · 0 评论 -
Stacking LSTM Layers
Here we implement an LSTM model on all a data set of Shakespeare works.We will stack multiple LSTM models for a more accurate representationof Shakespearean language. We will also use characters in...原创 2019-07-08 23:03:06 · 950 阅读 · 0 评论 -
Implementing an LSTM RNN Model
Implementing an LSTM RNN Model# -*- coding: utf-8 -*-## Implementing an LSTM RNN Model#------------------------------# Here we implement an LSTM model on all a data set of Shakespeare works.##...原创 2019-07-08 23:00:59 · 209 阅读 · 0 评论 -
Deep Dream代码
Deep Dream代码# Using TensorFlow for Deep Dream#---------------------------------------# From: Alexander Mordvintsev# --https://github.com/tensorflow/tensorflow/tree/master/tensorflow/examples/...原创 2019-07-08 22:57:00 · 306 阅读 · 0 评论 -
When Does Label Smoothing Help?
When Does Label Smoothing Help?Rafael Müller, Simon Kornblith, Geoffrey HintonGoogle BrainTorontorafaelmuller@google.comAbstractThe generalization and learning speed of a multi-class neural netw...原创 2019-07-08 20:45:31 · 3288 阅读 · 0 评论 -
强化学习代码研读
Tensorflow——占位符我们通过为输入图像和目标输出类别创建节点,来开始构建计算图。x = tf.placeholder("float", shape=[None, 784])y = tf.placeholder("float", shape=[None, 10])这里的x和y并不是特定的值,相反,他们都只是一个占位符,可以在TensorFlow运行某一计算时根据该占位符输入具体的...原创 2019-06-10 09:07:53 · 401 阅读 · 0 评论 -
AdamTechLouis's talk:Decoding the Best Papers from ICLR 2019 – Neural Networks are Here to Rule
IntroductionI love reading and decoding machine learning research papers. There is so much incredible information to parse through – a goldmine for us data scientists! I was thrilled when the best pa...原创 2019-06-03 14:47:23 · 400 阅读 · 0 评论 -
使用UNET理解语义分割
A Salt Identification Case StudyTable of Contents:IntroductionPrerequisitesWhat is Semantic Segmentation?ApplicationsBusiness ProblemUnderstanding the dataUnderstanding Convolution, Max Pooli...翻译 2019-04-16 22:39:03 · 5841 阅读 · 1 评论 -
深度学习涂鸦! 我们的草图识别之旅
Doodling with Deep Learning!Our Journey with Sketch recognitionIn this blog post, we describe our process understanding, fitting models on, and finding a fun application of the Google Quick, Draw! d...原创 2019-04-13 21:02:25 · 3344 阅读 · 3 评论 -
坤哥带你学AI之----深度卷积生成对抗网络--DCGAN
What are GANs?Generative Adversarial Networks (GANs) are one of the most interesting ideas in computer science today. Two models are trained simultaneously by an adversarial process. A generator (“th...原创 2019-03-16 09:37:49 · 693 阅读 · 0 评论 -
用Keras建立自动编码器
Building Autoencoders in KerasWhat are autoencoders?“Autoencoding” is a data compression algorithm where the compression and decompression functions are 1) data-specific, 2) lossy, and 3) learned a...原创 2019-03-05 23:26:43 · 4710 阅读 · 1 评论 -
A Comprehensive Introduction to Different Types of Convolutions in Deep Learning
Towards intuitive understanding of convolutions through visualizationsIf you’ve heard of different kinds of convolutions in Deep Learning (e.g. 2D / 3D / 1x1 / Transposed / Dilated (Atrous) / Spatial...翻译 2019-02-24 20:52:09 · 1411 阅读 · 0 评论 -
DCGANs (Deep Convolutional Generative Adversarial Networks)
Deep Convolutional Generative Adversarial NetworksGenerative Adversarial Networks最有趣的部分之一是Generator网络的设计。 发电机网络能够获取随机噪声并将其映射到图像中,使得鉴别器无法分辨哪些图像来自数据集以及哪些图像来自发生器。这是神经网络的一个非常有趣的应用。 通常,神经网络将输入映射到二进制输出(1或...翻译 2019-02-24 09:32:11 · 1527 阅读 · 0 评论 -
An intuitive introduction to Generative Adversarial Networks (GANs)
生成对抗网络(GAN)的直观介绍Warm upLet’s say there’s a very cool party going on in your neighborhood that you really want to go to. But, there is a problem. To get into the party you need a special ticket — t...原创 2019-02-23 18:33:16 · 364 阅读 · 0 评论 -
使用 Doc2Vec & Logistic Regretion 进行多类文本分类
The goal is to classify consumer finance complaints into 12 pre-defined classes using Doc2Vec and Logistic RegressionDoc2vec is an NLP tool for representing documents as a vector and is a generalizin...原创 2019-02-23 11:28:34 · 1337 阅读 · 0 评论 -
机器学习算法之------LSTM
Understanding LSTM NetworksRecurrent Neural NetworksHumans don’t start their thinking from scratch every second. As you read this essay, you understand each word based on your understanding of pre...原创 2019-02-23 07:59:11 · 3947 阅读 · 0 评论