Hadoop实践1-inux deepin配置Hadoop环境

本次实践主要参考了厦门大学数据库实验室的内容链接如下:
http://dblab.xmu.edu.cn/blog/install-hadoop/

  1. 配置Java环境
  1. 安装hadoop
  • 安装ssh,配置ssh无密码登录
sudo apt-get install openssh-server
ssh localhost   #首次登录

这里需要数据自己的登录系统的密码

配置无密码登录

首先退出刚才的 ssh,就回到了我们原先的终端窗口,然后利用 ssh-keygen 生成密钥,并将密钥加入到授权中:

exit                           # 退出刚才的 ssh localhost
cd ~/.ssh/                     # 若没有该目录,请先执行一次ssh localhost
ssh-keygen -t rsa              # 会有提示,都按回车就可以
cat ./id_rsa.pub >> ./authorized_keys  # 加入授权
  • 安装hadoop,选择安装在/usr/local下
sudo tar -zxf ~/下载/hadoop-2.6.0.tar.gz -C /usr/local    # 解压到/usr/local中
cd /usr/local/
sudo mv ./hadoop-2.6.0/ ./hadoop            # 将文件夹名改为hadoop
sudo chown -R ‘换成自己的用户名’ ./hadoop       # 修改文件权限

解压之后即可使用,输入命令查看一下hadoop的版本

cd /usr/local/hadoop
./bin/hadoop version

如果显示了hadoop版本,则安装完成

今天先写到这,这是苦行僧的第7篇实践记录,继续努力

Title: Deep Learning with Hadoop Author: Dipayan Dev Length: 259 pages Edition: 1 Language: English Publisher: Packt Publishing Publication Date: 2017-03-06 ISBN-10: 1787124762 ISBN-13: 9781787124769 Book Description Deep Learning involves extracting features and insights from multiple layers of the data. This book will teach you how to deploy the deep learning networks with Hadoop. Starting with understanding what deep learning is and what the various models associated with deep learning are, this book will then show you how to set up the Hadoop environment for deep learning. In this book, you will also learn how to overcome the challenges that you face while implementing distributed deep learning with Hadoop. The book will also show you how you can implement and parallelize Deep Belief Networks, CNN, RNN, RBM and much more using the popular deep learning library deeplearning4j. Get in depth mathematical explanations, visual representations to understand the implementation of Denoising AutoEncoders with deeplearning4j. To give you a more practical perspective, the book will also teach you how you can implement image classification, audio processing and natural language processing on Hadoop. By the end of this book, you will know how to deploy deep learning in distributed systems using Hadoop What you will learn Explore Deep Learning and various models associated with it. Understand the challenges of implementing distributed deep learning with Hadoop and how to overcome it Implement Convolutional Neural Network (CNN) with deeplearning4j Delve into the implementation of Restricted Boltzmann Machines (RBM) Understand the mathematical explanation for implementing Recurrent Neural Networks (RNN) Get hands on practice of deep learning and their implementation with Hadoop. Table of Contents Chapter 1. Introduction to Deep Learning Chapter 2. Distributed Deep Learning for Large-Scale Data Chapter 3. Convolutional Neural Network Chapter 4. Recurrent Neural Network Chapt
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值