CUHK
yonghangtian
这个作者很懒,什么都没留下…
展开
-
SSH连接远程Linux服务器时出现“Server Refused Your Key” 错误的一种解决方法
我这里出现错误的原因是:登陆名称及private key名称与服务器端配置的public key中的名称不一致因为服务器端的public key中已经包含了登陆时的名称信息,所以在登陆服务器时,一定要保证本地的private key文件的名字及登陆时的用户名与public key中创建的名称一致。否则就会出现上述错误。...原创 2019-01-14 20:50:47 · 2190 阅读 · 0 评论 -
CUHK-IEMS5730-HW0
Name: Tian YonghangStudent ID: 1155114915EnvironmentGoogle Cloud PlatformUbuntu 14.04 LTSInstance: 2 cores, 8GB ROM, 50GB storageOpenjdk-7-jdk/jreHadoop 2.9.2Part ai: Single Node Hadoop Se...原创 2019-01-21 10:51:39 · 588 阅读 · 0 评论 -
CUHK-IEMS5730-HW1
CUHK-IEMS5730-HW1Student ID: 1155114915Student Name: TIAN YonghangMapReduce Source CodeI use two mapreduce job to achieve the sparse matrix multiplication.Before using the original matrix file, I...原创 2019-02-16 13:33:42 · 558 阅读 · 0 评论 -
CUHK-IEMS5730-HW0详解
This is a tutorial for my cuhk ierg5730 big data course hw0.I considered many other tutorial before, and they are all not complete for my homework, so I will record every step I did to demonstrate t...原创 2019-02-17 16:42:18 · 843 阅读 · 0 评论 -
CUHK-IEMS5730-HW2
CUHK-IEMS5730-HW2Pig Setup & Basic OperationsPig Latin ScriptBookA = load '/Pig_Data/google_book/googlebooks-eng-all-1gram-20120701-a' using PigStorage() as (gram:chararray, year:int, num:int, ...原创 2019-03-11 10:39:07 · 505 阅读 · 0 评论 -
CUHK-IEMS5730-HW3
CUHK-IEMS5730-HW3Question 1: Kafka Integration with Strom(1) Multi-node Kafka Cluster SetupScreen-shots shows that all process runs well.Here is the description of topic: test and it contains con...原创 2019-03-25 11:11:18 · 495 阅读 · 1 评论 -
Linux下编译打包 Java/Scala Maven项目
前言:学习spark时,需要用远程集群来跑项目,因此要了解一下如何编译scala maven项目。但是网上资料好乱啊! 只能自己来写一个符合像我一样情况的初学者。环境:Scala Version: 2.11.12Java Version: openjdk 1.7Maven Version: 3.0.5Java Maven 编译及打jar包之所以介绍,是因为Java和Scala编译过...原创 2019-04-19 16:19:26 · 2231 阅读 · 0 评论