- 博客(7)
- 收藏
- 关注
原创 Linux下编译打包 Java/Scala Maven项目
前言:学习spark时,需要用远程集群来跑项目,因此要了解一下如何编译scala maven项目。但是网上资料好乱啊! 只能自己来写一个符合像我一样情况的初学者。环境:Scala Version: 2.11.12Java Version: openjdk 1.7Maven Version: 3.0.5Java Maven 编译及打jar包之所以介绍,是因为Java和Scala编译过...
2019-04-19 16:19:26
2212
原创 CUHK-IEMS5730-HW3
CUHK-IEMS5730-HW3Question 1: Kafka Integration with Strom(1) Multi-node Kafka Cluster SetupScreen-shots shows that all process runs well.Here is the description of topic: test and it contains con...
2019-03-25 11:11:18
474
1
原创 CUHK-IEMS5730-HW2
CUHK-IEMS5730-HW2Pig Setup & Basic OperationsPig Latin ScriptBookA = load '/Pig_Data/google_book/googlebooks-eng-all-1gram-20120701-a' using PigStorage() as (gram:chararray, year:int, num:int, ...
2019-03-11 10:39:07
486
原创 CUHK-IEMS5730-HW0详解
This is a tutorial for my cuhk ierg5730 big data course hw0.I considered many other tutorial before, and they are all not complete for my homework, so I will record every step I did to demonstrate t...
2019-02-17 16:42:18
825
原创 CUHK-IEMS5730-HW1
CUHK-IEMS5730-HW1Student ID: 1155114915Student Name: TIAN YonghangMapReduce Source CodeI use two mapreduce job to achieve the sparse matrix multiplication.Before using the original matrix file, I...
2019-02-16 13:33:42
538
原创 CUHK-IEMS5730-HW0
Name: Tian YonghangStudent ID: 1155114915EnvironmentGoogle Cloud PlatformUbuntu 14.04 LTSInstance: 2 cores, 8GB ROM, 50GB storageOpenjdk-7-jdk/jreHadoop 2.9.2Part ai: Single Node Hadoop Se...
2019-01-21 10:51:39
576
原创 SSH连接远程Linux服务器时出现“Server Refused Your Key” 错误的一种解决方法
我这里出现错误的原因是:登陆名称及private key名称与服务器端配置的public key中的名称不一致因为服务器端的public key中已经包含了登陆时的名称信息,所以在登陆服务器时,一定要保证本地的private key文件的名字及登陆时的用户名与public key中创建的名称一致。否则就会出现上述错误。...
2019-01-14 20:50:47
2161
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人