- 博客(10)
- 资源 (9)
- 收藏
- 关注
原创 install docker in aws redhat7
编辑/etc/yum.reop.d/redhat-rhui.repo 文件,找到如下配置块。[rhui-REGION-rhel-server-extras]name=Red Hat Enterprise Linux Server 7 Extra(RPMs)mirrorlist=https://rhui2-cds01.REGION.aws.ce.redhat.com/pulp/mirror/
2017-03-27 15:58:33 828
原创 SQLAccesslogAnalyzer in sparkSQL
package com.ibeifeng.bigdata.spark.sqlimport com.ibeifeng.bigdata.spark.core.ApacheAccessLogimport org.apache.spark.rdd.RDDimport org.apache.spark.sql.{DataFrame, SQLContext}import org.apache.spa
2017-03-23 18:58:27 503
原创 spark JavaSQLPageViewanalyzer for hive table
package com.ibeifeng.bigdata.spark.sql; import org.apache.spark.SparkConf; import org.apache.spark.api.java.JavaRDD; import org.apache.spark.api.java.JavaSparkContext; import org.apache.spa
2017-03-23 14:43:57 330
原创 intergrate hbase-1.2.4 into hive-2.1.1
hbase> create ' hvtohbase', 'cf1'hive >create table ccc(foo int,bar string) row format delimited fields terminated by '\t' lines terminated by '\n' stored as textfile;hive >CREATE external
2017-03-23 14:00:24 497
原创 install hive-2.1.1 in fedora
1、环境变量 /etc/profilePATH=$PATH:$HOME/.local/bin:$HOME/binexport JAVA_HOME=/home/jka07@int.hrs.com/software/jdk1.8.0_121PATH=$PATH:$JAVA_HOME/binexport SCALA_HOME=/usr/share/scalaexport CL
2017-03-23 11:45:42 366
原创 integrate hbase into sparkSql in fedora
1 in hbase-env.shexport JAVA_HOME=/home/jka07@int.hrs.com/software/jdk1.8.0_1212. in hbase-site.xmlhbase.zookeeper.property.dataDir/datahbase.rootdirhdfs://hrs-hadoop:9000/hbase
2017-03-22 08:58:55 331
原创 install sparkStreaming +karka in fedora
>source /etc/profile>sudo hostname hrs-hadoop>sudo sshd starthadoop/sbin>./start-allkarka/bin>./kafka-server-start.sh ../config/server.properties karka/bin>./kafka-console-producer.sh --br
2017-03-21 08:41:53 364
原创 intergrate sparkSQL with hive
copy hive-site to {spack_HOME}/conf ,and add two properties: hive.metastore.local true --> hive.metastore.schema.verification false
2017-03-20 10:09:55 433
原创 install hive in fedora
1、环境变量 ~/.bash_profileexport JAVA_HOME=/home/jka07@int.hrs.com/software/jdk1.8.0_121PATH=$PATH:$JAVA_HOME/binexport SCALA_HOME=/usr/share/scalaexport CLASSPATH=.:$JAVA_HOME/lib:$JAVA_HOM
2017-03-17 09:39:23 314
原创 install hadoop in fedora
1>hostname hrs-hadoop (which will used in xml)2>mkdir -p /home/jka07@int.hrs.com/hadoop/dfs/name3> add property in /home/jka07@int.hrs.com/software/hadoop-2.7.0/etc/hadoop/hdfs-site.xml
2017-03-16 16:27:21 331
2013_uboot_aston.txt
2020-05-24
uboot_116-linux2.6.32.7z
2012-09-11
jdbc——内嵌事务
2012-03-13
linux_0.11_bochs
2012-02-23
java数据结构
2011-12-31
jbpm4.4请假流程
2011-12-09
你好,我是jimmy,订阅你的“零基础驱动”。
2023-11-02
TA创建的收藏夹 TA关注的收藏夹
TA关注的人