关闭

日志分析hive

hadoop fs -put logs_20160522 /nginx/20160523 date=`/bin/date +%Y%m%d`/letv/data/apache-hive-0.13.1-bin/bin/hive -e "CREATE EXTERNAL TABLE if not exists nginx_20160620( host STRING, uri STRING,...
阅读(81) 评论(0)

日志分析sql

CREATE EXTERNAL TABLE if not exists nginx_20160619( host STRING, uri STRING, request_method STRING, remote_addr STRING, http_marketChannelName STRING, http_hwMac STRING, http_et...
阅读(108) 评论(0)

spark 使用

要在spark-defaults.conf 设置如下参数,避免很多问题 spark.driver.maxResultSize 2g spark.driver.memory 10g可能可以解决group by的问题 spark.serializer org.apache.spark.serializer.JavaSeri...
阅读(107) 评论(0)

mysql恢复

http://www.it610.com/article/3380901.htm http://www.xifenfei.com/2015/08/mysql-recovery-support.html位置在/usr/local/db/innodb_datashow variables like ‘datadir’; show variables like ‘%per_table%’;...
阅读(130) 评论(0)

集群问题

dataNode 连接ha两个主节点 nameNode 连接zookeeper 报错org.apache.hadoop.ipc.Client: Retrying connect to server: THadoop7/10.185.28.26:8485. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixed...
阅读(139) 评论(0)

jdk安装配置

http://blog.csdn.net/licongcong_0224/article/details/12756959...
阅读(98) 评论(0)
    个人资料
    • 访问:17436次
    • 积分:802
    • 等级:
    • 排名:千里之外
    • 原创:51篇
    • 转载:76篇
    • 译文:0篇
    • 评论:0条
    文章分类
    评论排行