- 博客(6)
- 资源 (5)
- 收藏
- 关注
原创 pig分析日志脚本(1) 统计行数和单词个数wordcount
--统计数据的行数 cd hdfs:/// A = LOAD '/logdata/2012*/*/nohup_*' AS (name:chararray) ; B = GROUP A BY name; C = FOREACH B GENERATE group, COUNT(A); D = ORDER C BY ($1); E = FILTER D BY $1 > 200;
2013-01-31 16:06:01 5058
原创 hadoop报错导致flume无法写入日志文件,hadoop报错如下xceiverCount 258 exceeds the limit of concurrent xcievers 256
hadoop报错导致flume无法写入日志文件,hadoop报错如下xceiverCount 258 exceeds the limit of concurrent xcievers 256问题描述:报错具体如下2013-01-21 00:00:07,547 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiv
2013-01-22 16:03:48 2441
原创 flume报错 Configured capacity is 100000000 but the checkpoint file capacity is 1000000
最近flume运行不是很稳定,本次由于hadoop不能写入,导致flume报错,Configured capacity is 100000000 but the checkpoint file capacity is 1000000,重启flume后问题仍然存在。1,详细报错如下:22 Jan 2013 11:07:42,568 INFO [pool-7-thread-1] (or
2013-01-22 14:20:16 3575
原创 使用linux logrotate工具清理oracle listener日志
logrotate 工具是一个 Linux 系统自带的日志回滚程序,由系统计划服务工具 cron 程序启动,可以对各种系统日志进行回滚,由于oracle listener日志增长较快,需要定期清理,因此想到了使用这个工具,下面是具体的用法1,添加一个配置文件vi /etc/logrotate.d/oracle-listener/oracle/app/oracle/diag/tnslsn
2013-01-07 14:23:44 2009
原创 修改文件目录权限导致数据库连接报错ORA-12547
修改文件目录权限导致数据库连接报错1,使用oracle用户sysdba登录数据库报错ORA-12547-bash-3.2$ sqlplus "/as sysdba"SQL*Plus: Release 11.2.0.2.0 Production on 星期五 1月 4 16:59:26 2013Copyright (c) 1982, 2010, Oracle. All ri
2013-01-06 10:29:20 2240
原创 flume-ng 问题处理(1)
1,flume日志报错,同时没能正常收集相关日志文件Caused by: org.apache.flume.ChannelException: Space for commit to queue couldn't be acquired Sinks are likely not keeping up with sources, or the buffer size is too tight
2013-01-04 16:17:40 10196
oracle 11g HAIP介绍
2011-12-15
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人