使用python解析apache日志并上传到HBase

环境设置：

• 安装thrift, 默认情况下thrift python包在/usr/python2.7/site-packages/thrift下
• 安装apachelog python包
• 运行thrift --gen py HBase.thrift (在{HBASE_HOME}/src/java/org/apache/hadoop/hbase/thrift目录下),会在当前目录下产生gen-py目录，里面包含了hbase的python包
• 在eclipse里新建python项目，设置项目的属性，在PyDev-PYTHONPATH属性页中，ExternalLibraries Tab页中，添加sourcefolder /home/lotus/work/hbase-0.90.4-cdh3u2/gen-py;/usr/lib/python2.7/site-packages

import sys
import time
from thrift import Thrift  
from thrift.transport import TSocket, TTransport  
from thrift.protocol import TBinaryProtocol  
from hbase import ttypes  
from hbase.Hbase import *  
import apachelog



# tableName apachefile1, apachefile2, ..
if __name__ == "__main__":
    
    if(len(sys.argv) < 2):
        print "command line: tableName apachefile1, apachefile2, ...."
        print sys.argv