hadoop
回到未来望过去
oracle性能20年研究(saa批量自动优化分析,job、expdp的undo、temp内部运行机制等)
自行开发设计ssi平台(支持vpd)
自行开发设计pythonQT管理平台(系统监控、导出xls、常用字典、常用sql,日常运维sql(支持参数化))应用formysql,fororacle,fordm
python工具应用:工作量化监控mail日报,ogg监控日报(让领导发现问题),pyforweblogic监控自动重启
pyformysql数据外挂(降低mysql华为云性能峰值),py推荐算法落地社保
E-mail:li_tao@neusoft.com
展开
-
dblab-VirtualBox的hive的datax连接传输
数据源配置{ "job": { "setting": { "speed": { "channel": 3, "byte": 1048576 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "content": [ { "reader": { ...原创 2022-04-15 15:24:46 · 1828 阅读 · 0 评论 -
dblab-VirtualBox的hive2的beeline接入
hive-site.xml<?xml version="1.0" encoding="UTF-8" standalone="no"?><?xml-stylesheet type="text/xsl" href="configuration.xsl"?><configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <valu原创 2022-04-15 09:17:32 · 196 阅读 · 0 评论 -
dblab-VirtualBox的hive的导出实践三
insert overwrite local directory '/home/hadoop/exporttest1.txt' select * from test1;insert overwrite directory 'sogou/exporttest1.txt' select * from test1;hive> insert overwrite directory 'sogou/exporttest1.txt' select * from test1;WARNING: Hive-o原创 2022-04-14 11:13:21 · 1102 阅读 · 0 评论 -
dblab-VirtualBox的hive的分区表实践二
create table test3(a string,b string,c string) partitioned by (d string) row format delimited fields terminated by '\t' stored as textfile;hive> desc test3 > ;OKa string b原创 2022-04-14 10:21:41 · 411 阅读 · 0 评论 -
dblab-VirtualBox的hive的导入导出实践一
hadoop@dblab-VirtualBox:~$ cat /pub/test.txt1 a1 b12 a2 b23 a3 b34 a4 b原创 2022-04-14 09:41:08 · 1076 阅读 · 0 评论 -
hadoop的存储于文件关联
hadoop的存储于文件关联原创 2022-04-14 09:29:53 · 645 阅读 · 0 评论 -
dblab-VirtualBox的hadoop文件访问
dblab-VirtualBox的hadoop文件访问原创 2022-04-11 16:27:58 · 545 阅读 · 0 评论 -
dblab-VirtualBox的hadoop环境
导入虚拟机,hostonly方式到wifi上,可以直接护互联网,开机,选网卡复制1、cd /usr/local/hadoop/sbin2、./start-all.shThis script is Deprecated. Instead use start-dfs.sh and start-yarn.shStarting namenodes on [localhost]localhost: starting namenode, logging to /usr/local/hadoop/log原创 2022-04-11 14:41:53 · 699 阅读 · 0 评论