![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
datax
回到未来望过去
oracle性能20年研究(saa批量自动优化分析,job、expdp的undo、temp内部运行机制等)
自行开发设计ssi平台(支持vpd)
自行开发设计pythonQT管理平台(系统监控、导出xls、常用字典、常用sql,日常运维sql(支持参数化))应用formysql,fororacle,fordm
python工具应用:工作量化监控mail日报,ogg监控日报(让领导发现问题),pyforweblogic监控自动重启
pyformysql数据外挂(降低mysql华为云性能峰值),py推荐算法落地社保
E-mail:li_tao@neusoft.com
展开
-
datax的断点续传实战
思路:查看日志,分成了多少个tasks2021-11-17 05:32:36.654 [job-0] INFO JobContainer - DataX Reader.Job [oraclereader] splits to [51] tasks.2021-11-17 05:32:36.654 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] splits to [51] tasks.然后看看分段select "PSN..原创 2021-11-18 20:00:11 · 2056 阅读 · 0 评论 -
datax的jobjson的jinja2的oracle来源调用
import cx_Oracleimport sysimport datetimefrom jinjajson import *os.environ['NLS_LANG']='SIMPLIFIEDCHINESE_CHINA.ZHS16GBK'os.environ['NLS_LANG'] = 'SIMPLIFIED CHINESE_CHINA.ZHS16GBK'os.environ['NLS_LANG'] = 'AMERICAN_AMERICA.AL32UTF8'os.environ[..原创 2021-11-16 12:01:36 · 82 阅读 · 0 评论 -
datax的jobjson的jinja2的mysql库来源py调用
import cx_Oracleimport sysimport datetimefrom jinjajson import *import pymysqlos.environ['NLS_LANG']='SIMPLIFIEDCHINESE_CHINA.ZHS16GBK'os.environ['NLS_LANG'] = 'SIMPLIFIED CHINESE_CHINA.ZHS16GBK'os.environ['NLS_LANG'] = 'AMERICAN_AMERICA.AL32UTF..原创 2021-11-16 11:59:52 · 437 阅读 · 0 评论 -
datax的jobjson的jinja2.python代码
import jinja2import osdef crtjson(username,tablename,colname,tpltype): path=r'F:\pyconsole\tool\datax' jsondir=path+'/'+username+'/job' try: os.mkdir(jsondir) except: pass env = jinja2.Environment(loader=jinja2.File.原创 2021-11-16 11:58:03 · 545 阅读 · 0 评论 -
datax的jobjson的jinja2模板mysql2mysql
{ "job": { "setting": { "speed": { "channel": $speedchannel, "byte": $speedbyte }, "errorLimit": { "record": $errrecord, "percentage": $errpercentage } }, "content": [ { ".原创 2021-11-16 11:57:00 · 137 阅读 · 0 评论 -
datax的jobjson的jinja2模板mysql2oracle
{ "job": { "setting": { "speed": { "channel": $speedchannel, "byte": $speedbyte }, "errorLimit": { "record": $errrecord, "percentage": $errpercentage } }, "content": [ { ".原创 2021-11-16 11:56:29 · 473 阅读 · 0 评论 -
datax的jobjson的jinja2模板oracle2mysql
{ "job": { "setting": { "speed": { "channel": $speedchannel, "byte": $speedbyte }, "errorLimit": { "record": $errrecord, "percentage": $errpercentage } }, "content": [ { ".原创 2021-11-16 11:55:29 · 484 阅读 · 0 评论