luyee2010-CSDN博客

原创 python 日期时间

>>> print datetime.date.today().strftime('%Y%m%d')20180302>>> print (datetime.date.today()-datetime.timedelta(days=30)).strftime('%Y%m%d') 20180131

2018-03-02 11:27:56 606

原创 java.lang.AbstractMethodError: com.alibaba.otter.canal.common.zookeeper.ZooKeeperx.writeDat aReturnS

错误java.lang.AbstractMethodErrorjava.lang.AbstractMethodError: com.alibaba.otter.canal.common.zookeeper.ZooKeeperx.writeDataReturnStat(Ljava/lang/String;[BI)Lorg/apache/zookeeper/data/Stat;

2018-01-16 17:49:39 986

原创钉钉报警

自定义机器人更多-->机器人管理-->自定义机器人-->添加-->复制Webhook地址 https://oapi.dingtalk.com/robot/send?access_token=xxxxxxxx简单点的，直接给json参数就好了curl https://oapi.dingtalk.com/robot/send?access_token=xxx

2017-10-23 15:38:49 3455

原创 KUDU-Got out-of-order key column: name: "ID" type: STRING is_key: true is_nullable: false

Got out-of-order key column: name: "ID" type: STRING is_key: true is_nullable: falseThe columns which make up the primary key must be listed first in the schema.https://community

2017-09-25 16:21:26 4374

原创避免mybatis SUM求和返回null

SELEC SUM(ORDER_MONEY ) FROM gm_order WHERE ADD_UID = #{userCode}如上写法如果没有结果的话就会返回null,其实我们希望返回的是0.00这种情况SELECT COALESCE(SUM(ORDER_MONEY),0) FROM gm_order WHERE ADD_UID = #{userCode}

2017-09-01 03:57:03 15587

原创 Spring+Mybatis 多数据源配置Invalid bound statement (not found)

单独使用某一个数据源配置都是ok的，同时两个以上就会报错。几个数据源的mapper.xml，dao放在同一个目录下了，分开之后分别放在不同的目录就ok了

2017-08-29 17:16:47 7036 1

原创 Confluent Platform部署

下载链接地址：http://packages.confluent.io/archive/3.3/confluent-oss-3.3.0-2.11.tar.gz点击打开链接Confluent Platform Quickstart

2017-08-29 03:05:47 4248

原创 mybatis Invalid bound statement (not found)

org.apache.ibatis.binding.BindingException: Invalid bound statement (not found)将select 语句加上 ']]>"，居然好了

2017-08-29 03:02:19 604

原创 kudu1.4.0 安装配置

包下载地址archive.cloudera.com/kudu

2017-08-25 01:45:26 1198

原创 Percona-XtraBackup安装配置

下载安装# wget https://www.percona.com/downloads/XtraBackup/Percona-XtraBackup-2.4.8/binary/redhat/6/x86_64/percona-xtrabackup-24-2.4.8-1.el6.x86_64.rpm# rpm -ivh percona-xtrabackup-24-2.4.8-1.el6.x86_

2017-08-18 11:16:23 1122

原创 python2.7 各种姿势

[root@datablm170 MySQL-python-1.2.3]# python setup.py buildTraceback (most recent call last): File "setup.py", line 5, in from setuptools import setup, ExtensionImportError: No module named s

2017-08-16 11:08:47 682

原创 mydumper编译失败

shit# cmake .-- Using mysql-config: /usr/bin/mysql_config-- MySQL not found.CMake Warning at docs/CMakeLists.txt:9 (message): Unable to find Sphinx documentation generator-- ---------------

2017-08-15 17:10:49 1028

原创 NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

spark 1.6 scala2.10 替换jackson相关的包依赖 com.fasterxml.jackson.module jackson-module-scala_2.10 2.7.4 com.fasterxml.jackson.modu

2017-08-08 13:44:42 5141 1

原创添加CDH 5 Maven Repository

cloudera https://repository.cloudera.com/artifactory/cloudera-repos/ 点击打开链接 https://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh5_maven_repo.html

2017-08-02 10:21:04 1988

原创 http4client rest buik elasticsearch

maven org.apache.httpcomponents httpclient 4.5.2 org.apache.httpcomponents httpcore 4.4 org.apache.httpcomponents httpmime 4.4bulk

2017-07-20 11:29:49 674

原创 mysqlbinlog: unknown variable 'default-character-set=utf8'

mysqlbinlog: unknown variable 'default-character-set=utf8'加 --no-defaults参数 mysqlbinlog --no-defaults /var/lib/mysql/mysql-bin.000001

2017-07-12 15:18:56 615

原创 The total number of locks exceeds the lock table size错误

解决修改 innodb_buffer_pool_sizeHow to set global innodb_buffer_pool_size?

2017-07-10 21:15:41 1292

原创 spark1.6+elasticsearch5.x 底层jar冲突

spark1.6.3elasticsearch 5.4bulk api ```(Netty4Utils:117)-NoSuchMethodError io.netty.buffer.CompositeByteBuf.addComponents(ZLjava/lang/Iterable;)Lio/netty/buffer/CompositeByteBuf;at o

2017-07-10 00:06:26 3311 7

原创 spark yarn /bin/bash: /bin/java: is a directory

mac Os 10.12 +hadoop2.7.2+spark1.6.1 ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster --driver-memory 4g --executor-memory 2g

2017-06-22 03:42:00 1834

原创 Error:Module 'xxxx' production: java.lang.NullPointerException

调试运行kafka的时候碰到这个Error:Module 'core_main' production: java.lang.NullPointerException到scala-intellij下载idea版本对应的scala插件在【Plugins】下搜索scala，选择【install plugin from disk】，然后在路径中选中插件文件(scala

2017-02-10 16:07:54 4125

原创 solrcloud undefined field text

org.apache.solr.common.SolrException: undefined field text at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1298) at org.apache.solr.schema.IndexSchema$SolrQueryAnalyz

2016-05-31 14:06:39 1378

原创 Mac OS 安装tensorflow RuntimeError: Broken toolchain: cannot link a simple C program

Mac OS 安装tensorflow RuntimeError: Broken toolchain: cannot link a simple C programMac OS 安装tensorflow的时候碰到的问题 RuntimeError: Broken toolchain: cannot link a simple C program这个其实是pip 在更新numpy的时候出的问题。解决方

2016-04-06 14:55:35 7619

原创 [Gradle]org.gradle.tooling.GradleConnectionException: Could not install Gradle distribution from 'ht

mac 下org.gradle.tooling.GradleConnectionException: Could not install Gradle distribution from 'https://services.gradle.org/distributions/gradle-2.1-all.zip'.解决方案：到http://services.gradle.org/dist

2016-04-01 17:14:45 13666 1

原创 Maven notes

Maven notes <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <sonar.skippedModules>sms-admin,sms-web</sonar.skippedModules> <sonar.exclusions>

2015-12-09 16:55:39 1025

原创 Failed to install metadata only whitespace content allowed before start tag and not \u0

突然蓝屏，然后重启发现这个玩意已经不行了，编译就出这玩意，什么鬼后面直接删了.m2目录下相关的：maven-metadata-local.xml

2015-08-24 21:05:10 9187

原创 solr5.2.1

Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] fieldType "pint": Error loading class 'solr.IntField' at org.apache.solr.util.plugin.AbstractPluginLoader.load

2015-07-23 16:16:18 2844

原创 Log Processing With Storm

Learning storm book 笔记8有代码的书籍看起来就是爽，看完顺便跑个demo,感觉很爽！场景分析主要是利用apache的访问日志来进行分析统计如用户的IP来源，来自哪个国家或地区，用户使用的Os，浏览器等信息，以及像搜索的热词等信息的统计这里日志信息如下24.25.135.19 - - [1-01-2011:06:20:31 -0500] "GET

2014-12-11 01:59:43 4116

原创 Zookeeper 3.4.6 Client端流程粗略梳理

首先从Zookeeper入手，Zookeeper-->ClientCnxn-->sendThread/eventThreadpublic ZooKeeper(String connectString, int sessionTimeout, Watcher watcher, boolean canBeReadOnly) throws IOException{

2014-12-04 22:40:56 3001

原创 zookeeper启动流程简单梳理

等着测试童鞋完工，顺便里了下zookeeper的启动流程zk3.4.6启动脚本里面 nohup "$JAVA" "-Dzookeeper.log.dir=${ZOO_LOG_DIR}" "-Dzookeeper.root.logger=${ZOO_LOG4J_PROP}" \ -cp "$CLASSPATH" $JVMFLAGS $ZOOMAIN "$ZOOCFG

2014-11-14 22:09:19 6816

原创 solrcloud/solr error

1,Exception in thread "main" org.apache.solr.common.SolrException: Unknowndocument router '{name=implicit}'

2014-11-10 19:19:14 2409 1

原创 error[No partition metadata for topic test-1 due to kafka.common.LeaderNotAvailableException]

http://stackoverflow.com/questions/23228222/running-into-leadernotavailableexception-when-using-kafka-0-8-1-with-zookeeper-3Kafka uses an external coordination framework (by default Zookeeper) t

2014-11-06 11:12:41 11582 1

原创 metaq spring

spring metaqspring bean 配置 bean id="sessionFactory" class="com.taobao.metamorphosis.client.extension.spring.MetaqMessageSessionFactoryBean"> property name="zkConnect" value="192.168.137

2014-10-20 20:26:22 4472

原创 metaq入门部署到实战

zookeeper部署，这里单机zk为例。wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.5/zookeeper-3.4.6.tar.gztar -zxvf zookeeper-3.4.6.tar.gzcd zookeeper-3.4.6mkdir datacp conf/zoo_sample.cfg con

2014-10-17 15:26:40 13894 1

转载自旋锁和互斥锁

bdsohttp://blog.csdn.net/kyokowl/article/details/6294341POSIX threads(简称Pthreads)是在多核平台上进行并行编程的一套常用的API。线程同步(Thread Synchronization)是并行编程中非常重要的通讯手段，其中最典型的应用就是用Pthreads提供的锁机制(lock)来对多个线程之间共享的临

2014-10-10 01:10:14 1739

原创 Spark1.1.0 Transformations

TransformationsThe following table lists some of the common transformations supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for deta

2014-09-21 01:51:35 3949

原创 Spark1.1.0 Actions

ActionsThe following table lists some of the common actions supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for details.Ac

2014-09-21 01:50:55 2388

原创 Spark1.1.0 Spark SQL Programming Guide

Spark SQL Programming GuideOverviewGetting StartedData SourcesRDDsInferring the Schema Using ReflectionProgrammatically Specifying the SchemaParquet FilesLoading Data Programmaticall

2014-09-15 12:51:43 7119

原创 spark1.1.0 Machine Learning Library (MLlib)

Machine Learning Library (MLlib)MLlib is Spark’s scalable machine learning library consisting of common learning algorithms and utilities, including classification, regression, clustering, collabo

2014-09-15 12:51:10 4076

原创 Spark1.1.0 Spark Streaming Programming Guide

Spark Streaming Programming GuideOverviewA Quick ExampleBasic ConceptsLinkingInitializing StreamingContextDiscretized Streams (DStreams)Input DStreamsTransformations on DStreamsOutput Operatio

2014-09-15 12:50:18 7388