zljzlj1234的博客

原创 spark属性配置优先级

每个值将作为一个flags传递到应用中并个SparkConf对象中相应的属性进行合并。通过SparkConf 对象配置的属性优先级最高；其次是对spark-submit 或 spark-shell通过flags配置；最后是spark-defaults.conf文件中的配置。

转载 easyui插件库

http://www.jeasyui.net/plugins/169.html

原创 启动springboot报错

Field pontusJobDao in cn.tongdun.datacompute.biz.pontus.service.Pontus2JobService required a bean of type 'cn.tongdun.datacompute.biz.pontus.dao.PontusJobDao' that could not be found.Action:

原创 hibernate中如何用Annotion注解设置model中的字段不持久化

public final static int DELETESTATUS_YES=1; public final static int DELETESTATUS_NO=0; @Id @GeneratedValue( strategy = GenerationType.IDENTITY ) private Integer id;

原创 URI is not registered (Settings | Languages & Frameworks | Schemas and DTDs) in pom.xml

选中资源 fetch参考https://stackoverflow.com/questions/42569634/uri-is-not-registered-settings-languages-frameworks-schemas-and-dtds-in

原创 maven 编译spring-boot报错

localhost:web liujian.zhang$ mvn install[INFO] Scanning for projects...Downloading: http://maven.fraudmetrix.cn/nexus/content/groups/public/com/fasterxml/jackson/jackson-bom/2.4.2/jackson-bom-2.4.2.p

原创 dataframe写file的报错

org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby，原因namenode不是动态获取的

原创 hbase写的报错

caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid原因hmaster损坏

原创 mysql 用hfile写入到hbase报错

数据过大时报错，不知道什么原因造成，还在想办法找

原创 distcp传输文件俩边hdfs的blocksize不同报错

distcp 设置-skipcheckcrc -update代码编写如下 val mapper = conf.mapper val bandwidth = conf.bindwidth val writeMode = conf.getWriteMode val sourcePath = conf.readerHdfsPath val targetPath = co

原创 java 基础

package com.chen.demo;import java.lang.reflect.ParameterizedType;import java.lang.reflect.Type;class param<T1, T2> { class A {} class B extends A {} private Class<T1> entityClass;

原创 hdfs版本引起的问题check-sum mismatch between

转载 axure 8.0注册码

Licensee:米 业成 (STUDENT)Key:nFmqBBvEqdvbiUjy8NZiyWiRSg3yO+PtZ8c9wdwxWse4WprphvSu9sohAdpNnJK5用户名：axureuser序列号：8wFfIX7a8hHq6yAy6T8zCz5R0NBKeVxo9IKu+kgKh79FL6IyPD6lK7G6+tqEV4LG用户名：

原创 mesos日常工作

mesos查看日志192.168.40.130 spark提交任务机192.168.40.131查看日志的机器

原创 mysql日常 bug发现

1. 数据交换问题追踪 > image2017-11-20 15:22:49.png" src="http://wiki.tongdun.me/download/attachments/17312816/image2017-11-20%2015%3A22%3A49.png?version=1&modificationDate=1511162570000&api=v2" alt="" style="