关闭

spark提交java程序异常

错误 Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes   scala的jar包没任何问题 用java写的jar包提交到spark的时候抛错 zip -d JarName.jar META-INF/*.S...
阅读(88) 评论(0)

spark提交任务java.nio.channels.ClosedChannelException

1.提交任务 ./spark-submit --master "yarn" --driver-memory 1g --executor-memory 1g --class KeyCount /root/IdeaProjects/SparkApp/out/artifacts/SparkApp_jar/SparkApp.jar 报错如下: 17/08/25 14:47:03 ERROR cl...
阅读(1250) 评论(0)

Spark java.lang.NoSuchMethodError: scala.Predef$.refArrayOps

1.问题 2. spark运行的scala版本是有限制 提示 with scala 2.10 support 下载对应版本的scala,然后重新编译jar包...
阅读(151) 评论(0)

python requests指定出口ip

爬虫需要,一个机器多个口,一个口多个ip,为轮询这些ip demo #coding=utf-8 import requests,sys,socket from requests_toolbelt.adapters import source reload(sys) sys.setdefaultencoding('utf-8') responses =...
阅读(244) 评论(0)

ROS Mikrotik PCC配置记录

两条为例: ip firewall mangle add action=mark-connection chain=prerouting comment=pcc1 dst-address-type=!local new-connection-mark=pcc1 per-connection-classifier=both-addresses:2/0 src-address=192.168...
阅读(73) 评论(0)

pptp iptables snat记录

iptables # Generated by iptables-save v1.4.7 on Fri May 12 18:26:39 2017 *nat :PREROUTING ACCEPT [305:30920] :POSTROUTING ACCEPT [5:412] :OUTPUT ACCEPT [5:412] -A POSTROUTING -s 192.168.2.0/24 -...
阅读(107) 评论(0)

iptables snat 记录

iptables # Generated by iptables-save v1.4.7 on Mon Jun 19 11:02:25 2017 *security :INPUT ACCEPT [428:39712] :FORWARD ACCEPT [62:5208] :OUTPUT ACCEPT [514:56376] COMMIT # Completed on Mon J...
阅读(110) 评论(0)

关于ipv6的笔记

用途 阿里云放IOS app的服务器端信息 或者ipv6 server的需要 隧道服务 https://tunnelbroker.net/ 配置服务器 net.ipv6.conf.all.disable_ipv6 = 0 net.ipv6.conf.default.disable_ipv6 = 0 net.ipv6.conf.lo.disable_ipv6 = 0 ...
阅读(190) 评论(0)

linux用tc限速

tc qdisc add dev eth0 root tbf rate 1Mbit latency 50ms burst 10000 mpu 64 mtu 150000...
阅读(594) 评论(0)

oracle 倒出csv

/opt/sh/sqluldr2_linux64_10204.bin user=user/pass@services query="select * from table_name" file=/opt/csv/csv_name.csv charset=ZHS16GBK field=0x09 quote=0x22 escape=0x5c escf=0x22 esct=0x22 record=0x0...
阅读(215) 评论(0)

OpenStack

记录一个OpenStack的bug 启动实例的时候会报出500错误, 启动实例命令 nova boot --flavor 1 --key_name demo-key --image d7057028-a498-4576-86b4-e6aef50dab69 test1 日志路径/var/log/nova/nova-api.log记录如下: 2016-07-15 17:06:25.082...
阅读(451) 评论(0)

tomcat enable ssl

创建key keytool -genkey -alias wsria -keyalg RSA -keystore /usr/src/apache-tomcat-7.0.68/conf/mykey 导出key keytool -export -file /usr/src/apache-tomcat-7.0.68/conf/mykey.crt -alias wsria -keystore...
阅读(218) 评论(0)

pptp VPN配置

安装pptp yum -y install pptpd 配置pptp cat /etc/pptp.conf localip 192.168.1.1 remoteip 192.168.1.2-100 启动pptp /etc/init.d/pptpd start iptables配置nat [root@iZ25w20fzeyZ ~]# cat /etc/s...
阅读(463) 评论(0)

socket服务需要注意这两个头文件

#include #include 会出莫名其妙的没定义大小的结构体,端口转换成int时出现段错误等等。...
阅读(237) 评论(0)

Linux IPsec点到点配置

linux点到点vpn ipsec配置 Juniper netscreen interop Juniper end point: set ike gateway "GW-01" address Main outgoing-zone "V1-Untrust" preshare "Your PSK Here" proposal "pre-g2-3des-md5" set ike...
阅读(1438) 评论(0)
188条 共13页1 2 3 4 5 ... 下一页 尾页
    个人资料
    • 访问:192612次
    • 积分:3653
    • 等级:
    • 排名:第9863名
    • 原创:180篇
    • 转载:7篇
    • 译文:1篇
    • 评论:5条
    最新评论