Linux
一只独行特立的zhu
这个作者很懒,什么都没留下…
展开
-
java.io.IOException: Disk quota exceeded 磁盘配额已满
java.io.IOException: Disk quota exceeded原创 2022-07-13 14:50:25 · 2531 阅读 · 0 评论 -
Azkaban启动报错解决
环境:一台虚拟机(web和exector都在一台机器上)MySQL 8.x(后面的问题多因他而起)Hive-3.1.2Azkaban-exec-server-3.84.4Azkaban-web-server-3.84.41、SLF4J问题:ERROR [StdOutErrRedirect] [Azkaban] SLF4J: Class path contains multiple SLF4J bindings.2021/09/30 10:02:31.820 +0800 ERROR [StdO原创 2021-09-30 13:55:53 · 2833 阅读 · 0 评论 -
(Sqoop报错记录) Encountered IOException running import job: java.io.IOException: Hive exite
ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 642021-09-29 16:15:31,487 INFO hive.HiveImport: FAILED: SemanticException Line 2:17 Invalid path ''hdfs://192.168.8.131:9000/user/root/_sqoop/0原创 2021-09-29 17:05:43 · 2522 阅读 · 0 评论 -
运行Sqoop的job省略输入MySQL密码
创建job: ods_inc_test3vim test001.shsqoop job --create ods_inc_test3 -- import \--connect jdbc:mysql://localhost:3306/zhutest \--username root \--password root \--table origin_test1 \--incremental lastmodified \--check-column oper_time \--last-valu原创 2021-09-28 17:35:58 · 115 阅读 · 0 评论 -
Exception in thread “main“ java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class at io.github.interestinglab.waterdrop.Waterdrop$.<init>(Waterdrop.scala:21) at io.github.interestinglab.waterdrop.Waterdrop$.<clinit>(Waterdrop原创 2021-09-23 15:08:03 · 1231 阅读 · 0 评论 -
Sqoop找不到主类:Error: Could not find or load main class org.apache.sqoop.Sqoop
Sqoop找不到主类:Error: Could not find or load main class org.apache.sqoop.Sqoop解决方案:1、下载sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz包(某硅谷有)2、解压后将sqoop-1.4.6.jar放到hadoop的lib目录下3、修改/etc/profilevim /etc/profile#sqoop export SQOOP_HOME=/opt/module/sqoopexport原创 2021-09-22 16:05:05 · 164 阅读 · 0 评论 -
(可用备份)Centos7.x部署Clickhourse
先贴上Clickhouse的官方文档:https://clickhouse.tech/docs/zh/getting-started/install/环境准备:Centos 7clickhouse需要el7的适配一、安装先检测是否支持SSE 4.2的命令:$ grep -q sse4_2 /proc/cpuinfo && echo "SSE 4.2 supported" || echo "SSE 4.2 not supported"使用yum源装配(亲测可用):添加 yu原创 2021-08-19 16:23:42 · 165 阅读 · 0 评论 -
(Linux报错记录)PGsql,could not connect to server:Connection refused(0x0000274D/10061)
问题描述:装完Greenplum6.40后出现的报错:PostgreSQL连接出错,could not connect to server:Connection refused(0x0000274D/10061)解决方案(仅供参考):检查防火墙有没有开放5432端口,我的防火墙是关闭的,但是重新开启防火墙后,再开放5432端口,就可以连接上了。查看防火墙状态:systemctl status firewalld开启/关闭防火墙:systemctl start firewalldsystemc原创 2021-08-18 18:33:57 · 1959 阅读 · 0 评论 -
Linux文件传输(服务器之间)
想从别人的服务器中传输文件,Linux中有一个好用的命令。复制目录下的所有文件:scp -r 对方的地址(要保证能够ping通)scp -r 172.xx.x.xxx:/data/(目标文件目录) /(本机指定目录)原创 2021-08-16 15:27:45 · 82 阅读 · 0 评论 -
(Linux报错记录)报错:ping: www.baidu.com: Name or service not known
问题描述:昨天还能ping通baidu,今天起来发现报了这个错误。解决方案:第一步,先win+r,在cmd中尝试ping 192.168.8.130(我的虚拟机地址),发现能够ping通(那么大概率是DNS域名解析的问题)第二步:在Linux中修改网络配置vi /ect/syconfig/network-scripts/ifcfg-ens32添加上DNS1=114.114.114.114然后保存退出,重启网络service network restart再ping一次发现能够pin原创 2021-08-06 10:58:35 · 977 阅读 · 0 评论 -
(Linux报错记录)开启Redis报错:Creating Server TCP listening socket *:6379: bind: Address already in use
[root@localhost src]# ./redis-server1306:C 05 Aug 15:35:57.721 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1306:C 05 Aug 15:35:57.721 # Redis version=4.0.6, bits=64, commit=00000000, modified=0, pid=1306, just started1306:C 05 Aug 15:35:57.721 # Warn原创 2021-08-05 15:49:18 · 387 阅读 · 0 评论 -
Centos更换镜像源(亲测可用)
2020-12-02 centos 停止更新centos 6,导致yum出现报错解决方案:1、进入 /etc/yum.repo.d/ 文件夹,先将原来的CentOS-Base.repo备份2、然后编辑CentOS-Base.repo,复制下面的内容把原内容覆盖3、yum clean4、yum makecache# CentOS-Base.repo## The mirror system uses the connecting IP address of the client and the原创 2021-01-31 14:20:50 · 891 阅读 · 0 评论