<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[jia_7m的博客]]></title><description><![CDATA[]]></description><link>https://blog.csdn.net/jia_7m</link><language>zh-cn</language><generator>https://blog.csdn.net/</generator><copyright><![CDATA[Copyright &copy; jia_7m]]></copyright><item><title><![CDATA[集群搭建全过程]]></title><link>https://blog.csdn.net/jia_7m/article/details/97006781</link><guid>https://blog.csdn.net/jia_7m/article/details/97006781</guid><author>jia_7m</author><pubDate>Sat, 09 Oct 2021 15:42:03 +0800</pubDate><description><![CDATA[文章目录1.集群环境1.1 Zookeeper集群配置1.2 Hadoop安装1.3 HBase集群配置1.4 启动集群1.5 Spark安装1.6 Kafka安装2. 错误2.1 大数据之Zookeeper启动错误
1.集群环境
CentOS:7
JDK:1.8
Hadoop:3.0.0
Spark:2.4.0
HBase:

集群包括三个节点
主机名  IP
node01 192.168.4....]]></description><category></category></item><item><title><![CDATA[rabbitmq配置证书]]></title><link>https://blog.csdn.net/jia_7m/article/details/113242450</link><guid>https://blog.csdn.net/jia_7m/article/details/113242450</guid><author>jia_7m</author><pubDate>Wed, 27 Jan 2021 10:50:12 +0800</pubDate><description><![CDATA[rabbitmq wss协议
准备证书

ca证书
server证书
私钥

阿里云中下载pfx证书。使用如下方式转化成Rabbitmq需要配置的证书：

提取ca证书:
openssl pkcs12 -in www.xxxx.com.pfx -nodes -password pass:域名证书密码 -nokeys -cacerts -out cacert.pem

提取server证书:
openssl pkcs12 -in  4000000_www.xxxx.com.pfx -nodes -passwo]]></description><category></category></item><item><title><![CDATA[rabbitmq安装]]></title><link>https://blog.csdn.net/jia_7m/article/details/112806280</link><guid>https://blog.csdn.net/jia_7m/article/details/112806280</guid><author>jia_7m</author><pubDate>Tue, 19 Jan 2021 12:04:25 +0800</pubDate><description><![CDATA[文章目录安装rabbitmqerlang安装安装rabbitmqYou could try using --skip-broken to work around the problem You could try r
安装rabbitmq
rabbitmq官网
erlang安装
erlang.repo链接

1. 
# /etc/yum.repos.d/rabbitmq_erlang.repo
[rabbitmq_erlang]
name=rabbitmq_erlang
baseurl=https://pa]]></description><category></category></item><item><title><![CDATA[spark集群无法停止]]></title><link>https://blog.csdn.net/jia_7m/article/details/108572940</link><guid>https://blog.csdn.net/jia_7m/article/details/108572940</guid><author>jia_7m</author><pubDate>Mon, 14 Sep 2020 10:08:37 +0800</pubDate><description><![CDATA[[data@lcoalhost-1 spark-2.4.0]$ ./sbin/stop-all.sh 
localhost-1: no org.apache.spark.deploy.worker.Worker to stop
localhost-2: no org.apache.spark.deploy.worker.Worker to stop

原因分析
spark集群的停止是通过xxx.pid文件操作
查看stop-master,其中停止语句为
"${SPARK_HOME}/sbin"/spark-]]></description><category></category></item><item><title><![CDATA[更换python源]]></title><link>https://blog.csdn.net/jia_7m/article/details/108071074</link><guid>https://blog.csdn.net/jia_7m/article/details/108071074</guid><author>jia_7m</author><pubDate>Tue, 18 Aug 2020 10:21:27 +0800</pubDate><description><![CDATA[更换python源
pip国内的一些镜像

阿里云 http://mirrors.aliyun.com/pypi/simple/
中国科技大学 https://pypi.mirrors.ustc.edu.cn/simple/
豆瓣(douban) http://pypi.douban.com/simple/
清华大学 https://pypi.tuna.tsinghua.edu.cn/simple/
中国科学技术大学 http://pypi.mirrors.ustc.edu.cn/simple/

永久修改]]></description><category></category></item><item><title><![CDATA[spark如何配置Python虚拟环境]]></title><link>https://blog.csdn.net/jia_7m/article/details/90480070</link><guid>https://blog.csdn.net/jia_7m/article/details/90480070</guid><author>jia_7m</author><pubDate>Thu, 23 May 2019 14:57:47 +0800</pubDate><description><![CDATA[方式一
# 在代码中配置环境变量
import os
os.environ["SPARK_HOME"] = "/usr/local/Cellar/apache-spark/1.5.1/"
os.environ["PYSPARK_PYTHON"]="/usr/local/bin/python3"

方式二

]]></description><category></category></item><item><title><![CDATA[centos7 python3安装 虚拟环境创建]]></title><link>https://blog.csdn.net/jia_7m/article/details/90438227</link><guid>https://blog.csdn.net/jia_7m/article/details/90438227</guid><author>jia_7m</author><pubDate>Wed, 22 May 2019 10:53:38 +0800</pubDate><description><![CDATA[1、安装相关包，用于下载编译python3
yum install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gcc make

2、解压python3，安装包 并编译
tar -zvxf Python-3.6.4.tgz
mv Python-3.6.4 pytho...]]></description><category></category></item><item><title><![CDATA[Spark中Python与JVM的交互]]></title><link>https://blog.csdn.net/jia_7m/article/details/88949198</link><guid>https://blog.csdn.net/jia_7m/article/details/88949198</guid><author>jia_7m</author><pubDate>Mon, 01 Apr 2019 15:30:53 +0800</pubDate><description><![CDATA[原文链接：Spark通信原理之Python与JVM的交互
我们知道Spark平台是用Scala进行开发的，但是使用Spark的时候最流行的语言却不是Java和Scala，而是Python。原因当然是因为Python写代码效率更高，但是Scala是跑在JVM之上的，JVM和Python之间又是如何进行交互的呢？

在实际运行过程中，JVM并不会直接和Python进行交互，JVM只负责启停Pytho...]]></description><category></category></item><item><title><![CDATA[Spark之集群搭建]]></title><link>https://blog.csdn.net/jia_7m/article/details/88239151</link><guid>https://blog.csdn.net/jia_7m/article/details/88239151</guid><author>jia_7m</author><pubDate>Thu, 14 Mar 2019 10:14:11 +0800</pubDate><description><![CDATA[安装条件：

1、安装jdk
2、安装hadoop集群


]]></description><category></category></item><item><title><![CDATA[集群环境免密登录]]></title><link>https://blog.csdn.net/jia_7m/article/details/88240369</link><guid>https://blog.csdn.net/jia_7m/article/details/88240369</guid><author>jia_7m</author><pubDate>Wed, 06 Mar 2019 16:46:50 +0800</pubDate><description><![CDATA[一、修改hosts文件
1、在root权限下输入以下命令
vim /etc/hosts

编辑hosts文件
#127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1         localhost localhost.localdomain localhost6 localhost...]]></description><category></category></item><item><title><![CDATA[centOS7重新安装Python2和yum]]></title><link>https://blog.csdn.net/jia_7m/article/details/87940032</link><guid>https://blog.csdn.net/jia_7m/article/details/87940032</guid><author>jia_7m</author><pubDate>Wed, 27 Feb 2019 11:35:52 +0800</pubDate><description><![CDATA[centOS7重新安装Python2和yum
一、卸载Python
rpm -qa|grep python|xargs rpm -e --allmatches --nodeps


二、卸载yum
三、

]]></description><category></category></item></channel></rss>