superset day01

姚circle

已于 2023-03-28 18:11:48 修改

阅读量740

点赞数

分类专栏： superset 文章标签： linux 运维 centos

于 2022-12-06 17:52:28 首次发布

本文链接：https://blog.csdn.net/qq_53822083/article/details/128201827

版权

superset 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

目录

安装supeset

1. 部署python环境

(1)安装Python3环境准备的包

(2)上传python安装包Python-3.6.6.tgz 至linux上

(3)编译安装python3.x

(4)安装python3的virtualenv并建⽴superset的env

(5)安装superset需要的安装包

2 Superset部署

(1）安装Superset

(2）安装Mysql数据包

(3）创建数据库

（4）修改superset元数据库

(5）初始化Supetset数据库（Supetset是一个web应用，自带数据库，需要初始化）

(superset) [root@bigdata15 src]$ superset db upgrade

(6）创建管理员用户

(7）Superset初始化

3. 启动Superset
superset 数据可视化
1.官网地址
superset.apache.org
安装supeset
- ①python
- ②supeset （不要和mysql 服务部署在一起）
  - 完全分布式
  - 单点分布式

1. 部署python环境

(1)安装Python3环境准备的包
- [root@hadoop15 ] yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel
  - 遇到yum出错问题(57条消息) yum无法使用_不想写bug第n天的博客-CSDN博客
- 安装EPEL源并安装superset必备的包：
  - [root@hadoop15 ~] yum install epel-release #安装epel源
  - [root@hadoop15 ~ ] yum install mysql-devel #安装MySQL开发包，属于pymysqlclient依赖
  - [root@hadoop15 ~]yum install gcc gcc-c++ libffi-devel python-devel python-pip python-wheel openssl-devel cyrus-sasl-devel openldap-devel
(2)上传python安装包Python-3.6.6.tgz 至linux上
- [root@bigdata15 ~]# cd /usr/local/src
- 上传Python-3.6.6.tgz
- [root@bigdata15 src] # tar -xf ./Python-3.6.6.tgz
(3)编译安装python3.x
- [root@bigdata15 src] # cd Python-3.6.6.tgz
- [root@bigdata15 Python-3.6.6.tgz]# ./configure
- [root@bigdata15 Python-3.6.6.tgz]# make && make install
(4)安装python3的virtualenv并建⽴superset的env
- [root@bigdata15 Python-3.6.6.tgz]#pip3 install --upgrade pip -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
- [root@bigdata15 Python-3.6.6.tgz]#pip3 install virtualenv -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
- [root@bigdata15 Python-3.6.6.tgz]#pip3 install --upgrade setuptools -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
- 建⽴superset的env&激活：
  - [root@bigdata15 Python-3.6.6.tgz]# cd ..
  - [root@bigdata15 src]# python3 -m venv superset-py3
  - [root@bigdata15 src]# source superset-py3/bin/activate #激活superset的venv

(5)安装superset需要的安装包

1. 创建requirement.txt：[root@bigdata15 src]# vim requirement.txt
2. requirement.txt文件添加

#requirement.txt内容
alembic==1.3.2            # via flask-migrate
amqp==2.5.2               # via kombu
apispec[yaml]==1.3.3      # via flask-appbuilder
attrs==19.3.0             # via jsonschema
babel==2.8.0              # via flask-babel
backoff==1.10.0           # via apache-superset (setup.py)
billiard==3.6.3.0         # via celery
bleach==3.1.0             # via apache-superset (setup.py)     ---
celery==4.4.1             # via apache-superset (setup.py)
cffi==1.13.2              # via cryptography
click==7.1.1              # via apache-superset (setup.py), flask, flask-appbuilder
colorama==0.4.3           # via apache-superset (setup.py), flask-appbuilder
contextlib2==0.6.0.post1  # via apache-superset (setup.py)
croniter==0.3.31          # via apache-superset (setup.py)
cryptography==2.8         # via apache-superset (setup.py)
decorator==4.4.1          # via retry
defusedxml==0.6.0         # via python3-openid
flask-appbuilder==2.2.4   # via apache-superset (setup.py)
flask-babel==1.0.0        # via flask-appbuilder
flask-caching==1.8.0      # via apache-superset (setup.py)
flask-compress==1.4.0     # via apache-superset (setup.py)
flask-jwt-extended==3.24.1  # via flask-appbuilder
flask-login==0.4.1        # via flask-appbuilder
flask-migrate==2.5.2      # via apache-superset (setup.py)
flask-openid==1.2.5       # via flask-appbuilder
flask-sqlalchemy==2.4.1   # via flask-appbuilder, flask-migrate
flask-talisman==0.7.0     # via apache-superset (setup.py)
flask-wtf==0.14.2         # via apache-superset (setup.py), flask-appbuilder
flask==1.1.1              # via apache-superset (setup.py), flask-appbuilder, flask-babel, flask-caching, flask-compress, flask-jwt-extended, flask-login, flask-migrate, flask-openid, flask-sqlalchemy, flask-wtf
geographiclib==1.50       # via geopy
geopy==1.20.0             # via apache-superset (setup.py)
gunicorn==20.0.4          # via apache-superset (setup.py)
humanize==0.5.1           # via apache-superset (setup.py)
importlib-metadata==1.4.0  # via jsonschema, kombu
isodate==0.6.0            # via apache-superset (setup.py)
itsdangerous==1.1.0       # via flask
jinja2==2.10.3            # via flask, flask-babel
jsonschema==3.2.0         # via flask-appbuilder
kombu==4.6.8              # via celery
mako==1.1.1               # via alembic
markdown==3.1.1           # via apache-superset (setup.py)
markupsafe==1.1.1         # via jinja2, mako
marshmallow-enum==1.5.1   # via flask-appbuilder
marshmallow-sqlalchemy==0.21.0  # via flask-appbuilder
marshmallow==2.19.5       # via flask-appbuilder, marshmallow-enum, marshmallow-sqlalchemy
more-itertools==8.1.0     # via zipp
msgpack==0.6.2            # via apache-superset (setup.py)
numpy==1.18.1             # via pandas, pyarrow
pandas==0.25.3            # via apache-superset (setup.py)
parsedatetime==2.5        # via apache-superset (setup.py)
pathlib2==2.3.5           # via apache-superset (setup.py)
polyline==1.4.0           # via apache-superset (setup.py)
prison==0.1.2             # via flask-appbuilder
py==1.8.1                 # via retry
pyarrow==0.16.0           # via apache-superset (setup.py)
pycparser==2.19           # via cffi
pyjwt==1.7.1              # via flask-appbuilder, flask-jwt-extended
python-dateutil==2.8.1    # via alembic, apache-superset (setup.py), croniter, flask-appbuilder, pandas
python-dotenv==0.10.5     # via apache-superset (setup.py)
python-editor==1.0.4      # via alembic
python-geohash==0.8.5     # via apache-superset (setup.py)
python3-openid==3.1.0     # via flask-openid
pytz==2019.3              # via babel, celery, flask-babel, pandas
pyyaml==5.3               # via apache-superset (setup.py), apispec
retry==0.9.2              # via apache-superset (setup.py)
selenium==3.141.0         # via apache-superset (setup.py)
simplejson==3.17.0        # via apache-superset (setup.py)
six==1.14.0               # via bleach, cryptography, flask-jwt-extended, flask-talisman, isodate, jsonschema, pathlib2, polyline, prison, pyarrow, pyrsistent, python-dateutil, sqlalchemy-utils, wtforms-json
sqlalchemy-utils==0.36.1  # via apache-superset (setup.py), flask-appbuilder
sqlalchemy==1.3.12        # via alembic, apache-superset (setup.py), flask-sqlalchemy, marshmallow-sqlalchemy, sqlalchemy-utils
sqlparse==0.3.0           # via apache-superset (setup.py)
urllib3==1.25.8           # via selenium
vine==1.3.0               # via amqp, celery
webencodings==0.5.1       # via bleach
werkzeug==0.16.0          # via flask, flask-jwt-extended
wtforms-json==0.3.3       # via apache-superset (setup.py)
wtforms==2.2.1            # via flask-wtf, wtforms-json
zipp==2.0.0               # via importlib-metadata

#激活superset的venv ：source superset-py3/bin/activate
3.执行
(superset-py3) [root@bigdata15 src]# pip3 install -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com -r requirement.txt

2 Superset部署
- (1）安装Superset
  - (superset-py3) [root@bigdata15 src]# pip3 install apache-superset==0.37.1 -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
- (2）安装Mysql数据包
  - (superset-py3) [root@bigdata15 src]# pip3 install sqlalchemy==1.3.24 -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
  - (superset-py3) [root@bigdata15 src]# pip3 install mysqlclient -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
  - (superset-py3) [root@bigdata15 src]# pip3 install "pymssql<3.0" -i http://pypi.douban.com/simple --trusted-host pypi.douban.com
- (3）创建数据库
  在数据库中建2表
  - CREATE DATABASE `superset` /*!40100 DEFAULT CHARACTER SET utf8 */;
- （4）修改superset元数据库
  - (superset-py3) [root@bigdata15 src]# vim superset-py3/lib/python3.6/site-packages/superset/config.py
    - 修改SQLALCHEMY_DATABASE_URI
      在config.py查找SQLALCHEMY_DATABASE_URI ：:/SQLALCHEMY_DATABASE_URI
      'mysql://root:123456@bigdata13/superset?charset=utf8'
      用bigdata13因为mysql部署在中
- (5）初始化Supetset数据库（Supetset是一个web应用，自带数据库，需要初始化）
  - (superset) [root@bigdata15 src]$ superset db upgrade
- (6）创建管理员用户
  - (superset) [root@bigdata15 src]$ export FLASK_APP=superset
  - (superset) [root@bigdata15 src]$ flask fab create-admin
- (7）Superset初始化
  - (superset) [root@bigdata15 src]$ superset init
3. 启动Superset
- 1.(superset) [root@bigdata15 src]$ superset run -h bigdata15 -p 8889
- 2）web登录
  - 访问http://bigdata15:8889/
  - 1.databases
  - 2. 添加 Add
  - 3.此操作可以在bigdata15机器连接到bigdata13机器
  - 4.保存后
  - 5.使用
(3)superset启停脚本

4. 重启后启动命令
- [root@bigdata15 hadoop]# cd /usr/local/src
- [root@bigdata15 src]# source superset-py3/bin/activate
- (superset-py3) [root@bigdata15 src]# superset run -h bigdata15 -p 8889