一、Linux操作系统操作springboot购物项目:
xftp查找jar并传输Linux、opt文件夹
1>java -jar shoop-0.0.1-SNAPSHOT.jar(运行Jar包)
2>网页请求服务器
3>ps -ef|grep java(查询java进程)
二、步骤:
1.vim start.bash
添加权限:chmod +x 文件名,chmod -R 777/775 文件名
Shell脚本:
#!/bin/sh
java -jar /opt/shoop-0.0.1-SNAPSHOT.jar > /opt/temp.txt &
echo $! > /var/run/Test.pid
2.vim stop.bash
添加权限:chmod +x 文件名,chmod -R 777/775 文件名
Shell脚本:
#! /bin/bash
PID=$(cat /var/run/Test.pid)
kill -9 $PID
三、运行sparkSQL的Jar
编辑:spark_sql.sh的脚本,给予权限:chmod +x spark_sql.sh
#! /bin/bash
/usr/local/spark/spark-1.5.1-bin-hadoop2.4/bin/spark-submit \
--class com.etc.JDBCDataSource \
--num-executors 3 \
--driver-memory 100m \
--executor-memory 100m \
--executor-cores 3 \
--files /usr/local/hive/hive-0.13.1-bin/conf/hive-site.xml \
--driver-class-path /usr/local/hive/hive-0.13.1-bin/lib/mysql-connector-java-5.1.46.jar \
/opt/spark-sql-1.0-SNAPSHOT-jar-with-dependencies.jar \
hive-site.xml配置:
<configuration>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://198.168.88.3/hive?createDatabaseIfNotExist=true</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
<description>username to use against metastore database</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>111111</value>
<description>password to use against metastore database</description>
</property>
</configuration>
问题:
1. 异常:Unknown system variable 'query_cache_size’
mysql-connector-java版本低的问题
2.解决Exception in thread “main” java.lang.ClassNotFoundException: Main 报错