DataWorks 安装手册

最新推荐文章于 2024-08-26 14:52:05 发布

weixin_34161032

最新推荐文章于 2024-08-26 14:52:05 发布

阅读量1.8k

点赞数

文章标签： python java 数据库

原文链接：https://my.oschina.net/u/2002410/blog/780474

版权

2019独角兽企业重金招聘Python工程师标准>>>

DataWorks 安装手册

tags： gsac

[TOC]

1. 环境介绍

系统 : CentOS release 6.8 (Final) _x64 集成工具 : xampp 1.8.1 (包含 mysql 5.5.27， proFtp) 软件 : DataWorks-SW jdk : java version "1.7.0_111"

2. 安装软件

在 DataWorks-SW 压缩包中，存在安装说明，以下的安装步骤就是根据安装说明来的，如果需要了解更详细的安装说明，请阅读 README_Dataworks_Installation_Operation 文件。

2.1 创建数据库

按照文件 Dataworks-SW/database/README_create_MySQL_database 的说明来创建数据库。使用 /opt/lampp/bin/mysql -u root -p 命令登录数据库。

mysql> source /home/data/apps/Dataworks-SW/database/Dataworks_demo.sql; # 导入数据文件，会自动创建数据库
mysql> show tables;                 # 查看数据库的表情况
+-----------------------------------+
| Tables_in_Dataworks_GSAC_database |
+-----------------------------------+
| access                            |
| agency                            |
| antenna                           |
| country                           |
| datafile                          |
| datafile_type                     |
| ellipsoid                         |
| equip_config                      |
| locale                            |
| metpack                           |
| monument_style                    |
| network                           |
| radome                            |
| receiver_firmware                 |
| station                           |
| station_status                    |
| station_style                     |
+-----------------------------------+
17 rows in set (0.00 sec)

不能有任何错误，否则需要重新创建。

2.2 创建和安装 `GSAC`, 并且测试

GSAC 的安装分为两个部分， Part 1 的说明在 Dataworks-SW/dataworks-gsac/src/org/gsac/README 中，Part 2 的说明在 Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/README，按照两部分的说明来安装。

2.2.1 `Part 1`

安装 ant 构建工具来构建java项目，命令 yum install ant 执行安装。 注意： 因为我用的jdk 版本为 1.7，所以可以直接构建，如果使用的jdk版本为1.6，一定要参照说明。
进入 Dataworks-SW/dataworks-gsac/src/org/gsac 所在目录
执行 ant 命令.
编辑地图配置脚本repositorymap.js,在dataworks-gsac/src/org/gsac/gsl/htdocs/repositorymap.js 打开repositorymap.js 文件，按照提示设置

/*  set zoom level for map of GSAC sites; zoom level 3 is about 10,000 km wide; 4 ~ 4000 km;  5 ~ 2000 km;  6 ~ km.设置地图显示的距离大小是多少公里，分为 3， 4， 5， 6 四个等级 */
var defaultZoomLevel = 5;
/*  set center of GSAC site map, with (LONGITUDE, LATITUDE ) ; longitude east (west is negative), latitude north 这是中心坐标点，这里我用的房山的坐标点*/
var defaultLocation = new OpenLayers.LonLat(39.00, 116.00);

再在dataworks-gsac/src/org/gsac/gsl/目录下执行ant命令

2.2.2 `Part 2`

通过命令进入 cd dataworks-gsac/src/org/dataworks/gsac/目录，按照README的说明完成第二部分。

编辑resources/gsac.properties文件，参照说明，如果没有需要，可以不用修改
编辑dbresources/gsacdb_test.properties文件，设置数据库相关信息

## This is the database name and account information for GSAC
gsac.db.username=root
gsac.db.password=chgsac
gsac.db.jdbcurl=jdbc:mysql://127.0.0.1:3306/Dataworks_GSAC_database?useUnicode=yes&characterEncoding=UTF-8

检查org/dataworks/gsac目录下的 build.xml 文件

<target name="localinit">
    <!-- base name for build products， 此处的 `dataworksgsac` 要保证相同 -->
    <property name="basename" value="dataworksgsac"/>

在 org/dataworks/gsac 目录下执行 ant 命令

[root@localhost gsac]# ant
Buildfile: build.xml
test_build:
localinit:
init:
clean:
build:
     [echo] Creating test build
     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/resources
     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/resources
localinit:
init:
clean:
compile:
    [javac] Compiling 7 source files
    [javac] \u6ce8: /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/DataworksSiteManager.java\u4f7f\u7528\u4e86\u672a\u7ecf\u68c0\u67e5\u6216\u4e0d\u5b89\u5168\u7684\u64cd\u4f5c\u3002
    [javac] \u6ce8: \u6709\u5173\u8be6\u7ec6\u4fe1\u606f, \u8bf7\u4f7f\u7528 -Xlint:unchecked \u91cd\u65b0\u7f16\u8bd1\u3002
gsacjar:
    [echo] Making jar /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.jar
    [jar] Building jar: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.jar
release:
    [echo] Making /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.zip
   [delete] Deleting directory /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [mkdir] Created dir: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
    [zip] Building zip: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.zip
localinit:
init:
war:
     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist
   [delete] Deleting: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0/javax.servlet-api-3.1.0.jar
      [war] Building war: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsac.war
     [echo] ********************************
     [echo] To run the server run:
     [echo] ant runserver
     [echo] ********************************
BUILD SUCCESSFUL
Total time: 4 seconds

测试 GSAC 执行命令 ant runserver ，结果报错

     [java] Error:java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.security.AccessControlException: access denied ("javax.management.MBeanTrustPermission" "register")
     [java] java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.security.AccessControlException: access denied ("javax.management.MBeanTrustPermission" "register")

解决错误：设置Javax Security java.policy file 编辑/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre/lib/security/java.policy 文件

grant {
    //   many other lines

    // JMX Java Management eXtensions                               # 添加的注释
    permission javax.management.MBeanTrustPermission "register";    # 添加的内容
};

再来执行 ant runserver，启动成功

[root@localhost gsac]# ant runserver
Buildfile: build.xml

localinit:

init:

runserver:
     [java] JVM args ignored when same JVM is used.
     [java] 2016-09-07 10:55:18.814:INFO::main: Logging initialized @467ms
     [java] GSAC: GsacServlet:initServlet: making repository:org.dataworks.gsac.DataworksRepository
     [java] GSAC: Starting this GSAC server, at 2016-09-07T02:55:19 +0000
     [java] Running stand-alone GSAC server at: http://localhost:8080/dataworksgsac
     [java] 2016-09-07 10:55:19.758:INFO:oejs.Server:main: jetty-9.2.6.v20141205
     [java] 2016-09-07 10:55:19.831:INFO:oejsh.ContextHandler:main: Started o.e.j.s.ServletContextHandler@29ab993{/,null,AVAILABLE}
     [java] 2016-09-07 10:55:19.904:INFO:oejs.ServerConnector:main: Started ServerConnector@4a6e1c9a{HTTP/1.1}{0.0.0.0:8080}
     [java] 2016-09-07 10:55:19.905:INFO:oejs.Server:main: Started @1562ms

登录网站 http://localhost:8080/dataworksgsac 访问，能够打开网页看到 GSAC 内容。至此 GSAC 安装完成。

3. 导入数据

导入数据使用的是Dataworks-SW/mirror目录下的 mirrorStations.py 和 mirrorData.py 这两个 python 脚本， mirrorStations.py 的作用是导入站点数据，mirrorData.py 的作用是根据导入的站点来导入真实的数据信息到数据库。 注意： 两个脚本在执行的时候必须先导入站点数据，才能再执行导入数据的脚本。不能颠倒！！！

3.1 导入站点数据

在执行脚本之前需要安装 python-mysqldb ，在 CentOS 系统中使用命令 yum install MySQL-python.x86_64来安装命令解析： ./mirrorStations.py "STK2;MIZU;KSMV;TSK2" dbHostname dbAccount dbPasswd dbName ` 执行脚本命令要导入的站点 ; 隔开数据库ip地址用户名密码数据库名

# 导入国外站点
[root@localhost mirror]# ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" localhost root root dataworks_gsac_database 
Traceback (most recent call last):
  File "./mirrorStations.py", line 996, in <module>
    gsacdb = MySQLdb.connect(dbhost, dbacct, dbacctpw, dbname)
  File "/usr/lib64/python2.6/site-packages/MySQLdb/__init__.py", line 81, in Connect
    return Connection(*args, **kwargs)
  File "/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 187, in __init__
    super(Connection, self).__init__(*args, **kwargs2)
_mysql_exceptions.OperationalError: (2002, "Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)")

报错：Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock 解决办法如下：

# 导入国外站点
[root@localhost mirror]# mkdir -p /var/lib/mysql
[root@localhost mirror]# ln -s /opt/lampp/var/mysql/mysql.sock /var/lib/mysql/mysql.sock # 创建软连接
[root@localhost mirror]# ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" 127.0.0.1 root root dataworks_gsac_database

    Connected to the database dataworks_gsac_database with account root, on 127.0.0.1
    
    First, get site and equipment metadata at those sites from the UNAVCO GSAC. The GSAC API Linux command is 
    /usr/bin/curl -L  "http://www.unavco.org/data/web-services/gsacws/gsacapi/site/search?output=sitefull.csv&site.interval=interval.normal&site.code=DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" > dataworks_stations.csv
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 65180    0 65180    0     0   1432      0 --:--:--  0:00:45 --:--:--  7129

# 导入国内站点,导入成功样例，可能耗时会有点久，需要等待
[root@localhost mirror]# ./mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database

    Connected to the database Dataworks_GSAC_database with account root, on localhost

    First, get site and equipment metadata at those sites from the UNAVCO GSAC. The GSAC API Linux command is 
    /usr/bin/curl -L  "http://www.unavco.org/data/web-services/gsacws/gsacapi/site/search?output=sitefull.csv&site.interval=interval.normal&site.code=kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" > dataworks_stations.csv
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  9806    0  9806    0     0     55      0 --:--:--  0:02:56 --:--:--   897

  Metadata for station ID BJFS                  named Beijing Fangshan / China

  Metadata for station ID BJNM                  named BJNM antenna at NIM

  Metadata for station ID CHAN                  named CHANGCHUN

  Metadata for station ID GUAO                  named GUAO

  Metadata for station ID JFNG                  named JIUFENG

  Metadata for station ID KUNM                  named Kunming

  Metadata for station ID LHAZ                  named Lhasa / Tibet / China

  Metadata for station ID SHAO                  named Shanghai Obs/Sheshan Station

  Metadata for station ID TCMS                  named Hsinchu

  Metadata for station ID TWTF                  named Taoyuan

  Metadata for station ID URUM                  named Urumqi - People Republic of China

  Metadata for station ID WUHN                  named WUHAN

添加定时任务：使用crontab -e命令添加定时任务，注意服务器重启以后会失效，需要重新添加。

# 每天晚上 0 点 1 分，开始更新站点数据，并且不保存日志
1 0 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database > /dev/null 2>&1

3.2 导入数据信息

命令解析： ./mirrorData.py dbhost dbacct dbpw dbname 4daysback today "kunm;lhaz" 脚本数据库ip 账号密码数据库名 4天前今天站点代号

# 导入国内数据文件信息到数据库
./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms"

# 导入国外数据文件信息
./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG"

为数据导入添加定时任务：

[root@localhost apps]# crontab -l
# mei tian 24 dian kaishi genxin zhandian 
1 0 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database > /dev/null 2>&1  

# mei tian 3 dian kaishi dao ru shuju wenjian
1 3 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" > /dev/null 2>&1

至此：站点导入和数据信息的导入完成，以后会每天定时执行导入工作。

4. 数据的下载和ftp的至此

在 linux 系统下，会使用 wget 命令来充 GNSS 获取数据，如： wget -c -x -P ~/data/file ftp://data-out.unavco.org/pub/rinex/obs/2000/061/ugeo0610.00d.Z 通过前面的操作后数据都写入进数据库了，如下所示，replace.this.org 让我们替换成自己本地的ftp ip

mysql> select datafile_id ,url_path from datafile;
+-------------+----------------------------------------------------------+
| datafile_id | url_path                                                 |
+-------------+----------------------------------------------------------+
|        2049 | ftp://replace.this.org/rinex/nav/2016/249/bjnm2490.16g.Z |
|        2050 | ftp://replace.this.org/rinex/nav/2016/249/bjnm2490.16n.Z |
|        2051 | ftp://replace.this.org/rinex/obs/2016/249/bjnm2490.16d.Z |
|        2052 | ftp://replace.this.org/rinex/nav/2016/249/chan2490.16n.Z |
|        2053 | ftp://replace.this.org/rinex/obs/2016/249/chan2490.16d.Z |
+-------------+----------------------------------------------------------+
29 rows in set (0.00 sec)

以 shell 脚本来完成上述操作

#!/bin/bash
##############################
# @file DataDownload.sh
# @brief 用来下载 GNSS 数据的 shell 脚本
# @author liukai
# @version 1.0
# @date 2016-09-08
##############################

ip="168.168.169.199"                            # 主机ip地址
dbUser="root"                                   # 数据库用户名
dbPasswd="root"                                 # 数据库密码
dbName="Dataworks_GSAC_database"                # 数据库实例名
dbUrlPath="replace.this.org"                    # datafile 表中 url_path 字段中要替换的连接名
replaceUrlPath="data-out.unavco.org/pub"        # 被替换的连接名
ftpUrlPath="${ip}/${replaceUrlPath}"            # 最后替换的本地ftp路径


# 获取要下载数据的 ftp path
getUrlPaths() {
        # 查询数据库，将 url_path 放到变量 paths 中
        command="select url_path from datafile;"
        declare paths=`/opt/lampp/bin/mysql -u${dbUser} -p${dbPasswd} -D${dbName} -e "${command}" --skip-column-name`

        # 循环数组，拼接成 GNSS 的 ftp 下载地址，然后使用 wget 命令将文件下载到ftp目录
        for url in $paths
        do
                copyUrl="${url}"
                if [ ${url:6:16}  = ${dbUrlPath} ] ; then
                        `wget -c -x -P /opt/lampp/htdocs/ ${copyUrl/${dbUrlPath}/${replaceUrlPath}}`
                fi
        done

        # 最后，更新 url_path 为本地 ftp 路径
        command2="update datafile set url_path=replace(url_path,\"${dbUrlPath}\",\"${ftpUrlPath}\");"
        `/opt/lampp/bin/mysql -u${dbUser} -p${dbPasswd} -D${dbName} -e "${command2}"`

}

echo "--------------------开始下载文件------------------------------"
getUrlPaths
echo "--------------------文件下载完成------------------------------"

5. 脚本整合，添加任务调度

# 这是国内站点的任务调度内容
# mei tian 24 dian kaishi genxin zhandian 
1 22 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" 127.0.0.1 root root Dataworks_GSAC_database  >> /home/gsac/logs/station`date +\%Y\%m\%d`.log 2>&1

# mei tian 3 dian kaishi dao ru shuju wenjian
1 0 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms"  >> /home/gsac/logs/data`date +\%Y\%m\%d`.log 2>&1

1 3 * * * /home/gsac/apps/Dataworks-SW/mirror/DataDownload.sh  >> /home/gsac/logs/download`date +\%Y\%m\%d`.log 2>&1

# 这个国外站点的调度任务
1 21 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" 127.0.0.1 root root Dataworks_GSAC_database >> /home/gsac/logs/station`date +\%Y\%m\%d`.log 2>&1

1 1 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" >> /home/gsac/logs/data`date +\%Y\%m\%d`.log 2>&1

1 4 * * * /home/gsac/apps/Dataworks-SW/mirror/DataDownload.sh  >> /home/gsac/logs/download`date +\%Y\%m\%d`.log 2>&1

6. `GSAC` 镜像映射方案

采用 python 脚本来完成镜像的映射。 ./mirrorStations_199.py "bjnm;wuhn" 127.0.0.1 root root Dataworks_GSAC_database 命令将从199机器获取站点编号为kunm;lhaz 的两个站点的station信息。 ./mirrorData_199.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "bjnm;wuhn"命令会将上面更新站点信息的两个站点数据下载到本地。

./mirrorStations_200.py "DAEJ,NOVM" 127.0.0.1 root root Dataworks_GSAC_database ./mirrorData_200.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ,NOVM"

转载于:https://my.oschina.net/u/2002410/blog/780474