【GNSS】GNSS数据下载工具

最新推荐文章于 2024-03-26 21:56:41 发布
置顶 最新推荐文章于 2024-03-26 21:56:41 发布
阅读量1.6k 收藏 15
点赞数
分类专栏： GNSS 文章标签： gnss perl
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_32109917/article/details/113482618
版权

GNSS数据下载工具

​ 该脚本为武汉大学测绘学院李星星教授开源的linux端GNSS数据下载脚本，脚本为perl语言编写，可支持下载rinexo，rinexn，rinexc，snx等常用格式的GNSS数据，支持常用mgex机构切换。

原地址为 http://igmas.users.sgg.whu.edu.cn/group/tool/4

网站还有其他有用的小工具，感兴趣的可以去看一下。

【所属分类】：perl脚本
【开发工具】：perl
【文件大小】：13KB
【使用说明】：使用前需要注册cddis账号，并将账号密码写.netrc文件放在用户根目录下
文件格式如下：machine urs.earthdata.nasa.gov login username password password
【使用示例】：

 # 可下载的文件种类如下： 
 -obs daily daily_v2 daily_v3 hourly hourly_v2 hourly_v3  
 -nav brdc hourly daily 
 -dcb cas code (dlr not supported now) 
 -snx igs 
 -orb gfz wum grg cod igs 
 -clk gfz wum grg cod igs 
 -eop all daily gpsrapid 
 -slr all

代码

#!/usr/bin/perl
## 
#  Usage   : IGS/MGEX data/products downloading
#  Created : Yuan Yongqiang, 2020/10/24
#  Updated : Yuan Yongqiang, 2020/10/25, adding EOP and PRODUCTS downloading
#
# -obs daily daily_v2 daily_v3 hourly hourly_v2 hourly_v3 
# -nav brdc hourly daily
# -dcb cas code (dlr not supported now)
# -snx igs
# -orb gfz wum grg cod igs
# -clk gfz wum grg cod igs
# -eop all daily gpsrapid
# -slr all
# 
## 1. Get a list of all files in a directory:
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/*?list"
#
## 2. Get a list of files in a directory matching a pattern (cs2rx1700*.001.Z)
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/cs2rx1700*.001.Z?list"
#
## 3. Download a group of files within a range
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/cs2rx1700[1-9].001.Z" -O
#
## 4. Download a group of files from a list of specific files
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/cs2rx1700{1,3,7}.001.Z" -O
#
## 5. Download a set of files matching a pattern and output those to a single .tar file
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/cs2rx1700*.001.Z" -o files.tar
#
## 6. Download a single file
#  curl -c .urs_cookies -b .urs_cookies -n -L "https://cddis.nasa.gov/archive/doris/data/cs2/2017/cs2rx17001.001.Z" -O
#
 use strict;
 use warnings;
 use Net::FTP;
 use Getopt::Long;
 use File::Copy;
 use File::Path qw( make_path );
 use Data::Dumper;
 use File::Basename;
 use Class::Struct;
 use Cwd;
 use threads;
 use threads::shared;
 use Time::Local;
 
 struct DataType => { 
	 type => '$', ntype  => '$', 
	 time => '$', ctypes => '@',
 };
 struct IpMode => { 
	 ip   => '$', dir => '$',
	 mode => '$', type => '$',
	 subtype => '$',
 };
 struct CurlNode => { 
	 ip   => '$', user => '$', 
	 pwd  => '$', dir  => '$', 
	 file => '$', save => '$', 
 };
 
 my $year=0; 
 my $doy = 0;
 my $hour = 0;
 my $nthreads = 3;
 my $save = "";
 my @obs = ();
 my @nav = ();
 my @dcb = ();
 my @snx = ();
 my @orb = ();
 my @clk = ();
 my @eop = ();
 my @slr = ();
 GetOptions (
		"year=i" => \$year,
		"doy=i" => \$doy,
		"hour=i" => \$hour,
		"nth=i" => \$nthreads,
		"save=s" => \$save,
		"obs=s{,}" => \@obs,
		"nav=s{,}" => \@nav,
		"dcb=s{,}" => \@dcb,
		"snx=s{,}" => \@snx,
		"orb=s{,}" => \@orb,
		"clk=s{,}" => \@clk,
		"eop=s{,}" => \@eop,
		"slr=s{,}" => \@slr,
 );
 if($nthreads > 10) {
 	 print "Max threads 10\n";
 	 exit;
 }
 my @DataTypes = ();
 my $ctime = sprintf("%04d%03d%02d",$year,$doy,$hour);
 push @DataTypes,DataType->new(time=>$ctime, type=>"obs", ntype=>$#obs+1, ctypes=>\@obs) if(@obs);
 push @DataTypes,DataType->new(time=>$ctime, type=>"nav", ntype=>$#nav+1, ctypes=>\@nav) if(@nav);
 push @DataTypes,DataType->new(time=>$ctime, type=>"dcb", ntype=>$#dcb+1, ctypes=>\@dcb) if(@dcb);
 push @DataTypes,DataType->new(time=>$ctime, type=>"snx", ntype=>$#snx+1, ctypes=>\@snx) if(@snx);
 push @DataTypes,DataType->new(time=>$ctime, type=>"orb", ntype=>$#orb+1, ctypes=>\@orb) if(@orb);
 push @DataTypes,DataType->new(time=>$ctime, type=>"clk", ntype=>$#clk+1, ctypes=>\@clk) if(@clk);
 push @DataTypes,DataType->new(time=>$ctime, type=>"eop", ntype=>$#eop+1, ctypes=>\@eop) if(@eop);
 push @DataTypes,DataType->new(time=>$ctime, type=>"slr", ntype=>$#slr+1, ctypes=>\@slr) if(@slr);
 my @requested_CurlNodes = make_download_list(@DataTypes,$save);
 if(@requested_CurlNodes and ($#requested_CurlNodes+1) >= 1) {
 	 curl_download_files(@requested_CurlNodes,$nthreads);
 }
 exit;
 
 sub curl_download_files {
 	 my (@requested_CurlNodes) = @_;
 	 my $nthreads = pop(@requested_CurlNodes);
 	 
 	 my @cur_download_cmds = ();
 	 foreach my $requested_CurlNode (@requested_CurlNodes) {
 	 	 my $ip      = $requested_CurlNode->ip;
 	 	 my $user    = $requested_CurlNode->user;
 	 	 my $pwd     = $requested_CurlNode->pwd;
 	 	 my $rmtdir  = $requested_CurlNode->dir;
 	 	 my $file    = $requested_CurlNode->file;
 	 	 my $savedir = $requested_CurlNode->save;
 	 	 system("mkdir -p $savedir") if(! -d $savedir);
 	 	 my $cmd_curl = "";
 	 	 if($ip =~ /cddis/ or $ip =~ /http/) {
	 	   $cmd_curl = "curl -c .urs_cookies -b .urs_cookies -n --silent -L \"$ip$rmtdir/$file\" -o $savedir/$file";
	   }
	   else {
	   	 $cmd_curl = "curl $ip$rmtdir/$file -u anonymous:yqyuanwhu --silent -o $savedir/$file";
	   }
	   if(! -e "$savedir/$file") {
	   	 push @cur_download_cmds,$cmd_curl;
	   }
	   else {
	   	 print "Omitting already existed file: $savedir/$file\n";
	   }
	 }
	 
	 my @threads = ();
	 my $nfiles_per_thread = int(($#cur_download_cmds+1)/$nthreads);
	 $nthreads = 1 if($nfiles_per_thread<2);
	 #print "$nthreads\n";
	 #print "$nfiles_per_thread\n";
	 #exit;
	 for(my $ith = 0; $ith < $nthreads; $ith ++) {
     my $istart = $ith*$nfiles_per_thread;
     my $iend   = ($ith+1)*($nfiles_per_thread)-1;
     if($ith == $nthreads - 1) {
     	 $iend = $#cur_download_cmds;
     }
     #print "$istart  $iend\n";
	 	 my @th_cur_download_cmds = ();
	 	 for(my $icmd = $istart; $icmd <= $iend; $icmd ++) {
	 	 	 push @th_cur_download_cmds, $cur_download_cmds[$icmd];
	 	 }
	 	 if(@th_cur_download_cmds) {
	 	 	 my $th_cur = threads->create(\&run_download_files, @th_cur_download_cmds);
	 	 	 push @threads,$th_cur;
	 	 }
	 }
	 foreach my $curl_download_thread (@threads) {
	 	 $curl_download_thread->join();
	 }
 }
 
 sub run_download_files {
 	 my (@cur_download_cmds) = @_;
 	 foreach my $cur_download_cmd (@cur_download_cmds) {
 	 	 #print "$cur_download_cmd\n";
 	 	 my $time1=timelocal(localtime());
 	 	 system($cur_download_cmd);
 	 	 my $time2=timelocal(localtime());
 	 	 my $diff=$time2-$time1;
 	 	 print "Time consuming: $diff seconds; Finished: $cur_download_cmd\n";
 	 }
 }

 sub make_download_list {
 	 my (@DataTypes) = @_;
 	 my $save = pop(@DataTypes);
 	 my @IpModes = ();
 	 
 	 foreach my $DT (@DataTypes) {
	 	 my $year = substr($DT->time,0,4);
	 	 my $doy  = substr($DT->time,4,3);
	 	 my $hour = substr($DT->time,7,2);
	 	 my $type = $DT->type;
	 	 if($DT->ntype > 0) {
	 	 	 foreach my $subtype (@{$DT->ctypes}) {
	 	 	 	 push @IpModes,resolve_ip($year,$doy,$hour,$type,$subtype);
	 	 	 }
	 	 }
   }
   
   my @requested_CurlNodes = ();
   foreach my $ipnode (@IpModes) {
   	 my $ip = $ipnode->ip;
   	 my $dir = $ipnode->dir;
   	 my $mode = $ipnode->mode;
   	 my $type = $ipnode->type;
   	 my $subtype = $ipnode->subtype;
   	 print "Requesting files on remote server: ip = $ip, dir = $dir, mode = $mode, type = $type, subtype = $subtype\n";
   	 push @requested_CurlNodes, get_http_remote_list($year,$doy,$hour,$type,$subtype,$ip,$dir,$mode,$save);
   }
   return @requested_CurlNodes;
 }
 
 sub resolve_ip {
 	 my ($year,$doy,$hour,$type,$subtype) = @_;
 	 
 	 my $ip_cddis = "https://cddis.nasa.gov";
 	 my $ip_ign   = "ftp://igs.ign.fr";
 	 my $ip_whu   = "ftp://igs.gnsswhu.cn";
 	 my $ip_aiub  = "ftp://ftp.aiub.unibe.ch";
 	 my $ip_tum   = "ftp://edc.dgfi.tum.de";
 	 my $ip_iers  = "ftp://ftp.iers.org";
 	 
 	 my $mjd = yeardoy2mjd($year,$doy);
 	 my ($gwk,$gwkd) = mjd2gwkd($mjd);
 	 my ($year_not_used, $month, $monthday) = doy2monthday($year, $doy);
 	 
 	 my @IpModes = ();
# -obs cddis/ign/whu houly houly_v2 houly_v3 daily daily_v2 daily_v3
# -nav cddis/ign/whu brdc hourly daily
# -dcb cddis/aiub    cas dlr code
# -snx cddis/ign/whu igs
# -orb cddis/ign/whu gfz/gbm whu/wum grg cod igs
# -clk cddis/ign/whu gfz/gbm whu/wum grg cod igs
# -eop cddis/iers    all daily gpsrapid
# -slr cddis/tum     all prn
#### OBSERVATIONS
 	 if($type eq "obs") {
 	 	 my $mode_v2 = "*d.gz";
 	 	 my $mode_v3 = "*MO.crx.gz";
 	 	 my $dir_cddis = "";
 	 	 my $dir_ign   = "";
 	 	 my $dir_whu   = "";
 	 	 if($subtype =~ /hourly/) {
 	 	 	 $dir_cddis = sprintf("/archive/gnss/data/hourly/%04d/%03d/%02d",$year,$doy,$hour);
 	 	 	 $dir_ign   = sprintf("/pub/igs/data/hourly/%04d/%03d",$year,$doy);
 	 	 	 $dir_whu   = sprintf("/pub/gps/data/hourly/%04d/%03d/%02d",$year,$doy,$hour);
 	 	 }
 	 	 if($subtype =~ /daily/) {
 	 	 	 $dir_cddis = sprintf("/archive/gnss/data/daily/%04d/%03d/%02dd",$year,$doy,substr($year,2,2));
 	 	 	 $dir_ign   = sprintf("/pub/igs/data/%04d/%03d",$year,$doy);
 	 	 	 $dir_whu   = sprintf("/pub/gps/data/daily/%04d/%03d/%02dd",$year,$doy,substr($year,2,2));
 	 	 }
 	 	 if($subtype =~ /_v2/ or $subtype =~ /_v3/) {
 	 	 	 	 if($subtype =~ /_v2/) {
 	 	 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis, dir=>$dir_cddis, mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_ign,   dir=>$dir_ign,   mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_whu,   dir=>$dir_whu,   mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 	 }
 	 	 	 	 if($subtype =~ /_v3/) {
 	 	 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis, dir=>$dir_cddis, mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_ign,   dir=>$dir_ign,   mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_whu,   dir=>$dir_whu,   mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 	 	 }
 	 	 }
 	 	 else {
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis, dir=>$dir_cddis, mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_ign,   dir=>$dir_ign,   mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_whu,   dir=>$dir_whu,   mode=>$mode_v2, type=>$type, subtype=>$subtype);
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis, dir=>$dir_cddis, mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_ign,   dir=>$dir_ign,   mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 	 #push @IpModes,IpMode->new(ip=>$ip_whu,   dir=>$dir_whu,   mode=>$mode_v3, type=>$type, subtype=>$subtype);
 	 	 }
 	 }
#### NAVIGATION
 	 if($type eq "nav") {
 	 	 if($subtype =~ /brdc/) {
 	 	   my $dir = sprintf("/archive/gnss/data/daily/%04d/brdc",$year);
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>sprintf("*%02dn.gz",substr($year,2,2)), type=>$type, subtype=>$subtype); # GPS
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>sprintf("*%02dg.gz",substr($year,2,2)), type=>$type, subtype=>$subtype); # GLO
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>"BRD*MN.rnx.gz", type=>$type, subtype=>$subtype); # Multi-GNSS
 	 	 	 $dir = sprintf("/archive/gnss/data/daily/%04d/%03d/%02dp/",$year,$doy,substr($year,2,2));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>"BRD*MN.rnx.gz", type=>$type, subtype=>$subtype); # Multi-GNSS
 	 	 }
 	 	 if($subtype =~ /hourly/) {
 	 	 	 my $dir = sprintf("/archive/gnss/data/hourly/%04d/%03d/%02d",$year,$doy,$hour);
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>"*N.rnx.gz", type=>$type, subtype=>$subtype); # Longname-only
 	 	 }
 	 	 if($subtype =~ /daily/) {
 	 	 	 my $dir = sprintf("/archive/gnss/data/daily/%04d/%03d/%02dp",$year,$doy,substr($year,2,2));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>"*N.rnx.gz", type=>$type, subtype=>$subtype); # Longname-only
 	 	 }
 	 }
#### DCB
 	 if($type eq "dcb") {
 	 	 if($subtype =~ /cod/) {
 	 	 	 my $dir = sprintf("/CODE/%04d",$year);
 	 	 	 my $mode = "*.DCB.Z";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_aiub,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 	 if($subtype =~ /cas/) {
 	 	 	 my $dir = sprintf("/archive/gnss/products/bias/%04d",$year);
 	 	 	 my $mode = "*.BSX.gz";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 	 if($subtype =~ /dlr/) {
 	 	 	 # to be added
 	 	 }
 	 }
#### SINEX
 	 if($type eq "snx") {
 	 	 my $dir = sprintf("/archive/gnss/products/%04d",$gwk);
 	 	 my $mode = sprintf("igs*%04d.snx.Z",$gwk);
 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 $mode = sprintf("igs*%04d.snx.gz",$gwk);
 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 }
#### ORBIT/SP3
 	 if($type eq "orb") {
 	 	 if($subtype =~ /igs/) {
 	 	 	 my $dir = sprintf("/archive/gnss/products/%04d",$gwk);
 	 	 	 my $mode = "igs*.sp3.Z";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 	 $mode = "igs*.sp3.gz";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 	 else {
 	 	 	 my $dir = sprintf("/archive/gnss/products/mgex/%04d",$gwk);
 	 	 	 my $mode = sprintf("%3s0MGXFIN*ORB.SP3.gz",uc($subtype));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 	 $mode = sprintf("%3s0MGXRAP*ORB.SP3.gz",uc($subtype));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 }
#### CLOCK
 	 if($type eq "clk") {
 	 	 if($subtype =~ /igs/) {
 	 	 	 my $dir = sprintf("/archive/gnss/products/%04d",$gwk);
 	 	 	 my $mode = "igs*.clk_30s.Z";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 	 $mode = "igs*.clk_30s.gz";
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 	 else {
 	 	 	 my $dir = sprintf("/archive/gnss/products/mgex/%04d",$gwk);
 	 	 	 my $mode = sprintf("%3s0MGXFIN*CLK.CLK.gz",uc($subtype));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 	 $mode = sprintf("%3s0MGXRAP*CLK.CLK.gz",uc($subtype));
 	 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 }
 	 }
#### EOP
 	 if($type eq "eop") {
 	 	 my $dir = "/archive/products/iers";
 	 	 my $mode = "";
 	 	 if($subtype =~ /daily/) {
 	 	 	 $mode = "*2000A.daily";
 	 	 	 #$dir = "/products/eop/rapid/daily";
 	 	 }
 	 	 if($subtype =~ /all/) {
 	 	 	 $mode = "*2000A.data";
 	 	 	 #$dir = "/products/eop/rapid/standard";
 	 	 }
 	 	 if($subtype =~ /gpsrapid/) {
 	 	 	 $mode = "gpsrapid*";
 	 	 	 #$dir = "/products/eop/rapid/standard";
 	 	 }
 	 	 push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	 #push @IpModes,IpMode->new(ip=>$ip_iers,    dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 }
#### SLR
 	 if($type eq "slr") {
 	 	 my @slr_sats = ("galileo101","galileo102","galileo103","galileo104","galileo201","galileo202","galileo203","galileo204",
                     "galileo205","galileo206","galileo207","galileo208","galileo209","galileo210","galileo211","galileo212",
                     "galileo213","galileo214","galileo215","galileo216","galileo217","galileo218","galileo219","galileo220",
                     "galileo221","galileo222","qzs1","qzs2","qzs3","qzs4","beidou3m2","beidou3m3","beidou3m9","beidou3m10",
                     "compassg1","compassi3","compassi5","compassi6b","compassm3");
     my $mode = sprintf("%04d%02d.npt",$year,$month);
 	 	 foreach my $slr_sat (@slr_sats) {
 	 	   my $dir = sprintf("/archive/slr/data/npt_crd/%s/%04d",$slr_sat,$year);
 	 	   push @IpModes,IpMode->new(ip=>$ip_cddis,   dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	 	   ## for TUM ftp
 	 	   #my $dir = sprintf("/pub/slr/data/npt_crd/%s/%04d",$slr_sat,$year);
 	 	   #push @IpModes,IpMode->new(ip=>$ip_tum,     dir=>$dir,   mode=>$mode, type=>$type, subtype=>$subtype);
 	   }
 	 }
 	 return @IpModes;
 }
 
 sub get_http_remote_list {
 	 my ($year,$doy,$hour,$type,$subtype,$ip,$dir,$mode,$save) = @_;
 	 my @requested_CurlNode = ();
 	 ## use http for cddis
 	 if($ip =~ /cddis/) {
 	 	 my @remote_lists = `curl -c .urs_cookies -b .urs_cookies -n -L --silent "$ip$dir/$mode?list"`;
 	 	 my $total        = `curl -c .urs_cookies -b .urs_cookies -n -L --silent "$ip$dir/$mode?list" | grep 'Total number of files'`;
 	 	 if(! $total) {
 	 	 	 print "No files!\n";
 	 	 	 return @requested_CurlNode;
 	 	 	 #exit;
 	 	 }
 	 	 else {
 	 	 	 foreach my $remote_list (@remote_lists) {
 	 	 	 	 my @token=split(/ /,$remote_list);
 	 	 	 	 my $filename = $token[0];
 	 	 	 	 if(looks_like_gnss($year,$doy,$hour,$type,$subtype,$filename)) {
 	 	 	 	 	 my $node = CurlNode->new(ip=>$ip,user=>"yqyuan",pwd=>"yqyuanwhu",dir=>$dir,file=>$filename,save=>$save);
 	 	 	 	 	 push @requested_CurlNode, $node; 
 	 	 	 	 }
 	 	 	 }
 	 	 }
 	 }
 	 ## use ftp for others
 	 else {
 	 	 my @remote_lists = `curl -u anonymous:yqyuanwhu --silent -l "$ip$dir/$mode"`;
 	 	 if(! @remote_lists) {
 	 	 	 print "No files!\n";
 	 	 	 return @requested_CurlNode;
 	 	 	 #exit;
 	 	 }
 	 	 else {
 	 	 	 foreach my $remote_list (@remote_lists) {
 	 	 	 	 my $filename = $remote_list;
 	 	 	 	 chomp($filename);
 	 	 	 	 if(looks_like_gnss($year,$doy,$hour,$type,$subtype,$filename)) {
 	 	 	 	 	 #print "$filename";
 	 	 	 	 	 my $node = CurlNode->new(ip=>$ip,user=>"yqyuan",pwd=>"yqyuanwhu",dir=>$dir,file=>$filename,save=>$save);
 	 	 	 	 	 push @requested_CurlNode, $node; 
 	 	 	 	 }
 	 	 	 }
 	 	 }
 	 }
 	 return @requested_CurlNode;
 }
 
 sub looks_like_gnss {
 	 my ($year,$doy,$hour,$type,$subtype,$remote_name) = @_;
 	 
 	 my $mjd = yeardoy2mjd($year,$doy);
 	 my ($gwk,$gwkd) = mjd2gwkd($mjd);
 	 my ($year_not_used, $month, $monthday) = doy2monthday($year, $doy);
 	 my @hour_id_basket = ("a","b","c","d","e","f","g","h","i","j","k","l","m","n","o","p","q","r","s","t","u","v","w","x");
	 my $hour_id = $hour_id_basket[$hour];
# -obs cddis/ign/whu houly houly_v2 houly_v3 daily daily_v2 daily_v3
# -nav cddis/ign/whu brdc hourly daily
# -dcb cddis/aiub    cas dlr code
# -snx cddis/ign/whu igs
# -orb cddis/ign/whu gfz/gbm whu/wum grg cod igs
# -clk cddis/ign/whu gfz/gbm whu/wum grg cod igs
# -eop cddis/iers    all daily gpsrapid
# -slr cddis/tum     all prn
   my @ext_modes = ();
   if($type =~ /obs/) { 
   	 push @ext_modes,sprintf("%03d0.%02dd.Z",$doy,substr($year,2,2));
   	 push @ext_modes,sprintf("%03d%s.%02dd.Z",$doy,$hour_id,substr($year,2,2));
   	 push @ext_modes,sprintf("%03d0.%02dd.gz",$doy,substr($year,2,2));
   	 push @ext_modes,sprintf("%03d%s.%02dd.gz",$doy,$hour_id,substr($year,2,2));
   	 push @ext_modes,sprintf("%04d%03d0000_01D_30S_MO.crx.gz",$year,$doy); 
   	 push @ext_modes,sprintf("%04d%03d%02d00_01H_30S_MO.crx.gz",$year,$doy,$hour);
   }
   if($type =~ /nav/) { 
   	 #push @ext_modes,sprintf("%04d%03d%02d00_01H_GN.rnx.gz",$year,$doy,$hour);
   	 #push @ext_modes,sprintf("%04d%03d%02d00_01H_RN.rnx.gz",$year,$doy,$hour);
   	 #push @ext_modes,sprintf("%04d%03d%02d00_01H_EN.rnx.gz",$year,$doy,$hour);
   	 #push @ext_modes,sprintf("%04d%03d%02d00_01H_CN.rnx.gz",$year,$doy,$hour);
   	 #push @ext_modes,sprintf("%04d%03d%02d00_01H_JN.rnx.gz",$year,$doy,$hour);
   	 push @ext_modes,sprintf("%04d%03d%02d00_01H_MN.rnx.gz",$year,$doy,$hour);
   	 #push @ext_modes,sprintf("%03d%s.%02dn.Z",$doy,$hour_id,substr($year,2,2));
   	 #push @ext_modes,sprintf("%03d%s.%02dg.Z",$doy,$hour_id,substr($year,2,2));
   	 #push @ext_modes,sprintf("%03d%s.%02dl.Z",$doy,$hour_id,substr($year,2,2));
   	 #push @ext_modes,sprintf("%03d%s.%02df.Z",$doy,$hour_id,substr($year,2,2));
   	 #push @ext_modes,sprintf("%03d%s.%02dq.Z",$doy,$hour_id,substr($year,2,2));
   	 #push @ext_modes,sprintf("%03d%s.%02dp.Z",$doy,$hour_id,substr($year,2,2));
   	 push @ext_modes,sprintf("%04d%03d0000_01D_MN.rnx.gz",$year,$doy);
   	 push @ext_modes,sprintf("%03d0.%02dp.Z",$doy,substr($year,2,2));
   	 push @ext_modes,sprintf("%03d0.%02dp.gz",$doy,substr($year,2,2));
   }
   if($type =~ /dcb/) { 
   	 push @ext_modes,sprintf("%04d%03d0000_01D_01D_DCB.BSX.gz",$year,$doy);
   	 push @ext_modes,sprintf("P1C1%02d%02d.DCB.Z",substr($year,2,2),$month);
   	 push @ext_modes,sprintf("P1P2%02d%02d.DCB.Z",substr($year,2,2),$month);
   	 push @ext_modes,sprintf("P2C2%02d%02d_RINEX.DCB.Z",substr($year,2,2),$month);
   }
   if($type =~ /snx/) { 
   	 push @ext_modes,sprintf("%04d.snx.Z",$gwk);
   	 push @ext_modes,sprintf("%04d.snx.gz",$gwk);
   }
   if($type =~ /orb/) {
   	 push @ext_modes,sprintf("igs%04d%01d.sp3.Z",$gwk,$gwkd);
   	 push @ext_modes,sprintf("igs%04d%01d.sp3.gz",$gwk,$gwkd);
   	 push @ext_modes,sprintf("%04d%03d0000_01D_05M_ORB.SP3.gz",$year,$doy);
   	 push @ext_modes,sprintf("%04d%03d0000_01D_15M_ORB.SP3.gz",$year,$doy);
   }
   if($type =~ /clk/) { 
   	 push @ext_modes,sprintf("igs%04d%01d.clk_30s.Z",$gwk,$gwkd);
   	 push @ext_modes,sprintf("igs%04d%01d.clk_30s.gz",$gwk,$gwkd);
   	 push @ext_modes,sprintf("%04d%03d0000_01D_30S_CLK.CLK.gz",$year,$doy);
   }
   if($type =~ /eop/) { 
   	 push @ext_modes,"finals2000A.data";
   	 push @ext_modes,"finals2000A.daily";
   	 push @ext_modes,"gpsrapid.out";
   	 push @ext_modes,"gpsrapid.daily";
   }
   if($type =~ /slr/) { 
   	 push @ext_modes,sprintf("%04d%02d.npt",$year,$month);
   }
   my $lgnss = 0;
   foreach my $ext_mode (@ext_modes) {
	   if($remote_name =~ /$ext_mode/) {
	   	 $lgnss = 1;
	   	 last;
	   }
   }
   return $lgnss;
 }
 
 sub yeardoy2mjd {
	 my ($iyear, $idoy) = @_;
	 my $iyear2 = $iyear -1;
	 my $mjd;
	 {
		 use integer;
		 $mjd =  365*$iyear-678941+$iyear2/4-$iyear2/100+$iyear2/400;
	 } 
	 $mjd = $mjd + $idoy;
	 return $mjd;
 }
 
 sub mjd2gwkd {
	 my ($mjd) = @_;
	 my $gwk  = int(($mjd - 44244)/7);
	 my $gwkd = $mjd-44244 - $gwk * 7;
	 return ($gwk,$gwkd);
 }
 
 sub doy2monthday {
	 my @days_in_month = (31,28,31,30,31,30,31,31,30,31,30,31);
	 my ($iyear,$idoy) = @_;
	 $days_in_month[1]= ($iyear%4==0 && $iyear%100!=0 || $iyear%400 == 0) ? 29 : 28;
	 my $iday = $idoy;
	 my $imonth;
	 for($imonth=0;$imonth<12;$imonth++) {
		 if($iday <= $days_in_month[$imonth]) {
			 last;
		 }
		 $iday = $iday - $days_in_month[$imonth];
	 }
	 $imonth++;
	 return (sprintf("%04d",$iyear),sprintf("%02d",$imonth),sprintf("%02d",$iday));
 }
小马甲的新马甲
关注
  • 0
    点赞
  • 踩
  • 15
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
gnss tool kit
11-06
gps定位，包含卫星位置计算，各个误差模型的建立，最小二乘解算
GNSS TOOL导航定位领域实用工具
新猿异码的博客
07-13 2719
GNSS TOOL是一款非常实用的导航定位类产品测试工具，通过串口连接导航定位设备，可实时打印串口数据，分析并展示定位信息、搜星情况、卫星信号强度等关键信息，同时支持测试数据的抓取归档。另外还集成了一些小工具，如：NMEA/KML转换、差分数据注入、指令配置管理等。......
【GNSS】常见的GNSS免费软件和开源软件（持续更新）
最新发布
a922922737的博客
03-26 1524
【GNSS】常见的GNSS免费软件和开源软件（持续更新）
matlab求极差代码-GNSS_Tools:用于操作GPS、定位和授时以及导航数据的工具
06-03
matlab求极差代码GNSS 工具 -- ALPHA 一组用于 GNSS 数据处理的有用 MATLAB 工具 注意：该软件仍处于 alpha 开发阶段； 我正在Swift开发这个项目的功能，并保留对代码库进行实质性更改的权利，而无需寻求输入或通知任何人。 目录结构 文件_处理 用于从 rinex 和（最终）二进制 NovAtel 日志中提取数据的 Matlab 工具。 getNewEphemeris.m从位于 ftp://cddis.gsfc.nasa.gov/gnss/data/hourly/ 的 IGS 存储库加载所有 GPS 卫星的最新星历数据 loadEphemeris.m从指定的 RINEX 导航文件加载星历数据 RinexObsToCSV.py独立 Python 脚本，可将 RINEX 观察文件解析为具有用户指定字段的 CSV NovAtel_src该目录包含可以解析 NovAtel 二进制 .gps 文件以提取 BESTPOS 和 RANGE 日志的 C 文件。 最终，这些可以构建为可以从 matlab 调用的 .mex 文件，但 C 版本现在可以运行，可以将数据解析为
GnssToolKit3.rar 中科微GPS定位数据操作软件
11-01
GnssToolKit3.rar GnssToolKit3为一款配合杭州中科微卫星定位接收机(以下简称为接收机)使用的软件. 用于显示接收机的输出信息, 配置接收机的内部状态, 并对接收机的性能做一些简单的测试.
GnssToolKit3.rar
08-09
中科微定位芯片测试软件。全中文
GNSS数据质量检查软件（GNSScheck）
11-03
GNSS数据质量检查软件（简称GNSScheck）用于RINEX标准格式的GNSS数据质量检查，便于快速的了解所测点位的GNSS数据有效率、周跳比、丢失历元个数以及多路径影响，软件支持批量GNSS数据检查。 GNSScheck软件无需安装，...
GNSS控制网数据处理.zip
05-10
中海达GNSS数据处理软件HGO，配套相关数据，操作简单，界面人性化，适合测绘工程本科生
GNSS数据质量检查软件（GNSScheck）V1.1
02-03
GNSS数据质量检查软件（简称GNSScheck）用于RINEX标准格式的GNSS数据质量检查，便于快速的了解所测点位的GNSS数据有效率、周跳比、丢失历元个数以及多路径影响，软件支持批量GNSS数据检查。 GNSScheck软件无需安装，...
IMU/GNSS开源仿真工具
04-25
开源的IMU/GNSS仿真工具，基于Python开发。内建传感器数据生成，传感器误差模型，提供了多个实例算法代码。可以有效帮助IMU/GNSS开发。
gnsspy:用于GNSS数据的Python工具包
05-15
Mustafa Serkan Isik（ ）和Volkan Ozbey（ ）开发的GNSS数据Python工具包。 该项目仍在进行中。 请向我们发送您的反馈意见... 什么是GNSSpy？ GNSSpy是一个免费的开源库，用于处理多个GNSS和RINEX文件的不同版本...
gnss-analysis:用于分析gnss算法和gnss数据的工具
05-13
gnss分析 用于分析所存储的GNSS数据上的libswiftnav过滤器的工具。 设置和安装 首先，您需要安装 ， 和 。 您可能还需要但实际上只需要使用--write-hdf5选项创建的某些文件。 可以按照各自页面上的指示进行安装。 然后，您将需要此库更多的依赖项。 这些可以安装 sudo pip install numpy tables pandas 然后可以使用 sudo python setup.py install 用法 给定一个由piksi_tools生成的JSON日志文件，您可以生成一个观测，星历和单点/ RTK解决方案的HDF5文件： python gnss_analysis/hdf5.py -o my_file.hdf5 data/serial_link_log_20150314-190228_dl_sat_fail_test1.log.json.dat usag
GNSS时间转换工具
03-31
GNSS时间转换，支持utc,儒略日，gps时相互转换（源于GPSTK）
GNSS数据自动下载
09-26
可以自动下载各种GNSS数据 完整 方便 傻瓜式操作
GNSS坐标转换工具
11-19
各种坐标的转换工具，包括WGS-84、北京54、北京80等坐标的转换。还可以支持自定义坐标系的转换。还支持将RTK、BLH、ORG文件转换成KML文件。
GNSS软件处理
05-02
GNSS软件处理，，阿斯会丢啊啥的欧嫂大力加强哦i我和我就来到了卡萨诺的
重磅 | 谷歌发布免费GNSS数据分析工具【内附下载地址】
gis_3s_user的博客
01-05 8346
摘要： 谷歌GNSS分析工具，对安卓设备采集的GNSS测量数据进行分析。 　　泰伯网讯  继去年推出安卓设备的GNSS原始测量功能，近日，谷歌又发布了免费GNSS(全球导航卫星系统)分析工具，用于处理和分析GNSS原始测量数据，既可以帮助制造商调试GNSS接收机的工作状态，还可用于研究和了解其他GNSS相关信息。 　　利用GNSS原始测量功能，用户可以从手机或平板电脑上，获得包括美国GPS、俄
GNSS数据下载软件介绍----GAMPII-GOOD-master
qq_43381998的博客
09-08 1323
2.解压文件夹，放到指定位置，这里我将其解压到D盘，文件路径为：D:\GAMPII-GOOD-master。
python脚本--批量下载GNSS数据
专注人工智能，主攻CV
07-19 1522
1 前言 2020年7月19日，应某一大佬要求，为其写一个用于批量下载GNSS数据的脚本。恰好前几天研究过如何在教务系统中自动签到，便有了这篇博文，希望能够为下载数据的各位GNSSer提供一些参考。 2 思路 使用selenium模块实现模拟登录，定位到下载数据的页面，并获取网页源码； 通过re模块(正则表达式)实现网页源码中数据压缩包名称的爬取； 匹配需要下载的测站和爬取得到的测站，提取能够下载的站点数据包名称； 根据站点数据包名称遍历下载。 3. Talk is cheap 运行环境：python3
gnss数据解析 matlab
10-25
GNSS数据解析是指将从GNSS设备中获取的原始数据进行处理和解析，以获取有用的信息，例如位置、速度、距离、倾角等。Matlab是一种常用的工具，可以用于GNSS数据的处理和解析。通过编写Matlab代码，可以实现实时位置和实时倾角的表示，以及对GNSS数据进行后处理和分析。在Matlab中，可以使用各种函数和工具箱来处理GNSS数据，例如NMEA解析器和求极差代码等。此外，Matlab还提供了读写文件的代码，可以用于处理GNSS元数据标准。总之，Matlab是一种非常有用的工具，可以帮助GNSS数据分析人员更好地处理和解析GNSS数据。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值