最近就会一直哭，坐地铁也会哭，中午吃饭也会哭。我真的好难过。
下面来讲一讲kaldi的语音识别，使用aishell1的15GB的语音数据
1、首先要下载kaldi的语音识别库
git clone https://github.com/kaldi-asr/kaldi.git
然后进入到tools文件夹下面安装依赖包
cd tools
.extras/check_dependencies.sh
check_dependencies.sh之后会提示相关的命令，让你去安装相关的包。
安装完后再执行
.extras/check_dependencies.sh
命令
重复上述步骤，直到.extras/check_dependencies.sh显示OK为止
2、进入到kaldi/src目录下面，去编译kaldi
./configure --shared
make depend -j 8
make -j 8
3、下载aishell1的数据集去进行训练
http://www.openslr.org/resources/33/data_aishell.tgz
4、下载完后，就准备开始训练了
一、首先修改下面的这个文件
kaldi/egs/aishell/s5/cmd.sh
把下面的queue.pl 改成run.pl 。
因为是在本地跑的，所以没有集群
export train_cmd="queue.pl --mem 2G"
export decode_cmd="queue.pl --mem 4G"
export mkgraph_cmd="queue.pl --mem 8G"
二、修改下面这个文件中的数据目录的地址
kaldi/egs/aishell/s5/cmd.sh
data=/export/a05/xna/data 改成 你所下载的data_aishell.tgz文件所在的文件夹就可以了
data_url=www.openslr.org/resources/33 表示还要下载一个resource_data.tgz文件，会去自动下载，这个可以不需要care它
三、最后执行run.sh命令
下面是识别的日志
nohup: ignoring input
local/nnet3/run_ivector_common.sh: training the iVector extractor
steps/online/nnet2/train_ivector_extractor.sh --cmd run.pl --mem 2G --nj 10 data/train_sp_hires_nopitch exp/nnet3/diag_ubm exp/nnet3/extractor
utils/data/modify_speaker_info.sh: copied data from data/train_sp_hires_nopitch to exp/nnet3/ivectors_train_sp/train_sp_sp_hires_nopitch_max2, number of speakers changed from 1020 to 180399
utils/validate_data_dir.sh: Successfully validated data-directory exp/nnet3/ivectors_train_sp/train_sp_sp_hires_nopitch_max2
steps/online/nnet2/extract_ivectors_online.sh --cmd run.pl --mem 2G --nj 30 exp/nnet3/ivectors_train_sp/train_sp_sp_hires_nopitch_max2 exp/nnet3/extractor exp/nnet3/ivectors_train_sp
steps/online/nnet2/extract_ivectors_online.sh: extracting iVectors
steps/online/nnet2/extract_ivectors_online.sh: combining iVectors across jobs
steps/online/nnet2/extract_ivectors_online.sh: done extracting (online) iVectors to exp/nnet3/ivectors_train_sp using the extractor in exp/nnet3/extractor.
steps/online/nnet2/extract_ivectors_online.sh --cmd run.pl --mem 2G --nj 8 data/dev_hires_nopitch exp/nnet3/extractor exp/nnet3/ivectors_dev
steps/online/nnet2/extract_ivectors_online.sh: extracting iVectors
steps/online/nnet2/extract_ivectors_online.sh: combining iVectors across jobs
steps/online/nnet2/extract_ivectors_online.sh: done extracting (online) iVectors to exp/nnet3/ivectors_dev using the extractor in exp/nnet3/extractor.
steps/online/nnet2/extract_ivectors_online.sh --cmd run.pl --mem 2G --nj 8 data/test_hires_nopitch exp/nnet3/extractor exp/nnet3/ivectors_test
steps/online/nnet2/extract_ivectors_online.sh: extracting iVectors
steps/online/nnet2/extract_ivectors_online.sh: combining iVectors across jobs
steps/online/nnet2/extract_ivectors_online.sh: done extracting (online) iVectors to exp/nnet3/ivectors_test using the extractor in exp/nnet3/extractor.
local/nnet3/run_tdnn.sh: creating neural net configs
tree-info exp/tri5a_sp_ali/tree
steps/nnet3/xconfig_to_configs.py --xconfig-file exp/nnet3/tdnn_sp/configs/network.xconfig --config-dir exp/nnet3/tdnn_sp/configs/
nnet3-init exp/nnet3/tdnn_sp/configs//init.config exp/nnet3/tdnn_sp/configs//init.raw
LOG (nnet3-init[5.5.814~4-3ce241]:main():nnet3-init.cc:80) Initialized raw neural net and wrote it to exp/nnet3/tdnn_sp/configs//init.raw
nnet3-info exp/nnet3/tdnn_sp/configs//init.raw
nnet3-init exp/nnet3/tdnn_sp/configs//ref.config exp/nnet3/tdnn_sp/configs//ref.raw
LOG (nnet3-init[5.5.814~4-3ce241]:main():nnet3-init.cc:80) Initialized raw neural net and wrote it to exp/nnet3/tdnn_sp/configs//ref.raw
nnet3-info exp/nnet3/tdnn_sp/configs//ref.raw
nnet3-init exp/nnet3/tdnn_sp/configs//ref.config exp/nnet3/tdnn_sp/configs//ref.raw
LOG (nnet3-init[5.5.814~4-3ce241]:main():nnet3-init.cc:80) Initialized raw neural net and wrote it to exp/nnet3/tdnn_sp/configs//ref.raw
nnet3-info exp/nnet3/tdnn_sp/configs//ref.raw
2020-10-16 04:12:04,365 [steps/nnet3/train_dnn.py:36 - <module> - INFO ] Starting DNN trainer (train_dnn.py)
steps/nnet3/train_dnn.py --stage=-10 --cmd=run.pl --mem 4G --feat.online-ivector-dir exp/nnet3/ivectors_train_sp --feat.cmvn-opts=--norm-means=false --norm-vars=false --trainer.num-epochs 4 --trainer.optimization.num-jobs-initial 2 --trainer.optimization.num-jobs-final 2 --trainer.optimization.initial-effective-lrate 0.0015 --trainer.optimization.final-effective-lrate 0.00015 --egs.dir --cleanup.remove-egs true --cleanup.preserve-model-interval 500 --use-gpu wait --feat-dir=data/train_sp_hires --ali-dir exp/tri5a_sp_ali --lang data/lang --reporting.email= --dir=exp/nnet3/tdnn_sp
['steps/nnet3/train_dnn.py', '--stage=-10', '--cmd=run.pl --mem 4G', '--feat.online-ivector-dir', 'exp/nnet3/ivectors_train_sp', '--feat.cmvn-opts=--norm-means=false --norm-vars=false', '--trainer.num-epochs', '4', '--trainer.optimization.num-jobs-initial', '2', '--trainer.optimization.num-jobs-final', '2', '--trainer.optimization.initial-effective-lrate', '0.0015', '--trainer.optimization.final-effective-lrate', '0.00015', '--egs.dir', '', '--cleanup.remove-egs', 'true', '--cleanup.preserve-model-interval', '500', '--use-gpu', 'wait', '--feat-dir=data/train_sp_hires', '--ali-dir', 'exp/tri5a_sp_ali', '--lang', 'data/lang', '--reporting.email=', '--dir=exp/nnet3/tdnn_sp']
2020-10-16 04:12:04,379 [steps/nnet3/train_dnn.py:178 - train - INFO ] Arguments for the experiment
{'ali_dir': 'exp/tri5a_sp_ali',
'backstitch_training_interval': 1,
'backstitch_training_scale': 0.0,
'cleanup': True,
'cmvn_opts': '--norm-means=false --norm-vars=false',
'combine_sum_to_one_penalty': 0.0,
'command': 'run.pl --mem 4G',
'compute_per_dim_accuracy': False,
'dir': 'exp/nnet3/tdnn_sp',
'do_final_combination': True,
'dropout_schedule': None,
'egs_command': None,
'egs_dir': None,
'egs_opts': None,
'egs_stage': 0,
'email': None,
'exit_stage': None,
'feat_dir': 'data/train_sp_hires',
'final_effective_lrate': 0.00015,
'frames_per_eg': 8,
'initial_effective_lrate': 0.0015,
'input_model': None,
'lang': 'data/lang',
'max_lda_jobs': 10,
'max_models_combine': 20,
'max_objective_evaluations': 30,
'max_param_change': 2.0,
'minibatch_size': '512',
'momentum': 0.0,
'num_epochs': 4.0,
'num_jobs_compute_prior': 10,
'num_jobs_final': 2,
'num_jobs_initial': 2,
'num_jobs_step': 1,
'online_ivector_dir': 'exp/nnet3/ivectors_train_sp',
'preserve_model_interval': 500,
'presoftmax_prior_scale_power': -0.25,
'prior_subset_size': 20000,
'proportional_shrink': 0.0,
'rand_prune': 4.0,
'remove_egs': True,
'reporting_interval': 0.1,
'samples_per_iter': 400000,
'shuffle_buffer_size': 5000,
'srand': 0,
'stage': -10,
'train_opts': [],
'use_gpu': 'wait'}
2020-10-16 04:12:07,825 [steps/nnet3/train_dnn.py:228 - train - INFO ] Initializing a basic network for estimating preconditioning matrix
2020-10-16 04:12:07,974 [steps/nnet3/train_dnn.py:238 - train - INFO ] Generating egs
steps/nnet3/get_egs.sh --cmd run.pl --mem 4G --cmvn-opts --norm-means=false --norm-vars=false --online-ivector-dir exp/nnet3/ivectors_train_sp --left-context 16 --right-context 12 --left-context-initial -1 --right-context-final -1 --stage 0 --samples-per-iter 400000 --frames-per-eg 8 --srand 0 data/train_sp_hires exp/tri5a_sp_ali exp/nnet3/tdnn_sp/egs
File data/train_sp_hires/utt2uniq exists, so augmenting valid_uttlist to
include all perturbed versions of the same 'real' utterances.
steps/nnet3/get_egs.sh: creating egs. To ensure they are not deleted later you can do: touch exp/nnet3/tdnn_sp/egs/.nodelete
steps/nnet3/get_egs.sh: feature type is raw, with 'apply-cmvn'
feat-to-dim scp:exp/nnet3/ivectors_train_sp/ivector_online.scp -
steps/nnet3/get_egs.sh: working out number of frames of training data
steps/nnet3/get_egs.sh: working out feature dim
steps/nnet3/get_egs.sh: creating 52 archives, each with 394272 egs, with
steps/nnet3/get_egs.sh: 8 labels per example, and (left,right) context = (16,12)
steps/nnet3/get_egs.sh: copying data alignments
copy-int-vector ark:- ark,scp:exp/nnet3/tdnn_sp/egs/ali.ark,exp/nnet3/tdnn_sp/egs/ali.scp
LOG (copy-int-vector[5.5.814~4-3ce241]:main():copy-int-vector.cc:83) Copied 360291 vectors of int32.
steps/nnet3/get_egs.sh: Getting validation and training subset examples.
steps/nnet3/get_egs.sh: ... extracting validation and training-subset alignments.
... Getting subsets of validation examples for diagnostics and combination.
steps/nnet3/get_egs.sh: Generating training examples on disk
steps/nnet3/get_egs.sh: recombining and shuffling order of archives on disk
steps/nnet3/get_egs.sh: removing temporary archives
steps/nnet3/get_egs.sh: removing temporary alignments
steps/nnet3/get_egs.sh: Finished preparing training examples
2020-10-16 04:55:25,722 [steps/nnet3/train_dnn.py:276 - train - INFO ] Computing the preconditioning matrix for input features
2020-10-16 05:04:23,973 [steps/nnet3/train_dnn.py:287 - train - INFO ] Computing initial vector for FixedScaleComponent before softmax, using priors^-0.25 and rescaling to average 1
2020-10-16 05:04:33,927 [steps/nnet3/train_dnn.py:294 - train - INFO ] Preparing the initial acoustic model.
2020-10-16 05:04:44,296 [steps/nnet3/train_dnn.py:319 - train - INFO ] Training will run for 4.0 epochs = 832 iterations
2020-10-16 05:04:44,297 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 0/831 Jobs: 2 Epoch: 0.00/4.0 (0.0% complete) lr: 0.003000
2020-10-16 05:05:44,597 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 1/831 Jobs: 2 Epoch: 0.00/4.0 (0.1% complete) lr: 0.002992
2020-10-16 05:06:41,698 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 2/831 Jobs: 2 Epoch: 0.01/4.0 (0.2% complete) lr: 0.002983
2020-10-16 05:07:37,982 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 3/831 Jobs: 2 Epoch: 0.01/4.0 (0.4% complete) lr: 0.002975
2020-10-16 05:08:33,712 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 4/831 Jobs: 2 Epoch: 0.02/4.0 (0.5% complete) lr: 0.002967
2020-10-16 05:09:30,842 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 5/831 Jobs: 2 Epoch: 0.02/4.0 (0.6% complete) lr: 0.002959
2020-10-16 05:10:46,849 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 6/831 Jobs: 2 Epoch: 0.03/4.0 (0.7% complete) lr: 0.002951
2020-10-16 05:11:56,632 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 7/831 Jobs: 2 Epoch: 0.03/4.0 (0.8% complete) lr: 0.002942
2020-10-16 05:13:05,099 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 8/831 Jobs: 2 Epoch: 0.04/4.0 (1.0% complete) lr: 0.002934
2020-10-16 05:14:16,828 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 9/831 Jobs: 2 Epoch: 0.04/4.0 (1.1% complete) lr: 0.002926
2020-10-16 05:15:28,308 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 10/831 Jobs: 2 Epoch: 0.05/4.0 (1.2% complete) lr: 0.002918
2020-10-16 05:16:24,801 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 11/831 Jobs: 2 Epoch: 0.05/4.0 (1.3% complete) lr: 0.002910
2020-10-16 05:17:21,802 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 12/831 Jobs: 2 Epoch: 0.06/4.0 (1.4% complete) lr: 0.002902
2020-10-16 05:18:18,906 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 13/831 Jobs: 2 Epoch: 0.06/4.0 (1.6% complete) lr: 0.002894
2020-10-16 05:19:15,981 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 14/831 Jobs: 2 Epoch: 0.07/4.0 (1.7% complete) lr: 0.002886
2020-10-16 05:20:12,785 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 15/831 Jobs: 2 Epoch: 0.07/4.0 (1.8% complete) lr: 0.002878
2020-10-16 05:21:09,623 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 16/831 Jobs: 2 Epoch: 0.08/4.0 (1.9% complete) lr: 0.002870
2020-10-16 05:22:06,385 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 17/831 Jobs: 2 Epoch: 0.08/4.0 (2.0% complete) lr: 0.002862
2020-10-16 05:23:02,744 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 18/831 Jobs: 2 Epoch: 0.09/4.0 (2.2% complete) lr: 0.002854
2020-10-16 05:23:59,714 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 19/831 Jobs: 2 Epoch: 0.09/4.0 (2.3% complete) lr: 0.002846
2020-10-16 05:24:56,352 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 20/831 Jobs: 2 Epoch: 0.10/4.0 (2.4% complete) lr: 0.002838
2020-10-16 05:25:56,027 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 21/831 Jobs: 2 Epoch: 0.10/4.0 (2.5% complete) lr: 0.002831
2020-10-16 05:26:52,836 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 22/831 Jobs: 2 Epoch: 0.11/4.0 (2.6% complete) lr: 0.002823
2020-10-16 05:27:49,771 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 23/831 Jobs: 2 Epoch: 0.11/4.0 (2.8% complete) lr: 0.002815
2020-10-16 05:28:46,837 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 24/831 Jobs: 2 Epoch: 0.12/4.0 (2.9% complete) lr: 0.002807
2020-10-16 05:29:43,671 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 25/831 Jobs: 2 Epoch: 0.12/4.0 (3.0% complete) lr: 0.002799
2020-10-16 05:30:40,848 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 26/831 Jobs: 2 Epoch: 0.12/4.0 (3.1% complete) lr: 0.002792
2020-10-16 05:31:37,973 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 27/831 Jobs: 2 Epoch: 0.13/4.0 (3.2% complete) lr: 0.002784
2020-10-16 05:32:35,122 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 28/831 Jobs: 2 Epoch: 0.13/4.0 (3.4% complete) lr: 0.002776
2020-10-16 05:33:31,688 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 29/831 Jobs: 2 Epoch: 0.14/4.0 (3.5% complete) lr: 0.002769
2020-10-16 05:34:28,835 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 30/831 Jobs: 2 Epoch: 0.14/4.0 (3.6% complete) lr: 0.002761
2020-10-16 05:35:25,719 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 31/831 Jobs: 2 Epoch: 0.15/4.0 (3.7% complete) lr: 0.002753
2020-10-16 05:36:23,054 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 32/831 Jobs: 2 Epoch: 0.15/4.0 (3.8% complete) lr: 0.002746
2020-10-16 05:37:19,915 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 33/831 Jobs: 2 Epoch: 0.16/4.0 (4.0% complete) lr: 0.002738
2020-10-16 05:38:16,925 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 34/831 Jobs: 2 Epoch: 0.16/4.0 (4.1% complete) lr: 0.002731
2020-10-16 05:39:13,181 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 35/831 Jobs: 2 Epoch: 0.17/4.0 (4.2% complete) lr: 0.002723
2020-10-16 05:40:10,302 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 36/831 Jobs: 2 Epoch: 0.17/4.0 (4.3% complete) lr: 0.002716
2020-10-16 05:41:07,285 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 37/831 Jobs: 2 Epoch: 0.18/4.0 (4.4% complete) lr: 0.002708
2020-10-16 05:42:04,467 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 38/831 Jobs: 2 Epoch: 0.18/4.0 (4.6% complete) lr: 0.002701
2020-10-16 05:43:00,830 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 39/831 Jobs: 2 Epoch: 0.19/4.0 (4.7% complete) lr: 0.002693
2020-10-16 05:43:57,886 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 40/831 Jobs: 2 Epoch: 0.19/4.0 (4.8% complete) lr: 0.002686
2020-10-16 05:44:57,538 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 41/831 Jobs: 2 Epoch: 0.20/4.0 (4.9% complete) lr: 0.002678
2020-10-16 05:45:54,379 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 42/831 Jobs: 2 Epoch: 0.20/4.0 (5.0% complete) lr: 0.002671
2020-10-16 05:46:50,807 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 43/831 Jobs: 2 Epoch: 0.21/4.0 (5.2% complete) lr: 0.002663
2020-10-16 05:47:47,542 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 44/831 Jobs: 2 Epoch: 0.21/4.0 (5.3% complete) lr: 0.002656
2020-10-16 05:48:44,027 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 45/831 Jobs: 2 Epoch: 0.22/4.0 (5.4% complete) lr: 0.002649
2020-10-16 05:49:41,102 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 46/831 Jobs: 2 Epoch: 0.22/4.0 (5.5% complete) lr: 0.002641
2020-10-16 05:50:38,021 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 47/831 Jobs: 2 Epoch: 0.23/4.0 (5.6% complete) lr: 0.002634
2020-10-16 05:51:34,709 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 48/831 Jobs: 2 Epoch: 0.23/4.0 (5.8% complete) lr: 0.002627
2020-10-16 05:52:31,832 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 49/831 Jobs: 2 Epoch: 0.24/4.0 (5.9% complete) lr: 0.002620
2020-10-16 05:53:27,885 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 50/831 Jobs: 2 Epoch: 0.24/4.0 (6.0% complete) lr: 0.002612
2020-10-16 05:54:24,876 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 51/831 Jobs: 2 Epoch: 0.25/4.0 (6.1% complete) lr: 0.002605
2020-10-16 05:55:20,847 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 52/831 Jobs: 2 Epoch: 0.25/4.0 (6.2% complete) lr: 0.002598
2020-10-16 05:56:17,213 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 53/831 Jobs: 2 Epoch: 0.25/4.0 (6.4% complete) lr: 0.002591
2020-10-16 05:57:12,977 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 54/831 Jobs: 2 Epoch: 0.26/4.0 (6.5% complete) lr: 0.002584
2020-10-16 05:58:09,984 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 55/831 Jobs: 2 Epoch: 0.26/4.0 (6.6% complete) lr: 0.002576
2020-10-16 05:59:06,743 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 56/831 Jobs: 2 Epoch: 0.27/4.0 (6.7% complete) lr: 0.002569
2020-10-16 06:00:02,946 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 57/831 Jobs: 2 Epoch: 0.27/4.0 (6.9% complete) lr: 0.002562
2020-10-16 06:00:59,436 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 58/831 Jobs: 2 Epoch: 0.28/4.0 (7.0% complete) lr: 0.002555
2020-10-16 06:01:56,221 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 59/831 Jobs: 2 Epoch: 0.28/4.0 (7.1% complete) lr: 0.002548
2020-10-16 06:02:52,520 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 60/831 Jobs: 2 Epoch: 0.29/4.0 (7.2% complete) lr: 0.002541
2020-10-16 06:03:52,055 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 61/831 Jobs: 2 Epoch: 0.29/4.0 (7.3% complete) lr: 0.002534
2020-10-16 06:04:47,626 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 62/831 Jobs: 2 Epoch: 0.30/4.0 (7.5% complete) lr: 0.002527
2020-10-16 06:05:43,905 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 63/831 Jobs: 2 Epoch: 0.30/4.0 (7.6% complete) lr: 0.002520
2020-10-16 06:06:40,608 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 64/831 Jobs: 2 Epoch: 0.31/4.0 (7.7% complete) lr: 0.002513
2020-10-16 06:07:37,478 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 65/831 Jobs: 2 Epoch: 0.31/4.0 (7.8% complete) lr: 0.002506
2020-10-16 06:08:34,606 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 66/831 Jobs: 2 Epoch: 0.32/4.0 (7.9% complete) lr: 0.002499
2020-10-16 06:09:30,998 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 67/831 Jobs: 2 Epoch: 0.32/4.0 (8.1% complete) lr: 0.002492
2020-10-16 06:10:26,981 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 68/831 Jobs: 2 Epoch: 0.33/4.0 (8.2% complete) lr: 0.002485
2020-10-16 06:11:22,411 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 69/831 Jobs: 2 Epoch: 0.33/4.0 (8.3% complete) lr: 0.002478
2020-10-16 06:12:19,313 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 70/831 Jobs: 2 Epoch: 0.34/4.0 (8.4% complete) lr: 0.002472
2020-10-16 06:13:16,613 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 71/831 Jobs: 2 Epoch: 0.34/4.0 (8.5% complete) lr: 0.002465
2020-10-16 06:14:13,919 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 72/831 Jobs: 2 Epoch: 0.35/4.0 (8.7% complete) lr: 0.002458
2020-10-16 06:15:10,097 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 73/831 Jobs: 2 Epoch: 0.35/4.0 (8.8% complete) lr: 0.002451
2020-10-16 06:16:06,754 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 74/831 Jobs: 2 Epoch: 0.36/4.0 (8.9% complete) lr: 0.002444
2020-10-16 06:17:03,935 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 75/831 Jobs: 2 Epoch: 0.36/4.0 (9.0% complete) lr: 0.002438
2020-10-16 06:18:01,050 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 76/831 Jobs: 2 Epoch: 0.37/4.0 (9.1% complete) lr: 0.002431
2020-10-16 06:18:57,946 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 77/831 Jobs: 2 Epoch: 0.37/4.0 (9.3% complete) lr: 0.002424
2020-10-16 06:19:54,394 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 78/831 Jobs: 2 Epoch: 0.38/4.0 (9.4% complete) lr: 0.002418
2020-10-16 06:20:50,941 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 79/831 Jobs: 2 Epoch: 0.38/4.0 (9.5% complete) lr: 0.002411
2020-10-16 06:21:47,574 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 80/831 Jobs: 2 Epoch: 0.38/4.0 (9.6% complete) lr: 0.002404
2020-10-16 06:22:47,573 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 81/831 Jobs: 2 Epoch: 0.39/4.0 (9.7% complete) lr: 0.002398
2020-10-16 06:23:43,185 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 82/831 Jobs: 2 Epoch: 0.39/4.0 (9.9% complete) lr: 0.002391
2020-10-16 06:24:39,704 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 83/831 Jobs: 2 Epoch: 0.40/4.0 (10.0% complete) lr: 0.002384
2020-10-16 06:25:35,503 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 84/831 Jobs: 2 Epoch: 0.40/4.0 (10.1% complete) lr: 0.002378
2020-10-16 06:26:31,770 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 85/831 Jobs: 2 Epoch: 0.41/4.0 (10.2% complete) lr: 0.002371
2020-10-16 06:27:28,527 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 86/831 Jobs: 2 Epoch: 0.41/4.0 (10.3% complete) lr: 0.002365
2020-10-16 06:28:25,726 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 87/831 Jobs: 2 Epoch: 0.42/4.0 (10.5% complete) lr: 0.002358
2020-10-16 06:29:22,161 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 88/831 Jobs: 2 Epoch: 0.42/4.0 (10.6% complete) lr: 0.002352
2020-10-16 06:30:18,811 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 89/831 Jobs: 2 Epoch: 0.43/4.0 (10.7% complete) lr: 0.002345
2020-10-16 06:31:15,519 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 90/831 Jobs: 2 Epoch: 0.43/4.0 (10.8% complete) lr: 0.002339
2020-10-16 06:32:12,616 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 91/831 Jobs: 2 Epoch: 0.44/4.0 (10.9% complete) lr: 0.002332
2020-10-16 06:33:09,387 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 92/831 Jobs: 2 Epoch: 0.44/4.0 (11.1% complete) lr: 0.002326
2020-10-16 06:34:06,491 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 93/831 Jobs: 2 Epoch: 0.45/4.0 (11.2% complete) lr: 0.002319
2020-10-16 06:35:03,553 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 94/831 Jobs: 2 Epoch: 0.45/4.0 (11.3% complete) lr: 0.002313
2020-10-16 06:35:59,697 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 95/831 Jobs: 2 Epoch: 0.46/4.0 (11.4% complete) lr: 0.002306
2020-10-16 06:36:56,576 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 96/831 Jobs: 2 Epoch: 0.46/4.0 (11.5% complete) lr: 0.002300
2020-10-16 06:37:52,431 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 97/831 Jobs: 2 Epoch: 0.47/4.0 (11.7% complete) lr: 0.002294
2020-10-16 06:38:49,565 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 98/831 Jobs: 2 Epoch: 0.47/4.0 (11.8% complete) lr: 0.002287
2020-10-16 06:39:45,406 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 99/831 Jobs: 2 Epoch: 0.48/4.0 (11.9% complete) lr: 0.002281
2020-10-16 06:40:42,488 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 100/831 Jobs: 2 Epoch: 0.48/4.0 (12.0% complete) lr: 0.002275
2020-10-16 06:41:41,379 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 101/831 Jobs: 2 Epoch: 0.49/4.0 (12.1% complete) lr: 0.002268
2020-10-16 06:42:38,194 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 102/831 Jobs: 2 Epoch: 0.49/4.0 (12.3% complete) lr: 0.002262
2020-10-16 06:43:35,145 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 103/831 Jobs: 2 Epoch: 0.50/4.0 (12.4% complete) lr: 0.002256
2020-10-16 06:44:31,501 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 104/831 Jobs: 2 Epoch: 0.50/4.0 (12.5% complete) lr: 0.002250
2020-10-16 06:45:27,371 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 105/831 Jobs: 2 Epoch: 0.50/4.0 (12.6% complete) lr: 0.002243
2020-10-16 06:46:24,576 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 106/831 Jobs: 2 Epoch: 0.51/4.0 (12.7% complete) lr: 0.002237
2020-10-16 06:47:20,883 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 107/831 Jobs: 2 Epoch: 0.51/4.0 (12.9% complete) lr: 0.002231
2020-10-16 06:48:17,068 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 108/831 Jobs: 2 Epoch: 0.52/4.0 (13.0% complete) lr: 0.002225
2020-10-16 06:49:13,871 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 109/831 Jobs: 2 Epoch: 0.52/4.0 (13.1% complete) lr: 0.002219
2020-10-16 06:50:10,426 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 110/831 Jobs: 2 Epoch: 0.53/4.0 (13.2% complete) lr: 0.002213
2020-10-16 06:51:07,305 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 111/831 Jobs: 2 Epoch: 0.53/4.0 (13.3% complete) lr: 0.002207
2020-10-16 06:52:04,208 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 112/831 Jobs: 2 Epoch: 0.54/4.0 (13.5% complete) lr: 0.002200
2020-10-16 06:53:00,857 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 113/831 Jobs: 2 Epoch: 0.54/4.0 (13.6% complete) lr: 0.002194
2020-10-16 06:53:58,479 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 114/831 Jobs: 2 Epoch: 0.55/4.0 (13.7% complete) lr: 0.002188
2020-10-16 06:54:55,251 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 115/831 Jobs: 2 Epoch: 0.55/4.0 (13.8% complete) lr: 0.002182
2020-10-16 06:55:52,139 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 116/831 Jobs: 2 Epoch: 0.56/4.0 (13.9% complete) lr: 0.002176
2020-10-16 06:56:48,905 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 117/831 Jobs: 2 Epoch: 0.56/4.0 (14.1% complete) lr: 0.002170
2020-10-16 06:57:45,985 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 118/831 Jobs: 2 Epoch: 0.57/4.0 (14.2% complete) lr: 0.002164
2020-10-16 06:58:42,766 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 119/831 Jobs: 2 Epoch: 0.57/4.0 (14.3% complete) lr: 0.002158
2020-10-16 06:59:39,759 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 120/831 Jobs: 2 Epoch: 0.58/4.0 (14.4% complete) lr: 0.002152
2020-10-16 07:00:39,499 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 121/831 Jobs: 2 Epoch: 0.58/4.0 (14.5% complete) lr: 0.002146
2020-10-16 07:01:36,578 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 122/831 Jobs: 2 Epoch: 0.59/4.0 (14.7% complete) lr: 0.002140
2020-10-16 07:02:32,949 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 123/831 Jobs: 2 Epoch: 0.59/4.0 (14.8% complete) lr: 0.002134
2020-10-16 07:03:29,205 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 124/831 Jobs: 2 Epoch: 0.60/4.0 (14.9% complete) lr: 0.002129
2020-10-16 07:04:25,917 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 125/831 Jobs: 2 Epoch: 0.60/4.0 (15.0% complete) lr: 0.002123
2020-10-16 07:05:23,187 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 126/831 Jobs: 2 Epoch: 0.61/4.0 (15.1% complete) lr: 0.002117
2020-10-16 07:06:19,866 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 127/831 Jobs: 2 Epoch: 0.61/4.0 (15.3% complete) lr: 0.002111
2020-10-16 07:07:16,209 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 128/831 Jobs: 2 Epoch: 0.62/4.0 (15.4% complete) lr: 0.002105
2020-10-16 07:08:12,902 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 129/831 Jobs: 2 Epoch: 0.62/4.0 (15.5% complete) lr: 0.002099
2020-10-16 07:09:10,200 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 130/831 Jobs: 2 Epoch: 0.62/4.0 (15.6% complete) lr: 0.002093
2020-10-16 07:10:07,373 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 131/831 Jobs: 2 Epoch: 0.63/4.0 (15.7% complete) lr: 0.002088
2020-10-16 07:11:03,670 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 132/831 Jobs: 2 Epoch: 0.63/4.0 (15.9% complete) lr: 0.002082
2020-10-16 07:12:00,468 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 133/831 Jobs: 2 Epoch: 0.64/4.0 (16.0% complete) lr: 0.002076
2020-10-16 07:12:56,151 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 134/831 Jobs: 2 Epoch: 0.64/4.0 (16.1% complete) lr: 0.002070
2020-10-16 07:13:52,243 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 135/831 Jobs: 2 Epoch: 0.65/4.0 (16.2% complete) lr: 0.002065
2020-10-16 07:14:49,250 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 136/831 Jobs: 2 Epoch: 0.65/4.0 (16.3% complete) lr: 0.002059
2020-10-16 07:15:46,202 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 137/831 Jobs: 2 Epoch: 0.66/4.0 (16.5% complete) lr: 0.002053
2020-10-16 07:16:42,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 138/831 Jobs: 2 Epoch: 0.66/4.0 (16.6% complete) lr: 0.002048
2020-10-16 07:17:39,642 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 139/831 Jobs: 2 Epoch: 0.67/4.0 (16.7% complete) lr: 0.002042
2020-10-16 07:18:36,030 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 140/831 Jobs: 2 Epoch: 0.67/4.0 (16.8% complete) lr: 0.002036
2020-10-16 07:19:36,404 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 141/831 Jobs: 2 Epoch: 0.68/4.0 (16.9% complete) lr: 0.002031
2020-10-16 07:20:33,202 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 142/831 Jobs: 2 Epoch: 0.68/4.0 (17.1% complete) lr: 0.002025
2020-10-16 07:21:29,616 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 143/831 Jobs: 2 Epoch: 0.69/4.0 (17.2% complete) lr: 0.002020
2020-10-16 07:22:26,044 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 144/831 Jobs: 2 Epoch: 0.69/4.0 (17.3% complete) lr: 0.002014
2020-10-16 07:23:22,948 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 145/831 Jobs: 2 Epoch: 0.70/4.0 (17.4% complete) lr: 0.002008
2020-10-16 07:24:19,022 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 146/831 Jobs: 2 Epoch: 0.70/4.0 (17.5% complete) lr: 0.002003
2020-10-16 07:25:15,777 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 147/831 Jobs: 2 Epoch: 0.71/4.0 (17.7% complete) lr: 0.001997
2020-10-16 07:26:12,430 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 148/831 Jobs: 2 Epoch: 0.71/4.0 (17.8% complete) lr: 0.001992
2020-10-16 07:27:09,136 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 149/831 Jobs: 2 Epoch: 0.72/4.0 (17.9% complete) lr: 0.001986
2020-10-16 07:28:05,941 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 150/831 Jobs: 2 Epoch: 0.72/4.0 (18.0% complete) lr: 0.001981
2020-10-16 07:29:02,297 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 151/831 Jobs: 2 Epoch: 0.73/4.0 (18.1% complete) lr: 0.001975
2020-10-16 07:29:59,471 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 152/831 Jobs: 2 Epoch: 0.73/4.0 (18.3% complete) lr: 0.001970
2020-10-16 07:30:55,595 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 153/831 Jobs: 2 Epoch: 0.74/4.0 (18.4% complete) lr: 0.001964
2020-10-16 07:31:52,129 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 154/831 Jobs: 2 Epoch: 0.74/4.0 (18.5% complete) lr: 0.001959
2020-10-16 07:32:49,020 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 155/831 Jobs: 2 Epoch: 0.75/4.0 (18.6% complete) lr: 0.001954
2020-10-16 07:33:45,890 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 156/831 Jobs: 2 Epoch: 0.75/4.0 (18.8% complete) lr: 0.001948
2020-10-16 07:34:42,623 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 157/831 Jobs: 2 Epoch: 0.75/4.0 (18.9% complete) lr: 0.001943
2020-10-16 07:35:39,791 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 158/831 Jobs: 2 Epoch: 0.76/4.0 (19.0% complete) lr: 0.001937
2020-10-16 07:36:36,905 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 159/831 Jobs: 2 Epoch: 0.76/4.0 (19.1% complete) lr: 0.001932
2020-10-16 07:37:33,803 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 160/831 Jobs: 2 Epoch: 0.77/4.0 (19.2% complete) lr: 0.001927
2020-10-16 07:38:34,250 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 161/831 Jobs: 2 Epoch: 0.77/4.0 (19.4% complete) lr: 0.001921
2020-10-16 07:39:29,874 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 162/831 Jobs: 2 Epoch: 0.78/4.0 (19.5% complete) lr: 0.001916
2020-10-16 07:40:26,872 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 163/831 Jobs: 2 Epoch: 0.78/4.0 (19.6% complete) lr: 0.001911
2020-10-16 07:41:23,854 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 164/831 Jobs: 2 Epoch: 0.79/4.0 (19.7% complete) lr: 0.001905
2020-10-16 07:42:20,992 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 165/831 Jobs: 2 Epoch: 0.79/4.0 (19.8% complete) lr: 0.001900
2020-10-16 07:43:17,626 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 166/831 Jobs: 2 Epoch: 0.80/4.0 (20.0% complete) lr: 0.001895
2020-10-16 07:44:14,514 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 167/831 Jobs: 2 Epoch: 0.80/4.0 (20.1% complete) lr: 0.001890
2020-10-16 07:45:11,314 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 168/831 Jobs: 2 Epoch: 0.81/4.0 (20.2% complete) lr: 0.001885
2020-10-16 07:46:07,680 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 169/831 Jobs: 2 Epoch: 0.81/4.0 (20.3% complete) lr: 0.001879
2020-10-16 07:47:04,690 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 170/831 Jobs: 2 Epoch: 0.82/4.0 (20.4% complete) lr: 0.001874
2020-10-16 07:48:01,089 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 171/831 Jobs: 2 Epoch: 0.82/4.0 (20.6% complete) lr: 0.001869
2020-10-16 07:48:57,895 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 172/831 Jobs: 2 Epoch: 0.83/4.0 (20.7% complete) lr: 0.001864
2020-10-16 07:49:54,823 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 173/831 Jobs: 2 Epoch: 0.83/4.0 (20.8% complete) lr: 0.001859
2020-10-16 07:50:51,794 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 174/831 Jobs: 2 Epoch: 0.84/4.0 (20.9% complete) lr: 0.001853
2020-10-16 07:51:48,052 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 175/831 Jobs: 2 Epoch: 0.84/4.0 (21.0% complete) lr: 0.001848
2020-10-16 07:52:44,192 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 176/831 Jobs: 2 Epoch: 0.85/4.0 (21.2% complete) lr: 0.001843
2020-10-16 07:53:40,805 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 177/831 Jobs: 2 Epoch: 0.85/4.0 (21.3% complete) lr: 0.001838
2020-10-16 07:54:37,767 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 178/831 Jobs: 2 Epoch: 0.86/4.0 (21.4% complete) lr: 0.001833
2020-10-16 07:55:34,479 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 179/831 Jobs: 2 Epoch: 0.86/4.0 (21.5% complete) lr: 0.001828
2020-10-16 07:56:31,534 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 180/831 Jobs: 2 Epoch: 0.87/4.0 (21.6% complete) lr: 0.001823
2020-10-16 07:57:31,404 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 181/831 Jobs: 2 Epoch: 0.87/4.0 (21.8% complete) lr: 0.001818
2020-10-16 07:58:27,334 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 182/831 Jobs: 2 Epoch: 0.88/4.0 (21.9% complete) lr: 0.001813
2020-10-16 07:59:23,629 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 183/831 Jobs: 2 Epoch: 0.88/4.0 (22.0% complete) lr: 0.001808
2020-10-16 08:00:19,669 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 184/831 Jobs: 2 Epoch: 0.88/4.0 (22.1% complete) lr: 0.001803
2020-10-16 08:03:57,594 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 185/831 Jobs: 2 Epoch: 0.89/4.0 (22.2% complete) lr: 0.001798
2020-10-16 08:05:18,522 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 186/831 Jobs: 2 Epoch: 0.89/4.0 (22.4% complete) lr: 0.001793
2020-10-16 08:06:43,628 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 187/831 Jobs: 2 Epoch: 0.90/4.0 (22.5% complete) lr: 0.001788
2020-10-16 08:07:51,101 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 188/831 Jobs: 2 Epoch: 0.90/4.0 (22.6% complete) lr: 0.001783
2020-10-16 08:09:05,325 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 189/831 Jobs: 2 Epoch: 0.91/4.0 (22.7% complete) lr: 0.001778
2020-10-16 08:10:12,683 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 190/831 Jobs: 2 Epoch: 0.91/4.0 (22.8% complete) lr: 0.001773
2020-10-16 08:11:29,934 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 191/831 Jobs: 2 Epoch: 0.92/4.0 (23.0% complete) lr: 0.001768
2020-10-16 08:12:40,295 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 192/831 Jobs: 2 Epoch: 0.92/4.0 (23.1% complete) lr: 0.001763
2020-10-16 08:13:56,114 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 193/831 Jobs: 2 Epoch: 0.93/4.0 (23.2% complete) lr: 0.001759
2020-10-16 08:15:09,184 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 194/831 Jobs: 2 Epoch: 0.93/4.0 (23.3% complete) lr: 0.001754
2020-10-16 08:16:15,045 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 195/831 Jobs: 2 Epoch: 0.94/4.0 (23.4% complete) lr: 0.001749
2020-10-16 08:17:28,713 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 196/831 Jobs: 2 Epoch: 0.94/4.0 (23.6% complete) lr: 0.001744
2020-10-16 08:18:36,998 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 197/831 Jobs: 2 Epoch: 0.95/4.0 (23.7% complete) lr: 0.001739
2020-10-16 08:19:56,998 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 198/831 Jobs: 2 Epoch: 0.95/4.0 (23.8% complete) lr: 0.001734
2020-10-16 08:21:08,120 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 199/831 Jobs: 2 Epoch: 0.96/4.0 (23.9% complete) lr: 0.001730
2020-10-16 08:22:25,968 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 200/831 Jobs: 2 Epoch: 0.96/4.0 (24.0% complete) lr: 0.001725
2020-10-16 08:23:41,456 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 201/831 Jobs: 2 Epoch: 0.97/4.0 (24.2% complete) lr: 0.001720
2020-10-16 08:24:51,652 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 202/831 Jobs: 2 Epoch: 0.97/4.0 (24.3% complete) lr: 0.001715
2020-10-16 08:26:24,261 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 203/831 Jobs: 2 Epoch: 0.98/4.0 (24.4% complete) lr: 0.001711
2020-10-16 08:27:41,985 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 204/831 Jobs: 2 Epoch: 0.98/4.0 (24.5% complete) lr: 0.001706
2020-10-16 08:28:48,141 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 205/831 Jobs: 2 Epoch: 0.99/4.0 (24.6% complete) lr: 0.001701
2020-10-16 08:30:08,939 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 206/831 Jobs: 2 Epoch: 0.99/4.0 (24.8% complete) lr: 0.001696
2020-10-16 08:31:35,367 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 207/831 Jobs: 2 Epoch: 1.00/4.0 (24.9% complete) lr: 0.001692
2020-10-16 08:32:55,935 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 208/831 Jobs: 2 Epoch: 1.00/4.0 (25.0% complete) lr: 0.001687
2020-10-16 08:34:01,907 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 209/831 Jobs: 2 Epoch: 1.00/4.0 (25.1% complete) lr: 0.001682
2020-10-16 08:35:18,714 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 210/831 Jobs: 2 Epoch: 1.01/4.0 (25.2% complete) lr: 0.001678
2020-10-16 08:36:15,311 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 211/831 Jobs: 2 Epoch: 1.01/4.0 (25.4% complete) lr: 0.001673
2020-10-16 08:37:12,184 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 212/831 Jobs: 2 Epoch: 1.02/4.0 (25.5% complete) lr: 0.001668
2020-10-16 08:38:09,105 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 213/831 Jobs: 2 Epoch: 1.02/4.0 (25.6% complete) lr: 0.001664
2020-10-16 08:39:05,887 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 214/831 Jobs: 2 Epoch: 1.03/4.0 (25.7% complete) lr: 0.001659
2020-10-16 08:40:01,457 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 215/831 Jobs: 2 Epoch: 1.03/4.0 (25.8% complete) lr: 0.001655
2020-10-16 08:40:58,382 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 216/831 Jobs: 2 Epoch: 1.04/4.0 (26.0% complete) lr: 0.001650
2020-10-16 08:41:54,955 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 217/831 Jobs: 2 Epoch: 1.04/4.0 (26.1% complete) lr: 0.001646
2020-10-16 08:42:51,790 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 218/831 Jobs: 2 Epoch: 1.05/4.0 (26.2% complete) lr: 0.001641
2020-10-16 08:43:48,537 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 219/831 Jobs: 2 Epoch: 1.05/4.0 (26.3% complete) lr: 0.001636
2020-10-16 08:44:45,659 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 220/831 Jobs: 2 Epoch: 1.06/4.0 (26.4% complete) lr: 0.001632
2020-10-16 08:45:46,245 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 221/831 Jobs: 2 Epoch: 1.06/4.0 (26.6% complete) lr: 0.001627
2020-10-16 08:46:43,042 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 222/831 Jobs: 2 Epoch: 1.07/4.0 (26.7% complete) lr: 0.001623
2020-10-16 08:47:38,845 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 223/831 Jobs: 2 Epoch: 1.07/4.0 (26.8% complete) lr: 0.001618
2020-10-16 08:48:36,279 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 224/831 Jobs: 2 Epoch: 1.08/4.0 (26.9% complete) lr: 0.001614
2020-10-16 08:49:31,908 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 225/831 Jobs: 2 Epoch: 1.08/4.0 (27.0% complete) lr: 0.001609
2020-10-16 08:50:28,711 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 226/831 Jobs: 2 Epoch: 1.09/4.0 (27.2% complete) lr: 0.001605
2020-10-16 08:51:24,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 227/831 Jobs: 2 Epoch: 1.09/4.0 (27.3% complete) lr: 0.001601
2020-10-16 08:52:21,446 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 228/831 Jobs: 2 Epoch: 1.10/4.0 (27.4% complete) lr: 0.001596
2020-10-16 08:53:17,924 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 229/831 Jobs: 2 Epoch: 1.10/4.0 (27.5% complete) lr: 0.001592
2020-10-16 08:54:14,897 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 230/831 Jobs: 2 Epoch: 1.11/4.0 (27.6% complete) lr: 0.001587
2020-10-16 08:55:11,366 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 231/831 Jobs: 2 Epoch: 1.11/4.0 (27.8% complete) lr: 0.001583
2020-10-16 08:56:07,149 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 232/831 Jobs: 2 Epoch: 1.12/4.0 (27.9% complete) lr: 0.001579
2020-10-16 08:57:04,018 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 233/831 Jobs: 2 Epoch: 1.12/4.0 (28.0% complete) lr: 0.001574
2020-10-16 08:58:00,415 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 234/831 Jobs: 2 Epoch: 1.12/4.0 (28.1% complete) lr: 0.001570
2020-10-16 08:58:56,684 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 235/831 Jobs: 2 Epoch: 1.13/4.0 (28.2% complete) lr: 0.001566
2020-10-16 08:59:53,848 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 236/831 Jobs: 2 Epoch: 1.13/4.0 (28.4% complete) lr: 0.001561
2020-10-16 09:00:50,493 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 237/831 Jobs: 2 Epoch: 1.14/4.0 (28.5% complete) lr: 0.001557
2020-10-16 09:01:46,721 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 238/831 Jobs: 2 Epoch: 1.14/4.0 (28.6% complete) lr: 0.001553
2020-10-16 09:02:43,753 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 239/831 Jobs: 2 Epoch: 1.15/4.0 (28.7% complete) lr: 0.001548
2020-10-16 09:03:40,654 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 240/831 Jobs: 2 Epoch: 1.15/4.0 (28.8% complete) lr: 0.001544
2020-10-16 09:04:41,366 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 241/831 Jobs: 2 Epoch: 1.16/4.0 (29.0% complete) lr: 0.001540
2020-10-16 09:05:38,218 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 242/831 Jobs: 2 Epoch: 1.16/4.0 (29.1% complete) lr: 0.001536
2020-10-16 09:06:33,913 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 243/831 Jobs: 2 Epoch: 1.17/4.0 (29.2% complete) lr: 0.001531
2020-10-16 09:07:30,664 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 244/831 Jobs: 2 Epoch: 1.17/4.0 (29.3% complete) lr: 0.001527
2020-10-16 09:08:27,552 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 245/831 Jobs: 2 Epoch: 1.18/4.0 (29.4% complete) lr: 0.001523
2020-10-16 09:09:23,965 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 246/831 Jobs: 2 Epoch: 1.18/4.0 (29.6% complete) lr: 0.001519
2020-10-16 09:10:20,869 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 247/831 Jobs: 2 Epoch: 1.19/4.0 (29.7% complete) lr: 0.001514
2020-10-16 09:11:18,105 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 248/831 Jobs: 2 Epoch: 1.19/4.0 (29.8% complete) lr: 0.001510
2020-10-16 09:12:14,995 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 249/831 Jobs: 2 Epoch: 1.20/4.0 (29.9% complete) lr: 0.001506
2020-10-16 09:13:11,937 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 250/831 Jobs: 2 Epoch: 1.20/4.0 (30.0% complete) lr: 0.001502
2020-10-16 09:14:08,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 251/831 Jobs: 2 Epoch: 1.21/4.0 (30.2% complete) lr: 0.001498
2020-10-16 09:15:05,640 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 252/831 Jobs: 2 Epoch: 1.21/4.0 (30.3% complete) lr: 0.001494
2020-10-16 09:16:02,719 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 253/831 Jobs: 2 Epoch: 1.22/4.0 (30.4% complete) lr: 0.001489
2020-10-16 09:16:58,624 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 254/831 Jobs: 2 Epoch: 1.22/4.0 (30.5% complete) lr: 0.001485
2020-10-16 09:17:54,267 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 255/831 Jobs: 2 Epoch: 1.23/4.0 (30.6% complete) lr: 0.001481
2020-10-16 09:18:51,227 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 256/831 Jobs: 2 Epoch: 1.23/4.0 (30.8% complete) lr: 0.001477
2020-10-16 09:19:46,711 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 257/831 Jobs: 2 Epoch: 1.24/4.0 (30.9% complete) lr: 0.001473
2020-10-16 09:20:43,773 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 258/831 Jobs: 2 Epoch: 1.24/4.0 (31.0% complete) lr: 0.001469
2020-10-16 09:21:40,296 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 259/831 Jobs: 2 Epoch: 1.25/4.0 (31.1% complete) lr: 0.001465
2020-10-16 09:22:37,292 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 260/831 Jobs: 2 Epoch: 1.25/4.0 (31.2% complete) lr: 0.001461
2020-10-16 09:23:37,715 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 261/831 Jobs: 2 Epoch: 1.25/4.0 (31.4% complete) lr: 0.001457
2020-10-16 09:24:34,835 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 262/831 Jobs: 2 Epoch: 1.26/4.0 (31.5% complete) lr: 0.001453
2020-10-16 09:25:31,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 263/831 Jobs: 2 Epoch: 1.26/4.0 (31.6% complete) lr: 0.001449
2020-10-16 09:26:28,554 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 264/831 Jobs: 2 Epoch: 1.27/4.0 (31.7% complete) lr: 0.001445
2020-10-16 09:27:24,142 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 265/831 Jobs: 2 Epoch: 1.27/4.0 (31.9% complete) lr: 0.001441
2020-10-16 09:28:20,928 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 266/831 Jobs: 2 Epoch: 1.28/4.0 (32.0% complete) lr: 0.001437
2020-10-16 09:29:17,932 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 267/831 Jobs: 2 Epoch: 1.28/4.0 (32.1% complete) lr: 0.001433
2020-10-16 09:30:13,322 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 268/831 Jobs: 2 Epoch: 1.29/4.0 (32.2% complete) lr: 0.001429
2020-10-16 09:31:10,302 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 269/831 Jobs: 2 Epoch: 1.29/4.0 (32.3% complete) lr: 0.001425
2020-10-16 09:32:07,299 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 270/831 Jobs: 2 Epoch: 1.30/4.0 (32.5% complete) lr: 0.001421
2020-10-16 09:33:03,655 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 271/831 Jobs: 2 Epoch: 1.30/4.0 (32.6% complete) lr: 0.001417
2020-10-16 09:34:00,166 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 272/831 Jobs: 2 Epoch: 1.31/4.0 (32.7% complete) lr: 0.001413
2020-10-16 09:34:55,757 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 273/831 Jobs: 2 Epoch: 1.31/4.0 (32.8% complete) lr: 0.001409
2020-10-16 09:35:52,654 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 274/831 Jobs: 2 Epoch: 1.32/4.0 (32.9% complete) lr: 0.001405
2020-10-16 09:36:49,567 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 275/831 Jobs: 2 Epoch: 1.32/4.0 (33.1% complete) lr: 0.001401
2020-10-16 09:37:46,360 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 276/831 Jobs: 2 Epoch: 1.33/4.0 (33.2% complete) lr: 0.001398
2020-10-16 09:38:42,792 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 277/831 Jobs: 2 Epoch: 1.33/4.0 (33.3% complete) lr: 0.001394
2020-10-16 09:39:39,794 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 278/831 Jobs: 2 Epoch: 1.34/4.0 (33.4% complete) lr: 0.001390
2020-10-16 09:40:36,890 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 279/831 Jobs: 2 Epoch: 1.34/4.0 (33.5% complete) lr: 0.001386
2020-10-16 09:41:33,997 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 280/831 Jobs: 2 Epoch: 1.35/4.0 (33.7% complete) lr: 0.001382
2020-10-16 09:42:34,178 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 281/831 Jobs: 2 Epoch: 1.35/4.0 (33.8% complete) lr: 0.001378
2020-10-16 09:43:30,012 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 282/831 Jobs: 2 Epoch: 1.36/4.0 (33.9% complete) lr: 0.001375
2020-10-16 09:44:27,119 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 283/831 Jobs: 2 Epoch: 1.36/4.0 (34.0% complete) lr: 0.001371
2020-10-16 09:45:24,317 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 284/831 Jobs: 2 Epoch: 1.37/4.0 (34.1% complete) lr: 0.001367
2020-10-16 09:46:21,084 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 285/831 Jobs: 2 Epoch: 1.37/4.0 (34.3% complete) lr: 0.001363
2020-10-16 09:47:18,258 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 286/831 Jobs: 2 Epoch: 1.38/4.0 (34.4% complete) lr: 0.001359
2020-10-16 09:48:15,520 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 287/831 Jobs: 2 Epoch: 1.38/4.0 (34.5% complete) lr: 0.001356
2020-10-16 09:49:12,072 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 288/831 Jobs: 2 Epoch: 1.38/4.0 (34.6% complete) lr: 0.001352
2020-10-16 09:50:08,791 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 289/831 Jobs: 2 Epoch: 1.39/4.0 (34.7% complete) lr: 0.001348
2020-10-16 09:51:05,337 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 290/831 Jobs: 2 Epoch: 1.39/4.0 (34.9% complete) lr: 0.001345
2020-10-16 09:52:02,085 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 291/831 Jobs: 2 Epoch: 1.40/4.0 (35.0% complete) lr: 0.001341
2020-10-16 09:52:58,763 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 292/831 Jobs: 2 Epoch: 1.40/4.0 (35.1% complete) lr: 0.001337
2020-10-16 09:53:55,650 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 293/831 Jobs: 2 Epoch: 1.41/4.0 (35.2% complete) lr: 0.001333
2020-10-16 09:54:52,793 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 294/831 Jobs: 2 Epoch: 1.41/4.0 (35.3% complete) lr: 0.001330
2020-10-16 09:55:48,447 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 295/831 Jobs: 2 Epoch: 1.42/4.0 (35.5% complete) lr: 0.001326
2020-10-16 09:56:44,940 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 296/831 Jobs: 2 Epoch: 1.42/4.0 (35.6% complete) lr: 0.001322
2020-10-16 09:57:41,652 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 297/831 Jobs: 2 Epoch: 1.43/4.0 (35.7% complete) lr: 0.001319
2020-10-16 09:58:38,846 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 298/831 Jobs: 2 Epoch: 1.43/4.0 (35.8% complete) lr: 0.001315
2020-10-16 09:59:34,592 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 299/831 Jobs: 2 Epoch: 1.44/4.0 (35.9% complete) lr: 0.001311
2020-10-16 10:00:30,934 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 300/831 Jobs: 2 Epoch: 1.44/4.0 (36.1% complete) lr: 0.001308
2020-10-16 10:01:30,294 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 301/831 Jobs: 2 Epoch: 1.45/4.0 (36.2% complete) lr: 0.001304
2020-10-16 10:02:27,482 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 302/831 Jobs: 2 Epoch: 1.45/4.0 (36.3% complete) lr: 0.001301
2020-10-16 10:03:24,374 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 303/831 Jobs: 2 Epoch: 1.46/4.0 (36.4% complete) lr: 0.001297
2020-10-16 10:04:21,280 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 304/831 Jobs: 2 Epoch: 1.46/4.0 (36.5% complete) lr: 0.001293
2020-10-16 10:05:18,432 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 305/831 Jobs: 2 Epoch: 1.47/4.0 (36.7% complete) lr: 0.001290
2020-10-16 10:06:15,454 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 306/831 Jobs: 2 Epoch: 1.47/4.0 (36.8% complete) lr: 0.001286
2020-10-16 10:07:11,122 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 307/831 Jobs: 2 Epoch: 1.48/4.0 (36.9% complete) lr: 0.001283
2020-10-16 10:08:07,920 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 308/831 Jobs: 2 Epoch: 1.48/4.0 (37.0% complete) lr: 0.001279
2020-10-16 10:09:05,035 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 309/831 Jobs: 2 Epoch: 1.49/4.0 (37.1% complete) lr: 0.001276
2020-10-16 10:10:01,969 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 310/831 Jobs: 2 Epoch: 1.49/4.0 (37.3% complete) lr: 0.001272
2020-10-16 10:10:58,861 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 311/831 Jobs: 2 Epoch: 1.50/4.0 (37.4% complete) lr: 0.001269
2020-10-16 10:11:56,126 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 312/831 Jobs: 2 Epoch: 1.50/4.0 (37.5% complete) lr: 0.001265
2020-10-16 10:12:53,586 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 313/831 Jobs: 2 Epoch: 1.50/4.0 (37.6% complete) lr: 0.001262
2020-10-16 10:13:49,578 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 314/831 Jobs: 2 Epoch: 1.51/4.0 (37.7% complete) lr: 0.001258
2020-10-16 10:14:45,907 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 315/831 Jobs: 2 Epoch: 1.51/4.0 (37.9% complete) lr: 0.001255
2020-10-16 10:15:41,433 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 316/831 Jobs: 2 Epoch: 1.52/4.0 (38.0% complete) lr: 0.001251
2020-10-16 10:16:38,152 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 317/831 Jobs: 2 Epoch: 1.52/4.0 (38.1% complete) lr: 0.001248
2020-10-16 10:17:34,384 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 318/831 Jobs: 2 Epoch: 1.53/4.0 (38.2% complete) lr: 0.001244
2020-10-16 10:18:30,540 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 319/831 Jobs: 2 Epoch: 1.53/4.0 (38.3% complete) lr: 0.001241
2020-10-16 10:19:27,566 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 320/831 Jobs: 2 Epoch: 1.54/4.0 (38.5% complete) lr: 0.001237
2020-10-16 10:20:27,466 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 321/831 Jobs: 2 Epoch: 1.54/4.0 (38.6% complete) lr: 0.001234
2020-10-16 10:21:24,528 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 322/831 Jobs: 2 Epoch: 1.55/4.0 (38.7% complete) lr: 0.001231
2020-10-16 10:22:21,011 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 323/831 Jobs: 2 Epoch: 1.55/4.0 (38.8% complete) lr: 0.001227
2020-10-16 10:23:17,930 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 324/831 Jobs: 2 Epoch: 1.56/4.0 (38.9% complete) lr: 0.001224
2020-10-16 10:24:13,756 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 325/831 Jobs: 2 Epoch: 1.56/4.0 (39.1% complete) lr: 0.001220
2020-10-16 10:25:10,797 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 326/831 Jobs: 2 Epoch: 1.57/4.0 (39.2% complete) lr: 0.001217
2020-10-16 10:26:07,374 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 327/831 Jobs: 2 Epoch: 1.57/4.0 (39.3% complete) lr: 0.001214
2020-10-16 10:27:04,151 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 328/831 Jobs: 2 Epoch: 1.58/4.0 (39.4% complete) lr: 0.001210
2020-10-16 10:28:00,351 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 329/831 Jobs: 2 Epoch: 1.58/4.0 (39.5% complete) lr: 0.001207
2020-10-16 10:28:57,609 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 330/831 Jobs: 2 Epoch: 1.59/4.0 (39.7% complete) lr: 0.001204
2020-10-16 10:29:54,316 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 331/831 Jobs: 2 Epoch: 1.59/4.0 (39.8% complete) lr: 0.001200
2020-10-16 10:30:51,420 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 332/831 Jobs: 2 Epoch: 1.60/4.0 (39.9% complete) lr: 0.001197
2020-10-16 10:31:48,106 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 333/831 Jobs: 2 Epoch: 1.60/4.0 (40.0% complete) lr: 0.001194
2020-10-16 10:32:43,872 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 334/831 Jobs: 2 Epoch: 1.61/4.0 (40.1% complete) lr: 0.001190
2020-10-16 10:33:39,934 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 335/831 Jobs: 2 Epoch: 1.61/4.0 (40.3% complete) lr: 0.001187
2020-10-16 10:34:35,789 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 336/831 Jobs: 2 Epoch: 1.62/4.0 (40.4% complete) lr: 0.001184
2020-10-16 10:35:31,899 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 337/831 Jobs: 2 Epoch: 1.62/4.0 (40.5% complete) lr: 0.001181
2020-10-16 10:36:28,908 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 338/831 Jobs: 2 Epoch: 1.62/4.0 (40.6% complete) lr: 0.001177
2020-10-16 10:37:26,208 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 339/831 Jobs: 2 Epoch: 1.63/4.0 (40.7% complete) lr: 0.001174
2020-10-16 10:38:23,262 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 340/831 Jobs: 2 Epoch: 1.63/4.0 (40.9% complete) lr: 0.001171
2020-10-16 10:39:22,127 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 341/831 Jobs: 2 Epoch: 1.64/4.0 (41.0% complete) lr: 0.001168
2020-10-16 10:40:17,575 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 342/831 Jobs: 2 Epoch: 1.64/4.0 (41.1% complete) lr: 0.001164
2020-10-16 10:41:14,120 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 343/831 Jobs: 2 Epoch: 1.65/4.0 (41.2% complete) lr: 0.001161
2020-10-16 10:42:10,874 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 344/831 Jobs: 2 Epoch: 1.65/4.0 (41.3% complete) lr: 0.001158
2020-10-16 10:43:07,542 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 345/831 Jobs: 2 Epoch: 1.66/4.0 (41.5% complete) lr: 0.001155
2020-10-16 10:44:04,050 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 346/831 Jobs: 2 Epoch: 1.66/4.0 (41.6% complete) lr: 0.001151
2020-10-16 10:45:00,920 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 347/831 Jobs: 2 Epoch: 1.67/4.0 (41.7% complete) lr: 0.001148
2020-10-16 10:45:57,777 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 348/831 Jobs: 2 Epoch: 1.67/4.0 (41.8% complete) lr: 0.001145
2020-10-16 10:46:54,660 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 349/831 Jobs: 2 Epoch: 1.68/4.0 (41.9% complete) lr: 0.001142
2020-10-16 10:47:51,001 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 350/831 Jobs: 2 Epoch: 1.68/4.0 (42.1% complete) lr: 0.001139
2020-10-16 10:48:48,133 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 351/831 Jobs: 2 Epoch: 1.69/4.0 (42.2% complete) lr: 0.001136
2020-10-16 10:49:44,548 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 352/831 Jobs: 2 Epoch: 1.69/4.0 (42.3% complete) lr: 0.001133
2020-10-16 10:50:41,083 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 353/831 Jobs: 2 Epoch: 1.70/4.0 (42.4% complete) lr: 0.001129
2020-10-16 10:51:37,841 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 354/831 Jobs: 2 Epoch: 1.70/4.0 (42.5% complete) lr: 0.001126
2020-10-16 10:52:34,554 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 355/831 Jobs: 2 Epoch: 1.71/4.0 (42.7% complete) lr: 0.001123
2020-10-16 10:53:31,984 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 356/831 Jobs: 2 Epoch: 1.71/4.0 (42.8% complete) lr: 0.001120
2020-10-16 10:54:29,225 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 357/831 Jobs: 2 Epoch: 1.72/4.0 (42.9% complete) lr: 0.001117
2020-10-16 10:55:26,362 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 358/831 Jobs: 2 Epoch: 1.72/4.0 (43.0% complete) lr: 0.001114
2020-10-16 10:56:22,538 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 359/831 Jobs: 2 Epoch: 1.73/4.0 (43.1% complete) lr: 0.001111
2020-10-16 10:57:19,737 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 360/831 Jobs: 2 Epoch: 1.73/4.0 (43.3% complete) lr: 0.001108
2020-10-16 10:58:20,124 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 361/831 Jobs: 2 Epoch: 1.74/4.0 (43.4% complete) lr: 0.001105
2020-10-16 10:59:16,713 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 362/831 Jobs: 2 Epoch: 1.74/4.0 (43.5% complete) lr: 0.001102
2020-10-16 11:00:13,804 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 363/831 Jobs: 2 Epoch: 1.75/4.0 (43.6% complete) lr: 0.001099
2020-10-16 11:01:11,276 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 364/831 Jobs: 2 Epoch: 1.75/4.0 (43.8% complete) lr: 0.001096
2020-10-16 11:02:08,074 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 365/831 Jobs: 2 Epoch: 1.75/4.0 (43.9% complete) lr: 0.001092
2020-10-16 11:03:04,589 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 366/831 Jobs: 2 Epoch: 1.76/4.0 (44.0% complete) lr: 0.001089
2020-10-16 11:04:01,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 367/831 Jobs: 2 Epoch: 1.76/4.0 (44.1% complete) lr: 0.001086
2020-10-16 11:04:58,398 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 368/831 Jobs: 2 Epoch: 1.77/4.0 (44.2% complete) lr: 0.001083
2020-10-16 11:05:55,327 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 369/831 Jobs: 2 Epoch: 1.77/4.0 (44.4% complete) lr: 0.001080
2020-10-16 11:06:52,016 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 370/831 Jobs: 2 Epoch: 1.78/4.0 (44.5% complete) lr: 0.001077
2020-10-16 11:07:48,841 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 371/831 Jobs: 2 Epoch: 1.78/4.0 (44.6% complete) lr: 0.001075
2020-10-16 11:08:44,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 372/831 Jobs: 2 Epoch: 1.79/4.0 (44.7% complete) lr: 0.001072
2020-10-16 11:09:41,874 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 373/831 Jobs: 2 Epoch: 1.79/4.0 (44.8% complete) lr: 0.001069
2020-10-16 11:10:38,930 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 374/831 Jobs: 2 Epoch: 1.80/4.0 (45.0% complete) lr: 0.001066
2020-10-16 11:11:35,270 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 375/831 Jobs: 2 Epoch: 1.80/4.0 (45.1% complete) lr: 0.001063
2020-10-16 11:12:31,700 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 376/831 Jobs: 2 Epoch: 1.81/4.0 (45.2% complete) lr: 0.001060
2020-10-16 11:13:28,236 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 377/831 Jobs: 2 Epoch: 1.81/4.0 (45.3% complete) lr: 0.001057
2020-10-16 11:14:25,220 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 378/831 Jobs: 2 Epoch: 1.82/4.0 (45.4% complete) lr: 0.001054
2020-10-16 11:15:21,868 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 379/831 Jobs: 2 Epoch: 1.82/4.0 (45.6% complete) lr: 0.001051
2020-10-16 11:16:18,597 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 380/831 Jobs: 2 Epoch: 1.83/4.0 (45.7% complete) lr: 0.001048
2020-10-16 11:17:19,002 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 381/831 Jobs: 2 Epoch: 1.83/4.0 (45.8% complete) lr: 0.001045
2020-10-16 11:18:15,188 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 382/831 Jobs: 2 Epoch: 1.84/4.0 (45.9% complete) lr: 0.001042
2020-10-16 11:19:12,112 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 383/831 Jobs: 2 Epoch: 1.84/4.0 (46.0% complete) lr: 0.001039
2020-10-16 11:20:08,909 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 384/831 Jobs: 2 Epoch: 1.85/4.0 (46.2% complete) lr: 0.001037
2020-10-16 11:21:05,836 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 385/831 Jobs: 2 Epoch: 1.85/4.0 (46.3% complete) lr: 0.001034
2020-10-16 11:22:02,689 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 386/831 Jobs: 2 Epoch: 1.86/4.0 (46.4% complete) lr: 0.001031
2020-10-16 11:22:59,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 387/831 Jobs: 2 Epoch: 1.86/4.0 (46.5% complete) lr: 0.001028
2020-10-16 11:23:57,033 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 388/831 Jobs: 2 Epoch: 1.87/4.0 (46.6% complete) lr: 0.001025
2020-10-16 11:24:53,978 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 389/831 Jobs: 2 Epoch: 1.87/4.0 (46.8% complete) lr: 0.001022
2020-10-16 11:25:50,935 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 390/831 Jobs: 2 Epoch: 1.88/4.0 (46.9% complete) lr: 0.001019
2020-10-16 11:26:47,757 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 391/831 Jobs: 2 Epoch: 1.88/4.0 (47.0% complete) lr: 0.001017
2020-10-16 11:27:44,585 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 392/831 Jobs: 2 Epoch: 1.88/4.0 (47.1% complete) lr: 0.001014
2020-10-16 11:28:41,084 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 393/831 Jobs: 2 Epoch: 1.89/4.0 (47.2% complete) lr: 0.001011
2020-10-16 11:29:37,620 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 394/831 Jobs: 2 Epoch: 1.89/4.0 (47.4% complete) lr: 0.001008
2020-10-16 11:30:34,768 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 395/831 Jobs: 2 Epoch: 1.90/4.0 (47.5% complete) lr: 0.001005
2020-10-16 11:31:31,861 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 396/831 Jobs: 2 Epoch: 1.90/4.0 (47.6% complete) lr: 0.001003
2020-10-16 11:32:28,715 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 397/831 Jobs: 2 Epoch: 1.91/4.0 (47.7% complete) lr: 0.001000
2020-10-16 11:33:25,778 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 398/831 Jobs: 2 Epoch: 1.91/4.0 (47.8% complete) lr: 0.000997
2020-10-16 11:34:22,489 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 399/831 Jobs: 2 Epoch: 1.92/4.0 (48.0% complete) lr: 0.000994
2020-10-16 11:35:19,053 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 400/831 Jobs: 2 Epoch: 1.92/4.0 (48.1% complete) lr: 0.000992
2020-10-16 11:36:18,786 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 401/831 Jobs: 2 Epoch: 1.93/4.0 (48.2% complete) lr: 0.000989
2020-10-16 11:37:15,010 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 402/831 Jobs: 2 Epoch: 1.93/4.0 (48.3% complete) lr: 0.000986
2020-10-16 11:38:11,747 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 403/831 Jobs: 2 Epoch: 1.94/4.0 (48.4% complete) lr: 0.000983
2020-10-16 11:39:08,767 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 404/831 Jobs: 2 Epoch: 1.94/4.0 (48.6% complete) lr: 0.000981
2020-10-16 11:40:04,876 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 405/831 Jobs: 2 Epoch: 1.95/4.0 (48.7% complete) lr: 0.000978
2020-10-16 11:41:01,751 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 406/831 Jobs: 2 Epoch: 1.95/4.0 (48.8% complete) lr: 0.000975
2020-10-16 11:41:57,281 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 407/831 Jobs: 2 Epoch: 1.96/4.0 (48.9% complete) lr: 0.000973
2020-10-16 11:42:54,256 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 408/831 Jobs: 2 Epoch: 1.96/4.0 (49.0% complete) lr: 0.000970
2020-10-16 11:43:51,163 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 409/831 Jobs: 2 Epoch: 1.97/4.0 (49.2% complete) lr: 0.000967
2020-10-16 11:44:48,519 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 410/831 Jobs: 2 Epoch: 1.97/4.0 (49.3% complete) lr: 0.000965
2020-10-16 11:45:44,831 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 411/831 Jobs: 2 Epoch: 1.98/4.0 (49.4% complete) lr: 0.000962
2020-10-16 11:46:42,022 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 412/831 Jobs: 2 Epoch: 1.98/4.0 (49.5% complete) lr: 0.000959
2020-10-16 11:47:39,254 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 413/831 Jobs: 2 Epoch: 1.99/4.0 (49.6% complete) lr: 0.000957
2020-10-16 11:48:36,331 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 414/831 Jobs: 2 Epoch: 1.99/4.0 (49.8% complete) lr: 0.000954
2020-10-16 11:49:33,070 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 415/831 Jobs: 2 Epoch: 2.00/4.0 (49.9% complete) lr: 0.000951
2020-10-16 11:50:29,540 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 416/831 Jobs: 2 Epoch: 2.00/4.0 (50.0% complete) lr: 0.000949
2020-10-16 11:51:25,581 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 417/831 Jobs: 2 Epoch: 2.00/4.0 (50.1% complete) lr: 0.000946
2020-10-16 11:52:22,647 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 418/831 Jobs: 2 Epoch: 2.01/4.0 (50.2% complete) lr: 0.000943
2020-10-16 11:53:18,608 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 419/831 Jobs: 2 Epoch: 2.01/4.0 (50.4% complete) lr: 0.000941
2020-10-16 11:54:16,255 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 420/831 Jobs: 2 Epoch: 2.02/4.0 (50.5% complete) lr: 0.000938
2020-10-16 11:55:16,259 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 421/831 Jobs: 2 Epoch: 2.02/4.0 (50.6% complete) lr: 0.000936
2020-10-16 11:56:12,896 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 422/831 Jobs: 2 Epoch: 2.03/4.0 (50.7% complete) lr: 0.000933
2020-10-16 11:57:08,569 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 423/831 Jobs: 2 Epoch: 2.03/4.0 (50.8% complete) lr: 0.000930
2020-10-16 11:58:05,275 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 424/831 Jobs: 2 Epoch: 2.04/4.0 (51.0% complete) lr: 0.000928
2020-10-16 11:59:01,967 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 425/831 Jobs: 2 Epoch: 2.04/4.0 (51.1% complete) lr: 0.000925
2020-10-16 11:59:58,631 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 426/831 Jobs: 2 Epoch: 2.05/4.0 (51.2% complete) lr: 0.000923
2020-10-16 12:01:49,839 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 427/831 Jobs: 2 Epoch: 2.05/4.0 (51.3% complete) lr: 0.000920
2020-10-16 12:03:25,353 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 428/831 Jobs: 2 Epoch: 2.06/4.0 (51.4% complete) lr: 0.000918
2020-10-16 12:05:22,590 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 429/831 Jobs: 2 Epoch: 2.06/4.0 (51.6% complete) lr: 0.000915
2020-10-16 12:06:32,957 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 430/831 Jobs: 2 Epoch: 2.07/4.0 (51.7% complete) lr: 0.000913
2020-10-16 12:07:48,371 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 431/831 Jobs: 2 Epoch: 2.07/4.0 (51.8% complete) lr: 0.000910
2020-10-16 12:09:35,715 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 432/831 Jobs: 2 Epoch: 2.08/4.0 (51.9% complete) lr: 0.000908
2020-10-16 12:10:44,365 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 433/831 Jobs: 2 Epoch: 2.08/4.0 (52.0% complete) lr: 0.000905
2020-10-16 12:11:51,891 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 434/831 Jobs: 2 Epoch: 2.09/4.0 (52.2% complete) lr: 0.000903
2020-10-16 12:13:03,540 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 435/831 Jobs: 2 Epoch: 2.09/4.0 (52.3% complete) lr: 0.000900
2020-10-16 12:14:13,574 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 436/831 Jobs: 2 Epoch: 2.10/4.0 (52.4% complete) lr: 0.000898
2020-10-16 12:15:28,828 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 437/831 Jobs: 2 Epoch: 2.10/4.0 (52.5% complete) lr: 0.000895
2020-10-16 12:16:37,078 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 438/831 Jobs: 2 Epoch: 2.11/4.0 (52.6% complete) lr: 0.000893
2020-10-16 12:17:49,496 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 439/831 Jobs: 2 Epoch: 2.11/4.0 (52.8% complete) lr: 0.000890
2020-10-16 12:19:29,751 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 440/831 Jobs: 2 Epoch: 2.12/4.0 (52.9% complete) lr: 0.000888
2020-10-16 12:20:46,211 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 441/831 Jobs: 2 Epoch: 2.12/4.0 (53.0% complete) lr: 0.000885
2020-10-16 12:22:00,352 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 442/831 Jobs: 2 Epoch: 2.12/4.0 (53.1% complete) lr: 0.000883
2020-10-16 12:23:08,371 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 443/831 Jobs: 2 Epoch: 2.13/4.0 (53.2% complete) lr: 0.000880
2020-10-16 12:24:20,244 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 444/831 Jobs: 2 Epoch: 2.13/4.0 (53.4% complete) lr: 0.000878
2020-10-16 12:25:30,762 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 445/831 Jobs: 2 Epoch: 2.14/4.0 (53.5% complete) lr: 0.000876
2020-10-16 12:26:38,798 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 446/831 Jobs: 2 Epoch: 2.14/4.0 (53.6% complete) lr: 0.000873
2020-10-16 12:27:52,730 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 447/831 Jobs: 2 Epoch: 2.15/4.0 (53.7% complete) lr: 0.000871
2020-10-16 12:29:02,385 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 448/831 Jobs: 2 Epoch: 2.15/4.0 (53.8% complete) lr: 0.000868
2020-10-16 12:30:15,261 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 449/831 Jobs: 2 Epoch: 2.16/4.0 (54.0% complete) lr: 0.000866
2020-10-16 12:31:22,602 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 450/831 Jobs: 2 Epoch: 2.16/4.0 (54.1% complete) lr: 0.000863
2020-10-16 12:32:38,314 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 451/831 Jobs: 2 Epoch: 2.17/4.0 (54.2% complete) lr: 0.000861
2020-10-16 12:33:45,787 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 452/831 Jobs: 2 Epoch: 2.17/4.0 (54.3% complete) lr: 0.000859
2020-10-16 12:34:52,036 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 453/831 Jobs: 2 Epoch: 2.18/4.0 (54.4% complete) lr: 0.000856
2020-10-16 12:35:49,170 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 454/831 Jobs: 2 Epoch: 2.18/4.0 (54.6% complete) lr: 0.000854
2020-10-16 12:36:45,916 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 455/831 Jobs: 2 Epoch: 2.19/4.0 (54.7% complete) lr: 0.000852
2020-10-16 12:37:42,369 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 456/831 Jobs: 2 Epoch: 2.19/4.0 (54.8% complete) lr: 0.000849
2020-10-16 12:38:39,567 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 457/831 Jobs: 2 Epoch: 2.20/4.0 (54.9% complete) lr: 0.000847
2020-10-16 12:39:36,398 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 458/831 Jobs: 2 Epoch: 2.20/4.0 (55.0% complete) lr: 0.000845
2020-10-16 12:40:32,821 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 459/831 Jobs: 2 Epoch: 2.21/4.0 (55.2% complete) lr: 0.000842
2020-10-16 12:41:29,570 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 460/831 Jobs: 2 Epoch: 2.21/4.0 (55.3% complete) lr: 0.000840
2020-10-16 12:42:29,103 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 461/831 Jobs: 2 Epoch: 2.22/4.0 (55.4% complete) lr: 0.000838
2020-10-16 12:43:25,873 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 462/831 Jobs: 2 Epoch: 2.22/4.0 (55.5% complete) lr: 0.000835
2020-10-16 12:44:22,301 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 463/831 Jobs: 2 Epoch: 2.23/4.0 (55.6% complete) lr: 0.000833
2020-10-16 12:45:18,879 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 464/831 Jobs: 2 Epoch: 2.23/4.0 (55.8% complete) lr: 0.000831
2020-10-16 12:46:15,694 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 465/831 Jobs: 2 Epoch: 2.24/4.0 (55.9% complete) lr: 0.000828
2020-10-16 12:47:13,053 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 466/831 Jobs: 2 Epoch: 2.24/4.0 (56.0% complete) lr: 0.000826
2020-10-16 12:48:09,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 467/831 Jobs: 2 Epoch: 2.25/4.0 (56.1% complete) lr: 0.000824
2020-10-16 12:49:06,197 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 468/831 Jobs: 2 Epoch: 2.25/4.0 (56.2% complete) lr: 0.000822
2020-10-16 12:50:02,878 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 469/831 Jobs: 2 Epoch: 2.25/4.0 (56.4% complete) lr: 0.000819
2020-10-16 12:50:59,627 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 470/831 Jobs: 2 Epoch: 2.26/4.0 (56.5% complete) lr: 0.000817
2020-10-16 12:51:56,654 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 471/831 Jobs: 2 Epoch: 2.26/4.0 (56.6% complete) lr: 0.000815
2020-10-16 12:52:53,445 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 472/831 Jobs: 2 Epoch: 2.27/4.0 (56.7% complete) lr: 0.000812
2020-10-16 12:53:50,192 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 473/831 Jobs: 2 Epoch: 2.27/4.0 (56.9% complete) lr: 0.000810
2020-10-16 12:54:47,267 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 474/831 Jobs: 2 Epoch: 2.28/4.0 (57.0% complete) lr: 0.000808
2020-10-16 12:55:43,954 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 475/831 Jobs: 2 Epoch: 2.28/4.0 (57.1% complete) lr: 0.000806
2020-10-16 12:56:41,101 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 476/831 Jobs: 2 Epoch: 2.29/4.0 (57.2% complete) lr: 0.000804
2020-10-16 12:57:37,343 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 477/831 Jobs: 2 Epoch: 2.29/4.0 (57.3% complete) lr: 0.000801
2020-10-16 12:58:33,491 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 478/831 Jobs: 2 Epoch: 2.30/4.0 (57.5% complete) lr: 0.000799
2020-10-16 12:59:30,373 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 479/831 Jobs: 2 Epoch: 2.30/4.0 (57.6% complete) lr: 0.000797
2020-10-16 13:00:27,404 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 480/831 Jobs: 2 Epoch: 2.31/4.0 (57.7% complete) lr: 0.000795
2020-10-16 13:01:27,872 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 481/831 Jobs: 2 Epoch: 2.31/4.0 (57.8% complete) lr: 0.000792
2020-10-16 13:02:24,477 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 482/831 Jobs: 2 Epoch: 2.32/4.0 (57.9% complete) lr: 0.000790
2020-10-16 13:03:20,990 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 483/831 Jobs: 2 Epoch: 2.32/4.0 (58.1% complete) lr: 0.000788
2020-10-16 13:04:17,844 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 484/831 Jobs: 2 Epoch: 2.33/4.0 (58.2% complete) lr: 0.000786
2020-10-16 13:05:14,356 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 485/831 Jobs: 2 Epoch: 2.33/4.0 (58.3% complete) lr: 0.000784
2020-10-16 13:06:11,048 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 486/831 Jobs: 2 Epoch: 2.34/4.0 (58.4% complete) lr: 0.000782
2020-10-16 13:07:07,829 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 487/831 Jobs: 2 Epoch: 2.34/4.0 (58.5% complete) lr: 0.000779
2020-10-16 13:08:04,085 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 488/831 Jobs: 2 Epoch: 2.35/4.0 (58.7% complete) lr: 0.000777
2020-10-16 13:09:00,880 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 489/831 Jobs: 2 Epoch: 2.35/4.0 (58.8% complete) lr: 0.000775
2020-10-16 13:09:57,801 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 490/831 Jobs: 2 Epoch: 2.36/4.0 (58.9% complete) lr: 0.000773
2020-10-16 13:10:54,779 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 491/831 Jobs: 2 Epoch: 2.36/4.0 (59.0% complete) lr: 0.000771
2020-10-16 13:11:51,819 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 492/831 Jobs: 2 Epoch: 2.37/4.0 (59.1% complete) lr: 0.000769
2020-10-16 13:12:48,789 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 493/831 Jobs: 2 Epoch: 2.37/4.0 (59.3% complete) lr: 0.000767
2020-10-16 13:13:45,801 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 494/831 Jobs: 2 Epoch: 2.38/4.0 (59.4% complete) lr: 0.000764
2020-10-16 13:14:43,203 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 495/831 Jobs: 2 Epoch: 2.38/4.0 (59.5% complete) lr: 0.000762
2020-10-16 13:15:40,369 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 496/831 Jobs: 2 Epoch: 2.38/4.0 (59.6% complete) lr: 0.000760
2020-10-16 13:16:37,602 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 497/831 Jobs: 2 Epoch: 2.39/4.0 (59.7% complete) lr: 0.000758
2020-10-16 13:17:34,618 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 498/831 Jobs: 2 Epoch: 2.39/4.0 (59.9% complete) lr: 0.000756
2020-10-16 13:18:31,468 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 499/831 Jobs: 2 Epoch: 2.40/4.0 (60.0% complete) lr: 0.000754
2020-10-16 13:19:28,505 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 500/831 Jobs: 2 Epoch: 2.40/4.0 (60.1% complete) lr: 0.000752
2020-10-16 13:20:28,313 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 501/831 Jobs: 2 Epoch: 2.41/4.0 (60.2% complete) lr: 0.000750
2020-10-16 13:21:25,020 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 502/831 Jobs: 2 Epoch: 2.41/4.0 (60.3% complete) lr: 0.000748
2020-10-16 13:22:22,033 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 503/831 Jobs: 2 Epoch: 2.42/4.0 (60.5% complete) lr: 0.000746
2020-10-16 13:23:18,631 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 504/831 Jobs: 2 Epoch: 2.42/4.0 (60.6% complete) lr: 0.000744
2020-10-16 13:24:15,517 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 505/831 Jobs: 2 Epoch: 2.43/4.0 (60.7% complete) lr: 0.000742
2020-10-16 13:25:12,522 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 506/831 Jobs: 2 Epoch: 2.43/4.0 (60.8% complete) lr: 0.000740
2020-10-16 13:26:08,790 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 507/831 Jobs: 2 Epoch: 2.44/4.0 (60.9% complete) lr: 0.000737
2020-10-16 13:27:05,859 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 508/831 Jobs: 2 Epoch: 2.44/4.0 (61.1% complete) lr: 0.000735
2020-10-16 13:28:02,259 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 509/831 Jobs: 2 Epoch: 2.45/4.0 (61.2% complete) lr: 0.000733
2020-10-16 13:28:59,103 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 510/831 Jobs: 2 Epoch: 2.45/4.0 (61.3% complete) lr: 0.000731
2020-10-16 13:29:55,701 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 511/831 Jobs: 2 Epoch: 2.46/4.0 (61.4% complete) lr: 0.000729
2020-10-16 13:30:52,632 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 512/831 Jobs: 2 Epoch: 2.46/4.0 (61.5% complete) lr: 0.000727
2020-10-16 13:31:49,571 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 513/831 Jobs: 2 Epoch: 2.47/4.0 (61.7% complete) lr: 0.000725
2020-10-16 13:32:45,470 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 514/831 Jobs: 2 Epoch: 2.47/4.0 (61.8% complete) lr: 0.000723
2020-10-16 13:33:41,925 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 515/831 Jobs: 2 Epoch: 2.48/4.0 (61.9% complete) lr: 0.000721
2020-10-16 13:34:38,804 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 516/831 Jobs: 2 Epoch: 2.48/4.0 (62.0% complete) lr: 0.000719
2020-10-16 13:35:35,045 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 517/831 Jobs: 2 Epoch: 2.49/4.0 (62.1% complete) lr: 0.000717
2020-10-16 13:36:31,940 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 518/831 Jobs: 2 Epoch: 2.49/4.0 (62.3% complete) lr: 0.000715
2020-10-16 13:37:28,911 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 519/831 Jobs: 2 Epoch: 2.50/4.0 (62.4% complete) lr: 0.000713
2020-10-16 13:38:26,036 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 520/831 Jobs: 2 Epoch: 2.50/4.0 (62.5% complete) lr: 0.000711
2020-10-16 13:39:26,120 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 521/831 Jobs: 2 Epoch: 2.50/4.0 (62.6% complete) lr: 0.000709
2020-10-16 13:40:23,011 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 522/831 Jobs: 2 Epoch: 2.51/4.0 (62.7% complete) lr: 0.000707
2020-10-16 13:41:19,922 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 523/831 Jobs: 2 Epoch: 2.51/4.0 (62.9% complete) lr: 0.000706
2020-10-16 13:42:16,481 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 524/831 Jobs: 2 Epoch: 2.52/4.0 (63.0% complete) lr: 0.000704
2020-10-16 13:43:13,423 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 525/831 Jobs: 2 Epoch: 2.52/4.0 (63.1% complete) lr: 0.000702
2020-10-16 13:44:10,377 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 526/831 Jobs: 2 Epoch: 2.53/4.0 (63.2% complete) lr: 0.000700
2020-10-16 13:45:07,408 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 527/831 Jobs: 2 Epoch: 2.53/4.0 (63.3% complete) lr: 0.000698
2020-10-16 13:46:04,139 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 528/831 Jobs: 2 Epoch: 2.54/4.0 (63.5% complete) lr: 0.000696
2020-10-16 13:47:00,381 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 529/831 Jobs: 2 Epoch: 2.54/4.0 (63.6% complete) lr: 0.000694
2020-10-16 13:47:57,103 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 530/831 Jobs: 2 Epoch: 2.55/4.0 (63.7% complete) lr: 0.000692
2020-10-16 13:48:53,865 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 531/831 Jobs: 2 Epoch: 2.55/4.0 (63.8% complete) lr: 0.000690
2020-10-16 13:49:51,062 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 532/831 Jobs: 2 Epoch: 2.56/4.0 (63.9% complete) lr: 0.000688
2020-10-16 13:50:47,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 533/831 Jobs: 2 Epoch: 2.56/4.0 (64.1% complete) lr: 0.000686
2020-10-16 13:51:44,929 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 534/831 Jobs: 2 Epoch: 2.57/4.0 (64.2% complete) lr: 0.000684
2020-10-16 13:52:41,567 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 535/831 Jobs: 2 Epoch: 2.57/4.0 (64.3% complete) lr: 0.000682
2020-10-16 13:53:38,197 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 536/831 Jobs: 2 Epoch: 2.58/4.0 (64.4% complete) lr: 0.000681
2020-10-16 13:54:34,789 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 537/831 Jobs: 2 Epoch: 2.58/4.0 (64.5% complete) lr: 0.000679
2020-10-16 13:55:31,849 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 538/831 Jobs: 2 Epoch: 2.59/4.0 (64.7% complete) lr: 0.000677
2020-10-16 13:56:28,909 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 539/831 Jobs: 2 Epoch: 2.59/4.0 (64.8% complete) lr: 0.000675
2020-10-16 13:57:25,845 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 540/831 Jobs: 2 Epoch: 2.60/4.0 (64.9% complete) lr: 0.000673
2020-10-16 13:58:25,374 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 541/831 Jobs: 2 Epoch: 2.60/4.0 (65.0% complete) lr: 0.000671
2020-10-16 13:59:22,348 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 542/831 Jobs: 2 Epoch: 2.61/4.0 (65.1% complete) lr: 0.000669
2020-10-16 14:00:18,686 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 543/831 Jobs: 2 Epoch: 2.61/4.0 (65.3% complete) lr: 0.000668
2020-10-16 14:01:15,758 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 544/831 Jobs: 2 Epoch: 2.62/4.0 (65.4% complete) lr: 0.000666
2020-10-16 14:02:12,344 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 545/831 Jobs: 2 Epoch: 2.62/4.0 (65.5% complete) lr: 0.000664
2020-10-16 14:03:09,431 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 546/831 Jobs: 2 Epoch: 2.62/4.0 (65.6% complete) lr: 0.000662
2020-10-16 14:04:06,048 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 547/831 Jobs: 2 Epoch: 2.63/4.0 (65.7% complete) lr: 0.000660
2020-10-16 14:05:02,865 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 548/831 Jobs: 2 Epoch: 2.63/4.0 (65.9% complete) lr: 0.000658
2020-10-16 14:05:58,504 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 549/831 Jobs: 2 Epoch: 2.64/4.0 (66.0% complete) lr: 0.000657
2020-10-16 14:06:55,278 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 550/831 Jobs: 2 Epoch: 2.64/4.0 (66.1% complete) lr: 0.000655
2020-10-16 14:07:52,122 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 551/831 Jobs: 2 Epoch: 2.65/4.0 (66.2% complete) lr: 0.000653
2020-10-16 14:08:48,965 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 552/831 Jobs: 2 Epoch: 2.65/4.0 (66.3% complete) lr: 0.000651
2020-10-16 14:09:45,680 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 553/831 Jobs: 2 Epoch: 2.66/4.0 (66.5% complete) lr: 0.000649
2020-10-16 14:10:42,745 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 554/831 Jobs: 2 Epoch: 2.66/4.0 (66.6% complete) lr: 0.000648
2020-10-16 14:11:39,681 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 555/831 Jobs: 2 Epoch: 2.67/4.0 (66.7% complete) lr: 0.000646
2020-10-16 14:12:36,887 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 556/831 Jobs: 2 Epoch: 2.67/4.0 (66.8% complete) lr: 0.000644
2020-10-16 14:13:33,956 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 557/831 Jobs: 2 Epoch: 2.68/4.0 (66.9% complete) lr: 0.000642
2020-10-16 14:14:30,131 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 558/831 Jobs: 2 Epoch: 2.68/4.0 (67.1% complete) lr: 0.000640
2020-10-16 14:15:27,176 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 559/831 Jobs: 2 Epoch: 2.69/4.0 (67.2% complete) lr: 0.000639
2020-10-16 14:16:23,323 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 560/831 Jobs: 2 Epoch: 2.69/4.0 (67.3% complete) lr: 0.000637
2020-10-16 14:17:22,524 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 561/831 Jobs: 2 Epoch: 2.70/4.0 (67.4% complete) lr: 0.000635
2020-10-16 14:18:19,310 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 562/831 Jobs: 2 Epoch: 2.70/4.0 (67.5% complete) lr: 0.000633
2020-10-16 14:19:16,046 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 563/831 Jobs: 2 Epoch: 2.71/4.0 (67.7% complete) lr: 0.000632
2020-10-16 14:20:12,946 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 564/831 Jobs: 2 Epoch: 2.71/4.0 (67.8% complete) lr: 0.000630
2020-10-16 14:21:10,396 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 565/831 Jobs: 2 Epoch: 2.72/4.0 (67.9% complete) lr: 0.000628
2020-10-16 14:22:06,850 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 566/831 Jobs: 2 Epoch: 2.72/4.0 (68.0% complete) lr: 0.000626
2020-10-16 14:23:03,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 567/831 Jobs: 2 Epoch: 2.73/4.0 (68.1% complete) lr: 0.000625
2020-10-16 14:23:59,514 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 568/831 Jobs: 2 Epoch: 2.73/4.0 (68.3% complete) lr: 0.000623
2020-10-16 14:24:55,863 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 569/831 Jobs: 2 Epoch: 2.74/4.0 (68.4% complete) lr: 0.000621
2020-10-16 14:25:52,410 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 570/831 Jobs: 2 Epoch: 2.74/4.0 (68.5% complete) lr: 0.000619
2020-10-16 14:26:48,052 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 571/831 Jobs: 2 Epoch: 2.75/4.0 (68.6% complete) lr: 0.000618
2020-10-16 14:27:45,040 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 572/831 Jobs: 2 Epoch: 2.75/4.0 (68.8% complete) lr: 0.000616
2020-10-16 14:28:41,390 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 573/831 Jobs: 2 Epoch: 2.75/4.0 (68.9% complete) lr: 0.000614
2020-10-16 14:29:38,280 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 574/831 Jobs: 2 Epoch: 2.76/4.0 (69.0% complete) lr: 0.000613
2020-10-16 14:30:35,089 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 575/831 Jobs: 2 Epoch: 2.76/4.0 (69.1% complete) lr: 0.000611
2020-10-16 14:31:32,016 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 576/831 Jobs: 2 Epoch: 2.77/4.0 (69.2% complete) lr: 0.000609
2020-10-16 14:32:28,956 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 577/831 Jobs: 2 Epoch: 2.77/4.0 (69.4% complete) lr: 0.000608
2020-10-16 14:33:25,762 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 578/831 Jobs: 2 Epoch: 2.78/4.0 (69.5% complete) lr: 0.000606
2020-10-16 14:34:22,933 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 579/831 Jobs: 2 Epoch: 2.78/4.0 (69.6% complete) lr: 0.000604
2020-10-16 14:35:19,811 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 580/831 Jobs: 2 Epoch: 2.79/4.0 (69.7% complete) lr: 0.000603
2020-10-16 14:36:19,703 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 581/831 Jobs: 2 Epoch: 2.79/4.0 (69.8% complete) lr: 0.000601
2020-10-16 14:37:16,897 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 582/831 Jobs: 2 Epoch: 2.80/4.0 (70.0% complete) lr: 0.000599
2020-10-16 14:38:13,402 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 583/831 Jobs: 2 Epoch: 2.80/4.0 (70.1% complete) lr: 0.000598
2020-10-16 14:39:10,318 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 584/831 Jobs: 2 Epoch: 2.81/4.0 (70.2% complete) lr: 0.000596
2020-10-16 14:40:07,084 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 585/831 Jobs: 2 Epoch: 2.81/4.0 (70.3% complete) lr: 0.000594
2020-10-16 14:41:03,864 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 586/831 Jobs: 2 Epoch: 2.82/4.0 (70.4% complete) lr: 0.000593
2020-10-16 14:42:00,540 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 587/831 Jobs: 2 Epoch: 2.82/4.0 (70.6% complete) lr: 0.000591
2020-10-16 14:42:57,640 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 588/831 Jobs: 2 Epoch: 2.83/4.0 (70.7% complete) lr: 0.000589
2020-10-16 14:43:54,188 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 589/831 Jobs: 2 Epoch: 2.83/4.0 (70.8% complete) lr: 0.000588
2020-10-16 14:44:51,277 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 590/831 Jobs: 2 Epoch: 2.84/4.0 (70.9% complete) lr: 0.000586
2020-10-16 14:45:48,297 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 591/831 Jobs: 2 Epoch: 2.84/4.0 (71.0% complete) lr: 0.000585
2020-10-16 14:46:44,596 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 592/831 Jobs: 2 Epoch: 2.85/4.0 (71.2% complete) lr: 0.000583
2020-10-16 14:47:40,032 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 593/831 Jobs: 2 Epoch: 2.85/4.0 (71.3% complete) lr: 0.000581
2020-10-16 14:48:36,571 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 594/831 Jobs: 2 Epoch: 2.86/4.0 (71.4% complete) lr: 0.000580
2020-10-16 14:49:33,790 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 595/831 Jobs: 2 Epoch: 2.86/4.0 (71.5% complete) lr: 0.000578
2020-10-16 14:50:30,705 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 596/831 Jobs: 2 Epoch: 2.87/4.0 (71.6% complete) lr: 0.000576
2020-10-16 14:51:27,635 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 597/831 Jobs: 2 Epoch: 2.87/4.0 (71.8% complete) lr: 0.000575
2020-10-16 14:52:24,589 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 598/831 Jobs: 2 Epoch: 2.88/4.0 (71.9% complete) lr: 0.000573
2020-10-16 14:53:21,448 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 599/831 Jobs: 2 Epoch: 2.88/4.0 (72.0% complete) lr: 0.000572
2020-10-16 14:54:18,385 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 600/831 Jobs: 2 Epoch: 2.88/4.0 (72.1% complete) lr: 0.000570
2020-10-16 14:55:18,552 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 601/831 Jobs: 2 Epoch: 2.89/4.0 (72.2% complete) lr: 0.000569
2020-10-16 14:56:15,329 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 602/831 Jobs: 2 Epoch: 2.89/4.0 (72.4% complete) lr: 0.000567
2020-10-16 14:57:11,266 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 603/831 Jobs: 2 Epoch: 2.90/4.0 (72.5% complete) lr: 0.000565
2020-10-16 14:58:07,962 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 604/831 Jobs: 2 Epoch: 2.90/4.0 (72.6% complete) lr: 0.000564
2020-10-16 14:59:04,947 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 605/831 Jobs: 2 Epoch: 2.91/4.0 (72.7% complete) lr: 0.000562
2020-10-16 15:00:01,936 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 606/831 Jobs: 2 Epoch: 2.91/4.0 (72.8% complete) lr: 0.000561
2020-10-16 15:00:58,001 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 607/831 Jobs: 2 Epoch: 2.92/4.0 (73.0% complete) lr: 0.000559
2020-10-16 15:01:54,128 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 608/831 Jobs: 2 Epoch: 2.92/4.0 (73.1% complete) lr: 0.000558
2020-10-16 15:02:51,503 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 609/831 Jobs: 2 Epoch: 2.93/4.0 (73.2% complete) lr: 0.000556
2020-10-16 15:03:48,355 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 610/831 Jobs: 2 Epoch: 2.93/4.0 (73.3% complete) lr: 0.000555
2020-10-16 15:04:45,479 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 611/831 Jobs: 2 Epoch: 2.94/4.0 (73.4% complete) lr: 0.000553
2020-10-16 15:05:42,341 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 612/831 Jobs: 2 Epoch: 2.94/4.0 (73.6% complete) lr: 0.000551
2020-10-16 15:06:39,192 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 613/831 Jobs: 2 Epoch: 2.95/4.0 (73.7% complete) lr: 0.000550
2020-10-16 15:07:36,148 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 614/831 Jobs: 2 Epoch: 2.95/4.0 (73.8% complete) lr: 0.000548
2020-10-16 15:08:32,767 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 615/831 Jobs: 2 Epoch: 2.96/4.0 (73.9% complete) lr: 0.000547
2020-10-16 15:09:29,876 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 616/831 Jobs: 2 Epoch: 2.96/4.0 (74.0% complete) lr: 0.000545
2020-10-16 15:10:26,966 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 617/831 Jobs: 2 Epoch: 2.97/4.0 (74.2% complete) lr: 0.000544
2020-10-16 15:11:23,695 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 618/831 Jobs: 2 Epoch: 2.97/4.0 (74.3% complete) lr: 0.000542
2020-10-16 15:12:20,597 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 619/831 Jobs: 2 Epoch: 2.98/4.0 (74.4% complete) lr: 0.000541
2020-10-16 15:13:16,962 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 620/831 Jobs: 2 Epoch: 2.98/4.0 (74.5% complete) lr: 0.000539
2020-10-16 15:14:16,986 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 621/831 Jobs: 2 Epoch: 2.99/4.0 (74.6% complete) lr: 0.000538
2020-10-16 15:15:13,552 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 622/831 Jobs: 2 Epoch: 2.99/4.0 (74.8% complete) lr: 0.000536
2020-10-16 15:16:10,209 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 623/831 Jobs: 2 Epoch: 3.00/4.0 (74.9% complete) lr: 0.000535
2020-10-16 15:17:07,284 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 624/831 Jobs: 2 Epoch: 3.00/4.0 (75.0% complete) lr: 0.000533
2020-10-16 15:18:03,534 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 625/831 Jobs: 2 Epoch: 3.00/4.0 (75.1% complete) lr: 0.000532
2020-10-16 15:18:59,997 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 626/831 Jobs: 2 Epoch: 3.01/4.0 (75.2% complete) lr: 0.000531
2020-10-16 15:19:56,462 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 627/831 Jobs: 2 Epoch: 3.01/4.0 (75.4% complete) lr: 0.000529
2020-10-16 15:20:53,265 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 628/831 Jobs: 2 Epoch: 3.02/4.0 (75.5% complete) lr: 0.000528
2020-10-16 15:21:50,295 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 629/831 Jobs: 2 Epoch: 3.02/4.0 (75.6% complete) lr: 0.000526
2020-10-16 15:22:46,865 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 630/831 Jobs: 2 Epoch: 3.03/4.0 (75.7% complete) lr: 0.000525
2020-10-16 15:23:42,588 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 631/831 Jobs: 2 Epoch: 3.03/4.0 (75.8% complete) lr: 0.000523
2020-10-16 15:24:39,546 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 632/831 Jobs: 2 Epoch: 3.04/4.0 (76.0% complete) lr: 0.000522
2020-10-16 15:25:36,639 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 633/831 Jobs: 2 Epoch: 3.04/4.0 (76.1% complete) lr: 0.000520
2020-10-16 15:26:33,575 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 634/831 Jobs: 2 Epoch: 3.05/4.0 (76.2% complete) lr: 0.000519
2020-10-16 15:27:29,902 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 635/831 Jobs: 2 Epoch: 3.05/4.0 (76.3% complete) lr: 0.000517
2020-10-16 15:28:25,460 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 636/831 Jobs: 2 Epoch: 3.06/4.0 (76.4% complete) lr: 0.000516
2020-10-16 15:29:22,035 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 637/831 Jobs: 2 Epoch: 3.06/4.0 (76.6% complete) lr: 0.000515
2020-10-16 15:30:18,787 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 638/831 Jobs: 2 Epoch: 3.07/4.0 (76.7% complete) lr: 0.000513
2020-10-16 15:31:14,832 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 639/831 Jobs: 2 Epoch: 3.07/4.0 (76.8% complete) lr: 0.000512
2020-10-16 15:32:11,469 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 640/831 Jobs: 2 Epoch: 3.08/4.0 (76.9% complete) lr: 0.000510
2020-10-16 15:33:11,912 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 641/831 Jobs: 2 Epoch: 3.08/4.0 (77.0% complete) lr: 0.000509
2020-10-16 15:34:08,403 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 642/831 Jobs: 2 Epoch: 3.09/4.0 (77.2% complete) lr: 0.000508
2020-10-16 15:35:05,313 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 643/831 Jobs: 2 Epoch: 3.09/4.0 (77.3% complete) lr: 0.000506
2020-10-16 15:36:01,974 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 644/831 Jobs: 2 Epoch: 3.10/4.0 (77.4% complete) lr: 0.000505
2020-10-16 15:36:58,150 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 645/831 Jobs: 2 Epoch: 3.10/4.0 (77.5% complete) lr: 0.000503
2020-10-16 15:37:54,972 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 646/831 Jobs: 2 Epoch: 3.11/4.0 (77.6% complete) lr: 0.000502
2020-10-16 15:38:52,107 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 647/831 Jobs: 2 Epoch: 3.11/4.0 (77.8% complete) lr: 0.000501
2020-10-16 15:39:48,890 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 648/831 Jobs: 2 Epoch: 3.12/4.0 (77.9% complete) lr: 0.000499
2020-10-16 15:40:45,636 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 649/831 Jobs: 2 Epoch: 3.12/4.0 (78.0% complete) lr: 0.000498
2020-10-16 15:41:42,811 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 650/831 Jobs: 2 Epoch: 3.12/4.0 (78.1% complete) lr: 0.000496
2020-10-16 15:42:39,694 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 651/831 Jobs: 2 Epoch: 3.13/4.0 (78.2% complete) lr: 0.000495
2020-10-16 15:43:37,268 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 652/831 Jobs: 2 Epoch: 3.13/4.0 (78.4% complete) lr: 0.000494
2020-10-16 15:44:33,918 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 653/831 Jobs: 2 Epoch: 3.14/4.0 (78.5% complete) lr: 0.000492
2020-10-16 15:45:30,611 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 654/831 Jobs: 2 Epoch: 3.14/4.0 (78.6% complete) lr: 0.000491
2020-10-16 15:46:26,963 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 655/831 Jobs: 2 Epoch: 3.15/4.0 (78.7% complete) lr: 0.000490
2020-10-16 15:47:23,700 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 656/831 Jobs: 2 Epoch: 3.15/4.0 (78.8% complete) lr: 0.000488
2020-10-16 15:48:20,494 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 657/831 Jobs: 2 Epoch: 3.16/4.0 (79.0% complete) lr: 0.000487
2020-10-16 15:49:17,046 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 658/831 Jobs: 2 Epoch: 3.16/4.0 (79.1% complete) lr: 0.000486
2020-10-16 15:50:13,285 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 659/831 Jobs: 2 Epoch: 3.17/4.0 (79.2% complete) lr: 0.000484
2020-10-16 15:51:10,339 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 660/831 Jobs: 2 Epoch: 3.17/4.0 (79.3% complete) lr: 0.000483
2020-10-16 15:52:09,684 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 661/831 Jobs: 2 Epoch: 3.18/4.0 (79.4% complete) lr: 0.000482
2020-10-16 15:53:06,972 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 662/831 Jobs: 2 Epoch: 3.18/4.0 (79.6% complete) lr: 0.000480
2020-10-16 15:54:03,944 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 663/831 Jobs: 2 Epoch: 3.19/4.0 (79.7% complete) lr: 0.000479
2020-10-16 15:55:01,101 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 664/831 Jobs: 2 Epoch: 3.19/4.0 (79.8% complete) lr: 0.000478
2020-10-16 15:55:58,231 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 665/831 Jobs: 2 Epoch: 3.20/4.0 (79.9% complete) lr: 0.000476
2020-10-16 15:56:55,253 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 666/831 Jobs: 2 Epoch: 3.20/4.0 (80.0% complete) lr: 0.000475
2020-10-16 15:57:52,403 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 667/831 Jobs: 2 Epoch: 3.21/4.0 (80.2% complete) lr: 0.000474
2020-10-16 15:58:49,464 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 668/831 Jobs: 2 Epoch: 3.21/4.0 (80.3% complete) lr: 0.000472
2020-10-16 15:59:45,994 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 669/831 Jobs: 2 Epoch: 3.22/4.0 (80.4% complete) lr: 0.000471
2020-10-16 16:01:24,119 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 670/831 Jobs: 2 Epoch: 3.22/4.0 (80.5% complete) lr: 0.000470
2020-10-16 16:03:17,174 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 671/831 Jobs: 2 Epoch: 3.23/4.0 (80.6% complete) lr: 0.000468
2020-10-16 16:04:58,695 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 672/831 Jobs: 2 Epoch: 3.23/4.0 (80.8% complete) lr: 0.000467
2020-10-16 16:06:27,010 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 673/831 Jobs: 2 Epoch: 3.24/4.0 (80.9% complete) lr: 0.000466
2020-10-16 16:07:34,813 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 674/831 Jobs: 2 Epoch: 3.24/4.0 (81.0% complete) lr: 0.000465
2020-10-16 16:08:49,756 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 675/831 Jobs: 2 Epoch: 3.25/4.0 (81.1% complete) lr: 0.000463
2020-10-16 16:09:56,772 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 676/831 Jobs: 2 Epoch: 3.25/4.0 (81.2% complete) lr: 0.000462
2020-10-16 16:11:05,481 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 677/831 Jobs: 2 Epoch: 3.25/4.0 (81.4% complete) lr: 0.000461
2020-10-16 16:12:14,759 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 678/831 Jobs: 2 Epoch: 3.26/4.0 (81.5% complete) lr: 0.000459
2020-10-16 16:13:21,567 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 679/831 Jobs: 2 Epoch: 3.26/4.0 (81.6% complete) lr: 0.000458
2020-10-16 16:14:29,997 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 680/831 Jobs: 2 Epoch: 3.27/4.0 (81.7% complete) lr: 0.000457
2020-10-16 16:15:40,034 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 681/831 Jobs: 2 Epoch: 3.27/4.0 (81.9% complete) lr: 0.000456
2020-10-16 16:17:08,357 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 682/831 Jobs: 2 Epoch: 3.28/4.0 (82.0% complete) lr: 0.000454
2020-10-16 16:18:19,031 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 683/831 Jobs: 2 Epoch: 3.28/4.0 (82.1% complete) lr: 0.000453
2020-10-16 16:19:36,973 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 684/831 Jobs: 2 Epoch: 3.29/4.0 (82.2% complete) lr: 0.000452
2020-10-16 16:20:51,434 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 685/831 Jobs: 2 Epoch: 3.29/4.0 (82.3% complete) lr: 0.000451
2020-10-16 16:22:08,797 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 686/831 Jobs: 2 Epoch: 3.30/4.0 (82.5% complete) lr: 0.000449
2020-10-16 16:23:30,530 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 687/831 Jobs: 2 Epoch: 3.30/4.0 (82.6% complete) lr: 0.000448
2020-10-16 16:24:39,326 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 688/831 Jobs: 2 Epoch: 3.31/4.0 (82.7% complete) lr: 0.000447
2020-10-16 16:25:44,915 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 689/831 Jobs: 2 Epoch: 3.31/4.0 (82.8% complete) lr: 0.000446
2020-10-16 16:27:03,238 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 690/831 Jobs: 2 Epoch: 3.32/4.0 (82.9% complete) lr: 0.000444
2020-10-16 16:28:10,710 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 691/831 Jobs: 2 Epoch: 3.32/4.0 (83.1% complete) lr: 0.000443
2020-10-16 16:29:23,515 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 692/831 Jobs: 2 Epoch: 3.33/4.0 (83.2% complete) lr: 0.000442
2020-10-16 16:30:29,494 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 693/831 Jobs: 2 Epoch: 3.33/4.0 (83.3% complete) lr: 0.000441
2020-10-16 16:31:41,977 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 694/831 Jobs: 2 Epoch: 3.34/4.0 (83.4% complete) lr: 0.000440
2020-10-16 16:32:50,992 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 695/831 Jobs: 2 Epoch: 3.34/4.0 (83.5% complete) lr: 0.000438
2020-10-16 16:33:56,411 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 696/831 Jobs: 2 Epoch: 3.35/4.0 (83.7% complete) lr: 0.000437
2020-10-16 16:34:52,596 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 697/831 Jobs: 2 Epoch: 3.35/4.0 (83.8% complete) lr: 0.000436
2020-10-16 16:35:48,844 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 698/831 Jobs: 2 Epoch: 3.36/4.0 (83.9% complete) lr: 0.000435
2020-10-16 16:36:45,513 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 699/831 Jobs: 2 Epoch: 3.36/4.0 (84.0% complete) lr: 0.000433
2020-10-16 16:37:42,457 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 700/831 Jobs: 2 Epoch: 3.37/4.0 (84.1% complete) lr: 0.000432
2020-10-16 16:38:42,123 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 701/831 Jobs: 2 Epoch: 3.37/4.0 (84.3% complete) lr: 0.000431
2020-10-16 16:39:39,271 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 702/831 Jobs: 2 Epoch: 3.38/4.0 (84.4% complete) lr: 0.000430
2020-10-16 16:40:36,111 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 703/831 Jobs: 2 Epoch: 3.38/4.0 (84.5% complete) lr: 0.000429
2020-10-16 16:41:32,884 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 704/831 Jobs: 2 Epoch: 3.38/4.0 (84.6% complete) lr: 0.000428
2020-10-16 16:42:29,618 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 705/831 Jobs: 2 Epoch: 3.39/4.0 (84.7% complete) lr: 0.000426
2020-10-16 16:43:26,581 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 706/831 Jobs: 2 Epoch: 3.39/4.0 (84.9% complete) lr: 0.000425
2020-10-16 16:44:23,472 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 707/831 Jobs: 2 Epoch: 3.40/4.0 (85.0% complete) lr: 0.000424
2020-10-16 16:45:20,402 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 708/831 Jobs: 2 Epoch: 3.40/4.0 (85.1% complete) lr: 0.000423
2020-10-16 16:46:17,440 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 709/831 Jobs: 2 Epoch: 3.41/4.0 (85.2% complete) lr: 0.000422
2020-10-16 16:47:13,971 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 710/831 Jobs: 2 Epoch: 3.41/4.0 (85.3% complete) lr: 0.000420
2020-10-16 16:48:10,827 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 711/831 Jobs: 2 Epoch: 3.42/4.0 (85.5% complete) lr: 0.000419
2020-10-16 16:49:07,881 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 712/831 Jobs: 2 Epoch: 3.42/4.0 (85.6% complete) lr: 0.000418
2020-10-16 16:50:03,922 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 713/831 Jobs: 2 Epoch: 3.43/4.0 (85.7% complete) lr: 0.000417
2020-10-16 16:51:00,864 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 714/831 Jobs: 2 Epoch: 3.43/4.0 (85.8% complete) lr: 0.000416
2020-10-16 16:51:57,712 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 715/831 Jobs: 2 Epoch: 3.44/4.0 (85.9% complete) lr: 0.000415
2020-10-16 16:52:55,006 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 716/831 Jobs: 2 Epoch: 3.44/4.0 (86.1% complete) lr: 0.000414
2020-10-16 16:53:51,518 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 717/831 Jobs: 2 Epoch: 3.45/4.0 (86.2% complete) lr: 0.000412
2020-10-16 16:54:48,436 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 718/831 Jobs: 2 Epoch: 3.45/4.0 (86.3% complete) lr: 0.000411
2020-10-16 16:55:45,218 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 719/831 Jobs: 2 Epoch: 3.46/4.0 (86.4% complete) lr: 0.000410
2020-10-16 16:56:42,373 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 720/831 Jobs: 2 Epoch: 3.46/4.0 (86.5% complete) lr: 0.000409
2020-10-16 16:57:42,653 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 721/831 Jobs: 2 Epoch: 3.47/4.0 (86.7% complete) lr: 0.000408
2020-10-16 16:58:39,620 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 722/831 Jobs: 2 Epoch: 3.47/4.0 (86.8% complete) lr: 0.000407
2020-10-16 16:59:36,317 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 723/831 Jobs: 2 Epoch: 3.48/4.0 (86.9% complete) lr: 0.000406
2020-10-16 17:00:32,656 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 724/831 Jobs: 2 Epoch: 3.48/4.0 (87.0% complete) lr: 0.000405
2020-10-16 17:01:29,713 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 725/831 Jobs: 2 Epoch: 3.49/4.0 (87.1% complete) lr: 0.000403
2020-10-16 17:02:26,366 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 726/831 Jobs: 2 Epoch: 3.49/4.0 (87.3% complete) lr: 0.000402
2020-10-16 17:03:23,098 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 727/831 Jobs: 2 Epoch: 3.50/4.0 (87.4% complete) lr: 0.000401
2020-10-16 17:04:20,206 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 728/831 Jobs: 2 Epoch: 3.50/4.0 (87.5% complete) lr: 0.000400
2020-10-16 17:05:17,386 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 729/831 Jobs: 2 Epoch: 3.50/4.0 (87.6% complete) lr: 0.000399
2020-10-16 17:06:14,406 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 730/831 Jobs: 2 Epoch: 3.51/4.0 (87.7% complete) lr: 0.000398
2020-10-16 17:07:11,558 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 731/831 Jobs: 2 Epoch: 3.51/4.0 (87.9% complete) lr: 0.000397
2020-10-16 17:08:07,814 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 732/831 Jobs: 2 Epoch: 3.52/4.0 (88.0% complete) lr: 0.000396
2020-10-16 17:09:05,047 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 733/831 Jobs: 2 Epoch: 3.52/4.0 (88.1% complete) lr: 0.000395
2020-10-16 17:10:02,065 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 734/831 Jobs: 2 Epoch: 3.53/4.0 (88.2% complete) lr: 0.000393
2020-10-16 17:10:59,130 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 735/831 Jobs: 2 Epoch: 3.53/4.0 (88.3% complete) lr: 0.000392
2020-10-16 17:11:55,806 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 736/831 Jobs: 2 Epoch: 3.54/4.0 (88.5% complete) lr: 0.000391
2020-10-16 17:12:53,074 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 737/831 Jobs: 2 Epoch: 3.54/4.0 (88.6% complete) lr: 0.000390
2020-10-16 17:13:49,556 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 738/831 Jobs: 2 Epoch: 3.55/4.0 (88.7% complete) lr: 0.000389
2020-10-16 17:14:46,191 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 739/831 Jobs: 2 Epoch: 3.55/4.0 (88.8% complete) lr: 0.000388
2020-10-16 17:15:42,856 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 740/831 Jobs: 2 Epoch: 3.56/4.0 (88.9% complete) lr: 0.000387
2020-10-16 17:16:43,290 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 741/831 Jobs: 2 Epoch: 3.56/4.0 (89.1% complete) lr: 0.000386
2020-10-16 17:17:40,416 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 742/831 Jobs: 2 Epoch: 3.57/4.0 (89.2% complete) lr: 0.000385
2020-10-16 17:18:37,116 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 743/831 Jobs: 2 Epoch: 3.57/4.0 (89.3% complete) lr: 0.000384
2020-10-16 17:19:34,133 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 744/831 Jobs: 2 Epoch: 3.58/4.0 (89.4% complete) lr: 0.000383
2020-10-16 17:20:30,742 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 745/831 Jobs: 2 Epoch: 3.58/4.0 (89.5% complete) lr: 0.000382
2020-10-16 17:21:27,810 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 746/831 Jobs: 2 Epoch: 3.59/4.0 (89.7% complete) lr: 0.000381
2020-10-16 17:22:24,663 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 747/831 Jobs: 2 Epoch: 3.59/4.0 (89.8% complete) lr: 0.000380
2020-10-16 17:23:21,801 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 748/831 Jobs: 2 Epoch: 3.60/4.0 (89.9% complete) lr: 0.000379
2020-10-16 17:24:18,677 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 749/831 Jobs: 2 Epoch: 3.60/4.0 (90.0% complete) lr: 0.000377
2020-10-16 17:25:15,839 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 750/831 Jobs: 2 Epoch: 3.61/4.0 (90.1% complete) lr: 0.000376
2020-10-16 17:26:12,854 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 751/831 Jobs: 2 Epoch: 3.61/4.0 (90.3% complete) lr: 0.000375
2020-10-16 17:27:09,942 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 752/831 Jobs: 2 Epoch: 3.62/4.0 (90.4% complete) lr: 0.000374
2020-10-16 17:28:07,151 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 753/831 Jobs: 2 Epoch: 3.62/4.0 (90.5% complete) lr: 0.000373
2020-10-16 17:29:04,439 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 754/831 Jobs: 2 Epoch: 3.62/4.0 (90.6% complete) lr: 0.000372
2020-10-16 17:30:01,419 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 755/831 Jobs: 2 Epoch: 3.63/4.0 (90.7% complete) lr: 0.000371
2020-10-16 17:30:58,407 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 756/831 Jobs: 2 Epoch: 3.63/4.0 (90.9% complete) lr: 0.000370
2020-10-16 17:31:54,962 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 757/831 Jobs: 2 Epoch: 3.64/4.0 (91.0% complete) lr: 0.000369
2020-10-16 17:32:50,865 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 758/831 Jobs: 2 Epoch: 3.64/4.0 (91.1% complete) lr: 0.000368
2020-10-16 17:33:47,585 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 759/831 Jobs: 2 Epoch: 3.65/4.0 (91.2% complete) lr: 0.000367
2020-10-16 17:34:44,330 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 760/831 Jobs: 2 Epoch: 3.65/4.0 (91.3% complete) lr: 0.000366
2020-10-16 17:35:43,127 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 761/831 Jobs: 2 Epoch: 3.66/4.0 (91.5% complete) lr: 0.000365
2020-10-16 17:36:40,132 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 762/831 Jobs: 2 Epoch: 3.66/4.0 (91.6% complete) lr: 0.000364
2020-10-16 17:37:37,132 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 763/831 Jobs: 2 Epoch: 3.67/4.0 (91.7% complete) lr: 0.000363
2020-10-16 17:38:34,282 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 764/831 Jobs: 2 Epoch: 3.67/4.0 (91.8% complete) lr: 0.000362
2020-10-16 17:39:31,454 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 765/831 Jobs: 2 Epoch: 3.68/4.0 (91.9% complete) lr: 0.000361
2020-10-16 17:40:28,554 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 766/831 Jobs: 2 Epoch: 3.68/4.0 (92.1% complete) lr: 0.000360
2020-10-16 17:41:25,306 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 767/831 Jobs: 2 Epoch: 3.69/4.0 (92.2% complete) lr: 0.000359
2020-10-16 17:42:22,491 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 768/831 Jobs: 2 Epoch: 3.69/4.0 (92.3% complete) lr: 0.000358
2020-10-16 17:43:18,191 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 769/831 Jobs: 2 Epoch: 3.70/4.0 (92.4% complete) lr: 0.000357
2020-10-16 17:44:15,143 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 770/831 Jobs: 2 Epoch: 3.70/4.0 (92.5% complete) lr: 0.000356
2020-10-16 17:45:10,990 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 771/831 Jobs: 2 Epoch: 3.71/4.0 (92.7% complete) lr: 0.000355
2020-10-16 17:46:07,797 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 772/831 Jobs: 2 Epoch: 3.71/4.0 (92.8% complete) lr: 0.000354
2020-10-16 17:47:04,569 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 773/831 Jobs: 2 Epoch: 3.72/4.0 (92.9% complete) lr: 0.000353
2020-10-16 17:48:00,830 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 774/831 Jobs: 2 Epoch: 3.72/4.0 (93.0% complete) lr: 0.000352
2020-10-16 17:48:57,890 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 775/831 Jobs: 2 Epoch: 3.73/4.0 (93.1% complete) lr: 0.000351
2020-10-16 17:49:55,116 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 776/831 Jobs: 2 Epoch: 3.73/4.0 (93.3% complete) lr: 0.000350
2020-10-16 17:50:51,840 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 777/831 Jobs: 2 Epoch: 3.74/4.0 (93.4% complete) lr: 0.000349
2020-10-16 17:51:48,376 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 778/831 Jobs: 2 Epoch: 3.74/4.0 (93.5% complete) lr: 0.000348
2020-10-16 17:52:45,420 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 779/831 Jobs: 2 Epoch: 3.75/4.0 (93.6% complete) lr: 0.000347
2020-10-16 17:53:42,524 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 780/831 Jobs: 2 Epoch: 3.75/4.0 (93.8% complete) lr: 0.000346
2020-10-16 17:54:42,037 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 781/831 Jobs: 2 Epoch: 3.75/4.0 (93.9% complete) lr: 0.000345
2020-10-16 17:55:38,592 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 782/831 Jobs: 2 Epoch: 3.76/4.0 (94.0% complete) lr: 0.000345
2020-10-16 17:56:34,946 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 783/831 Jobs: 2 Epoch: 3.76/4.0 (94.1% complete) lr: 0.000344
2020-10-16 17:57:31,156 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 784/831 Jobs: 2 Epoch: 3.77/4.0 (94.2% complete) lr: 0.000343
2020-10-16 17:58:27,266 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 785/831 Jobs: 2 Epoch: 3.77/4.0 (94.4% complete) lr: 0.000342
2020-10-16 17:59:23,654 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 786/831 Jobs: 2 Epoch: 3.78/4.0 (94.5% complete) lr: 0.000341
2020-10-16 18:00:20,636 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 787/831 Jobs: 2 Epoch: 3.78/4.0 (94.6% complete) lr: 0.000340
2020-10-16 18:01:17,293 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 788/831 Jobs: 2 Epoch: 3.79/4.0 (94.7% complete) lr: 0.000339
2020-10-16 18:02:14,121 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 789/831 Jobs: 2 Epoch: 3.79/4.0 (94.8% complete) lr: 0.000338
2020-10-16 18:03:11,100 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 790/831 Jobs: 2 Epoch: 3.80/4.0 (95.0% complete) lr: 0.000337
2020-10-16 18:04:08,022 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 791/831 Jobs: 2 Epoch: 3.80/4.0 (95.1% complete) lr: 0.000336
2020-10-16 18:05:04,467 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 792/831 Jobs: 2 Epoch: 3.81/4.0 (95.2% complete) lr: 0.000335
2020-10-16 18:06:01,411 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 793/831 Jobs: 2 Epoch: 3.81/4.0 (95.3% complete) lr: 0.000334
2020-10-16 18:06:58,460 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 794/831 Jobs: 2 Epoch: 3.82/4.0 (95.4% complete) lr: 0.000333
2020-10-16 18:07:55,381 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 795/831 Jobs: 2 Epoch: 3.82/4.0 (95.6% complete) lr: 0.000332
2020-10-16 18:08:52,104 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 796/831 Jobs: 2 Epoch: 3.83/4.0 (95.7% complete) lr: 0.000331
2020-10-16 18:09:48,801 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 797/831 Jobs: 2 Epoch: 3.83/4.0 (95.8% complete) lr: 0.000331
2020-10-16 18:10:45,784 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 798/831 Jobs: 2 Epoch: 3.84/4.0 (95.9% complete) lr: 0.000330
2020-10-16 18:11:42,633 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 799/831 Jobs: 2 Epoch: 3.84/4.0 (96.0% complete) lr: 0.000329
2020-10-16 18:12:39,441 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 800/831 Jobs: 2 Epoch: 3.85/4.0 (96.2% complete) lr: 0.000328
2020-10-16 18:13:39,343 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 801/831 Jobs: 2 Epoch: 3.85/4.0 (96.3% complete) lr: 0.000327
2020-10-16 18:14:35,164 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 802/831 Jobs: 2 Epoch: 3.86/4.0 (96.4% complete) lr: 0.000326
2020-10-16 18:15:31,462 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 803/831 Jobs: 2 Epoch: 3.86/4.0 (96.5% complete) lr: 0.000325
2020-10-16 18:16:28,502 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 804/831 Jobs: 2 Epoch: 3.87/4.0 (96.6% complete) lr: 0.000324
2020-10-16 18:17:25,557 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 805/831 Jobs: 2 Epoch: 3.87/4.0 (96.8% complete) lr: 0.000323
2020-10-16 18:18:22,428 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 806/831 Jobs: 2 Epoch: 3.88/4.0 (96.9% complete) lr: 0.000322
2020-10-16 18:19:19,689 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 807/831 Jobs: 2 Epoch: 3.88/4.0 (97.0% complete) lr: 0.000321
2020-10-16 18:20:15,639 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 808/831 Jobs: 2 Epoch: 3.88/4.0 (97.1% complete) lr: 0.000321
2020-10-16 18:21:12,582 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 809/831 Jobs: 2 Epoch: 3.89/4.0 (97.2% complete) lr: 0.000320
2020-10-16 18:22:09,629 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 810/831 Jobs: 2 Epoch: 3.89/4.0 (97.4% complete) lr: 0.000319
2020-10-16 18:23:06,075 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 811/831 Jobs: 2 Epoch: 3.90/4.0 (97.5% complete) lr: 0.000318
2020-10-16 18:24:03,000 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 812/831 Jobs: 2 Epoch: 3.90/4.0 (97.6% complete) lr: 0.000317
2020-10-16 18:24:59,275 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 813/831 Jobs: 2 Epoch: 3.91/4.0 (97.7% complete) lr: 0.000316
2020-10-16 18:25:55,987 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 814/831 Jobs: 2 Epoch: 3.91/4.0 (97.8% complete) lr: 0.000315
2020-10-16 18:26:52,796 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 815/831 Jobs: 2 Epoch: 3.92/4.0 (98.0% complete) lr: 0.000314
2020-10-16 18:27:48,825 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 816/831 Jobs: 2 Epoch: 3.92/4.0 (98.1% complete) lr: 0.000314
2020-10-16 18:28:44,712 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 817/831 Jobs: 2 Epoch: 3.93/4.0 (98.2% complete) lr: 0.000313
2020-10-16 18:29:41,304 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 818/831 Jobs: 2 Epoch: 3.93/4.0 (98.3% complete) lr: 0.000312
2020-10-16 18:30:37,822 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 819/831 Jobs: 2 Epoch: 3.94/4.0 (98.4% complete) lr: 0.000311
2020-10-16 18:31:34,430 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 820/831 Jobs: 2 Epoch: 3.94/4.0 (98.6% complete) lr: 0.000310
2020-10-16 18:32:34,710 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 821/831 Jobs: 2 Epoch: 3.95/4.0 (98.7% complete) lr: 0.000309
2020-10-16 18:33:31,119 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 822/831 Jobs: 2 Epoch: 3.95/4.0 (98.8% complete) lr: 0.000308
2020-10-16 18:34:26,907 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 823/831 Jobs: 2 Epoch: 3.96/4.0 (98.9% complete) lr: 0.000308
2020-10-16 18:35:23,805 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 824/831 Jobs: 2 Epoch: 3.96/4.0 (99.0% complete) lr: 0.000307
2020-10-16 18:36:20,646 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 825/831 Jobs: 2 Epoch: 3.97/4.0 (99.2% complete) lr: 0.000306
2020-10-16 18:37:16,348 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 826/831 Jobs: 2 Epoch: 3.97/4.0 (99.3% complete) lr: 0.000305
2020-10-16 18:38:13,315 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 827/831 Jobs: 2 Epoch: 3.98/4.0 (99.4% complete) lr: 0.000304
2020-10-16 18:39:10,372 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 828/831 Jobs: 2 Epoch: 3.98/4.0 (99.5% complete) lr: 0.000303
2020-10-16 18:40:07,494 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 829/831 Jobs: 2 Epoch: 3.99/4.0 (99.6% complete) lr: 0.000303
2020-10-16 18:41:04,389 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 830/831 Jobs: 2 Epoch: 3.99/4.0 (99.8% complete) lr: 0.000302
2020-10-16 18:42:00,961 [steps/nnet3/train_dnn.py:355 - train - INFO ] Iter: 831/831 Jobs: 2 Epoch: 4.00/4.0 (99.9% complete) lr: 0.000300
2020-10-16 18:42:58,251 [steps/nnet3/train_dnn.py:401 - train - INFO ] Doing final combination to produce final.mdl
2020-10-16 18:42:58,252 [steps/libs/nnet3/train/frame_level_objf/common.py:492 - combine_models - INFO ] Combining set([768, 773, 778, 783, 788, 793, 798, 803, 808, 813, 818, 823, 828, 832, 728, 733, 738, 743, 748, 753, 758, 763]) models.
2020-10-16 18:43:17,382 [steps/nnet3/train_dnn.py:410 - train - INFO ] Getting average posterior for purposes of adjusting the priors.
2020-10-16 18:44:55,534 [steps/nnet3/train_dnn.py:421 - train - INFO ] Re-adjusting priors based on computed posteriors
2020-10-16 18:44:55,744 [steps/nnet3/train_dnn.py:431 - train - INFO ] Cleaning up the experiment directory exp/nnet3/tdnn_sp
steps/nnet2/remove_egs.sh: Finished deleting examples in exp/nnet3/tdnn_sp/egs
exp/nnet3/tdnn_sp: num-iters=832 nj=2..2 num-params=12.2M dim=43+100->3016 combine=-0.42->-0.42 (over 22) loglike:train/valid[553,831,combined]=(-0.47,-0.42,-0.43/-0.78,-0.80,-0.80) accuracy:train/valid[553,831,combined]=(0.841,0.853,0.855/0.769,0.767,0.771)
steps/nnet3/decode.sh --nj 40 --cmd run.pl --mem 4G --online-ivector-dir exp/nnet3/ivectors_dev exp/tri5a/graph data/dev_hires exp/nnet3/tdnn_sp/decode_dev
steps/nnet3/decode.sh: feature type is raw
steps/diagnostic/analyze_lats.sh --cmd run.pl --mem 4G --iter final exp/tri5a/graph exp/nnet3/tdnn_sp/decode_dev
steps/diagnostic/analyze_lats.sh: see stats in exp/nnet3/tdnn_sp/decode_dev/log/analyze_alignments.log
Overall, lattice depth (10,50,90-percentile)=(1,3,19) and mean=8.6
steps/diagnostic/analyze_lats.sh: see stats in exp/nnet3/tdnn_sp/decode_dev/log/analyze_lattice_depth_stats.log
score best paths
+ steps/score_kaldi.sh --cmd 'run.pl --mem 4G' data/dev_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_dev
steps/score_kaldi.sh --cmd run.pl --mem 4G data/dev_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_dev
steps/score_kaldi.sh: scoring with word insertion penalty=0.0,0.5,1.0
+ steps/scoring/score_kaldi_cer.sh --stage 2 --cmd 'run.pl --mem 4G' data/dev_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_dev
steps/scoring/score_kaldi_cer.sh --stage 2 --cmd run.pl --mem 4G data/dev_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_dev
steps/scoring/score_kaldi_cer.sh: scoring with word insertion penalty=0.0,0.5,1.0
+ echo 'local/score.sh: Done'
local/score.sh: Done
score confidence and timing with sclite
Decoding done.
steps/nnet3/decode.sh --nj 20 --cmd run.pl --mem 4G --online-ivector-dir exp/nnet3/ivectors_test exp/tri5a/graph data/test_hires exp/nnet3/tdnn_sp/decode_test
steps/nnet3/decode.sh: feature type is raw
steps/diagnostic/analyze_lats.sh --cmd run.pl --mem 4G --iter final exp/tri5a/graph exp/nnet3/tdnn_sp/decode_test
steps/diagnostic/analyze_lats.sh: see stats in exp/nnet3/tdnn_sp/decode_test/log/analyze_alignments.log
Overall, lattice depth (10,50,90-percentile)=(1,4,25) and mean=11.0
steps/diagnostic/analyze_lats.sh: see stats in exp/nnet3/tdnn_sp/decode_test/log/analyze_lattice_depth_stats.log
score best paths
+ steps/score_kaldi.sh --cmd 'run.pl --mem 4G' data/test_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_test
steps/score_kaldi.sh --cmd run.pl --mem 4G data/test_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_test
steps/score_kaldi.sh: scoring with word insertion penalty=0.0,0.5,1.0
+ steps/scoring/score_kaldi_cer.sh --stage 2 --cmd 'run.pl --mem 4G' data/test_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_test
steps/scoring/score_kaldi_cer.sh --stage 2 --cmd run.pl --mem 4G data/test_hires exp/tri5a/graph exp/nnet3/tdnn_sp/decode_test
steps/scoring/score_kaldi_cer.sh: scoring with word insertion penalty=0.0,0.5,1.0
+ echo 'local/score.sh: Done'
local/score.sh: Done
score confidence and timing with sclite
Decoding done.
%WER 36.56 [ 38301 / 104765, 826 ins, 3204 del, 34271 sub ] exp/mono/decode_test/cer_10_0.0
%WER 18.71 [ 19599 / 104765, 954 ins, 1162 del, 17483 sub ] exp/tri1/decode_test/cer_13_0.5
%WER 18.70 [ 19587 / 104765, 1071 ins, 1096 del, 17420 sub ] exp/tri2/decode_test/cer_14_0.0
%WER 16.82 [ 17617 / 104765, 836 ins, 890 del, 15891 sub ] exp/tri3a/decode_test/cer_13_0.5
%WER 13.62 [ 14272 / 104765, 758 ins, 619 del, 12895 sub ] exp/tri4a/decode_test/cer_13_0.5
%WER 12.12 [ 12693 / 104765, 703 ins, 577 del, 11413 sub ] exp/tri5a/decode_test/cer_14_0.5
%WER 8.87 [ 9294 / 104765, 378 ins, 543 del, 8373 sub ] exp/nnet3/tdnn_sp/decode_test/cer_17_1.0
五、使用kaldi-gstreamer-server搭建在线识别
这块博主省略了，打算直接贴一张效果图
3139
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
