Average train loss at epoch 0, step 10: 7.168975
Average train loss at epoch 0, step 20: 4.187774
Average train loss at epoch 0, step 30: 3.224344
Average train loss at epoch 0, step 40: 2.797163
Average train loss at epoch 0, step 50: 2.747530
Average train loss at epoch 0, step 60: 2.608602
Average train loss at epoch 0, step 70: 2.759296
Average train loss at epoch 0, step 80: 2.575954
Average train loss at epoch 0, step 90: 2.697940
Average train loss at epoch 0, step 100: 2.533278
Average train loss at epoch 0, step 110: 2.482752
Average train loss at epoch 0, step 120: 2.428193
Average train loss at epoch 0, step 130: 2.433405
Average train loss at epoch 0, step 140: 2.546187
Average train loss at epoch 0, step 150: 2.350867
Average train loss at epoch 0, step 160: 2.255360
Average train loss at epoch 0, step 170: 2.072151
Average train loss at epoch 0, step 180: 2.079725
Average train loss at epoch 0, step 190: 2.055933
Average train loss at epoch 0, step 200: 1.949082
Average train loss at epoch 0, step 210: 1.820943
Average train loss at epoch 0, step 220: 1.883430
Average train loss at epoch 0, step 230: 2.125672
Average train loss at epoch 0, step 240: 1.869117
Average train loss at epoch 0, step 250: 1.592734
Average train loss at epoch 0, step 260: 1.670590
Average train loss at epoch 0, step 270: 1.522579
[Epoch 0] Average train loss: 2.530493380348315
Input Sentence : ['please', 'show', 'me', 'airlines', 'with', 'flights', 'from', 'denver', 'to', 'boston', 'with', 'stop', 'in', 'philadelphia']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'O', 'B-stoploc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'O', 'O']
Intent Truth : atis_airline
Intent Prediction : atis_flight
Intent accuracy for epoch 0: 0.8467741935483871
Slot accuracy for epoch 0: 0.7617284815643354
Slot F1 score for epoch 0: 0.7609041144269821
Average train loss at epoch 1, step 0: 2.015948
Average train loss at epoch 1, step 10: 1.515032
Average train loss at epoch 1, step 20: 1.623237
Average train loss at epoch 1, step 30: 1.569408
Average train loss at epoch 1, step 40: 1.511372
Average train loss at epoch 1, step 50: 1.503811
Average train loss at epoch 1, step 60: 1.427658
Average train loss at epoch 1, step 70: 1.549041
Average train loss at epoch 1, step 80: 1.376970
Average train loss at epoch 1, step 90: 1.325663
Average train loss at epoch 1, step 100: 1.354954
Average train loss at epoch 1, step 110: 1.507461
Average train loss at epoch 1, step 120: 1.227449
Average train loss at epoch 1, step 130: 1.282090
Average train loss at epoch 1, step 140: 1.298157
Average train loss at epoch 1, step 150: 1.175597
Average train loss at epoch 1, step 160: 1.208616
Average train loss at epoch 1, step 170: 1.187920
Average train loss at epoch 1, step 180: 1.267600
Average train loss at epoch 1, step 190: 1.286711
Average train loss at epoch 1, step 200: 1.293729
Average train loss at epoch 1, step 210: 1.070895
Average train loss at epoch 1, step 220: 1.202929
Average train loss at epoch 1, step 230: 0.951222
Average train loss at epoch 1, step 240: 0.979842
Average train loss at epoch 1, step 250: 1.068015
Average train loss at epoch 1, step 260: 0.985929
Average train loss at epoch 1, step 270: 1.097048
[Epoch 1] Average train loss: 1.2845789841426316
Input Sentence : ['flights', 'from', 'kansas', 'city', 'to', 'cleveland', 'on', 'wednesday']
Slot Truth : ['O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.day_name']
Slot Prediction : ['O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.day_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 1: 0.8669354838709677
Slot accuracy for epoch 1: 0.8218628902974674
Slot F1 score for epoch 1: 0.821156907836547
Average train loss at epoch 2, step 0: 0.829570
Average train loss at epoch 2, step 10: 1.049426
Average train loss at epoch 2, step 20: 0.994091
Average train loss at epoch 2, step 30: 0.933242
Average train loss at epoch 2, step 40: 0.872448
Average train loss at epoch 2, step 50: 0.924178
Average train loss at epoch 2, step 60: 0.908452
Average train loss at epoch 2, step 70: 0.832179
Average train loss at epoch 2, step 80: 0.969451
Average train loss at epoch 2, step 90: 1.023549
Average train loss at epoch 2, step 100: 0.776070
Average train loss at epoch 2, step 110: 0.784601
Average train loss at epoch 2, step 120: 0.823831
Average train loss at epoch 2, step 130: 0.747891
Average train loss at epoch 2, step 140: 0.662579
Average train loss at epoch 2, step 150: 0.699255
Average train loss at epoch 2, step 160: 0.768517
Average train loss at epoch 2, step 170: 0.763769
Average train loss at epoch 2, step 180: 0.681351
Average train loss at epoch 2, step 190: 0.749272
Average train loss at epoch 2, step 200: 0.716750
Average train loss at epoch 2, step 210: 0.746645
Average train loss at epoch 2, step 220: 0.708928
Average train loss at epoch 2, step 230: 0.601744
Average train loss at epoch 2, step 240: 0.541084
Average train loss at epoch 2, step 250: 0.684904
Average train loss at epoch 2, step 260: 0.714289
Average train loss at epoch 2, step 270: 0.593054
[Epoch 2] Average train loss: 0.7854871800082559
Input Sentence : ['does', 'american', 'airlines', 'fly', 'to', 'san', 'francisco', 'from', 'atlanta']
Slot Truth : ['O', 'B-airline_name', 'I-airline_name', 'O', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-fromloc.city_name']
Slot Prediction : ['O', 'B-airline_name', 'I-airline_name', 'O', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-fromloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 2: 0.9314516129032258
Slot accuracy for epoch 2: 0.8852743932972376
Slot F1 score for epoch 2: 0.884962007421806
Average train loss at epoch 3, step 0: 0.970477
Average train loss at epoch 3, step 10: 0.694361
Average train loss at epoch 3, step 20: 0.571297
Average train loss at epoch 3, step 30: 0.736816
Average train loss at epoch 3, step 40: 0.474960
Average train loss at epoch 3, step 50: 0.485004
Average train loss at epoch 3, step 60: 0.569803
Average train loss at epoch 3, step 70: 0.529790
Average train loss at epoch 3, step 80: 0.478037
Average train loss at epoch 3, step 90: 0.628945
Average train loss at epoch 3, step 100: 0.511432
Average train loss at epoch 3, step 110: 0.462153
Average train loss at epoch 3, step 120: 0.497189
Average train loss at epoch 3, step 130: 0.478925
Average train loss at epoch 3, step 140: 0.528197
Average train loss at epoch 3, step 150: 0.492928
Average train loss at epoch 3, step 160: 0.492649
Average train loss at epoch 3, step 170: 0.431927
Average train loss at epoch 3, step 180: 0.468128
Average train loss at epoch 3, step 190: 0.373504
Average train loss at epoch 3, step 200: 0.532929
Average train loss at epoch 3, step 210: 0.572107
Average train loss at epoch 3, step 220: 0.474337
Average train loss at epoch 3, step 230: 0.618194
Average train loss at epoch 3, step 240: 0.559880
Average train loss at epoch 3, step 250: 0.430830
Average train loss at epoch 3, step 260: 0.426991
Average train loss at epoch 3, step 270: 0.457553
[Epoch 3] Average train loss: 0.5181895210324222
Input Sentence : ['flight', 'from', 'dallas', 'to', 'oakland', 'california', 'on', 'monday']
Slot Truth : ['O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_name', 'O', 'B-depart_date.day_name']
Slot Prediction : ['O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_name', 'O', 'B-depart_date.day_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 3: 0.9495967741935484
Slot accuracy for epoch 3: 0.9226336008648389
Slot F1 score for epoch 3: 0.9221260815822002
Average train loss at epoch 4, step 0: 0.405955
Average train loss at epoch 4, step 10: 0.456293
Average train loss at epoch 4, step 20: 0.372024
Average train loss at epoch 4, step 30: 0.333584
Average train loss at epoch 4, step 40: 0.349129
Average train loss at epoch 4, step 50: 0.288039
Average train loss at epoch 4, step 60: 0.375815
Average train loss at epoch 4, step 70: 0.311218
Average train loss at epoch 4, step 80: 0.374242
Average train loss at epoch 4, step 90: 0.322777
Average train loss at epoch 4, step 100: 0.381374
Average train loss at epoch 4, step 110: 0.417221
Average train loss at epoch 4, step 120: 0.433347
Average train loss at epoch 4, step 130: 0.321036
Average train loss at epoch 4, step 140: 0.313297
Average train loss at epoch 4, step 150: 0.356379
Average train loss at epoch 4, step 160: 0.342532
Average train loss at epoch 4, step 170: 0.331589
Average train loss at epoch 4, step 180: 0.427229
Average train loss at epoch 4, step 190: 0.322483
Average train loss at epoch 4, step 200: 0.290892
Average train loss at epoch 4, step 210: 0.307305
Average train loss at epoch 4, step 220: 0.413282
Average train loss at epoch 4, step 230: 0.404580
Average train loss at epoch 4, step 240: 0.307830
Average train loss at epoch 4, step 250: 0.258290
Average train loss at epoch 4, step 260: 0.349296
Average train loss at epoch 4, step 270: 0.325474
[Epoch 4] Average train loss: 0.35307320338209897
Input Sentence : ['are', 'there', 'any', 'nonstop', 'flights', 'leaving', 'from', 'denver', 'arriving', 'in', 'baltimore', 'on', 'july', 'seventh']
Slot Truth : ['O', 'O', 'O', 'B-flight_stop', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'O', 'B-toloc.city_name', 'O', 'B-arrive_date.month_name', 'B-arrive_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'B-depart_date.day_name', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 4: 0.9637096774193549
Slot accuracy for epoch 4: 0.9362747486353112
Slot F1 score for epoch 4: 0.9353551476456505
Average train loss at epoch 5, step 0: 0.260956
Average train loss at epoch 5, step 10: 0.349296
Average train loss at epoch 5, step 20: 0.228863
Average train loss at epoch 5, step 30: 0.269304
Average train loss at epoch 5, step 40: 0.210656
Average train loss at epoch 5, step 50: 0.260930
Average train loss at epoch 5, step 60: 0.258613
Average train loss at epoch 5, step 70: 0.236776
Average train loss at epoch 5, step 80: 0.250542
Average train loss at epoch 5, step 90: 0.296261
Average train loss at epoch 5, step 100: 0.272369
Average train loss at epoch 5, step 110: 0.193351
Average train loss at epoch 5, step 120: 0.141734
Average train loss at epoch 5, step 130: 0.281359
Average train loss at epoch 5, step 140: 0.295245
Average train loss at epoch 5, step 150: 0.203517
Average train loss at epoch 5, step 160: 0.277214
Average train loss at epoch 5, step 170: 0.269945
Average train loss at epoch 5, step 180: 0.239375
Average train loss at epoch 5, step 190: 0.264742
Average train loss at epoch 5, step 200: 0.220108
Average train loss at epoch 5, step 210: 0.200727
Average train loss at epoch 5, step 220: 0.228492
Average train loss at epoch 5, step 230: 0.302682
Average train loss at epoch 5, step 240: 0.266196
Average train loss at epoch 5, step 250: 0.197283
Average train loss at epoch 5, step 260: 0.273072
Average train loss at epoch 5, step 270: 0.368770
[Epoch 5] Average train loss: 0.25269853432519246
Input Sentence : ['explain', 'the', 'restriction', 'ap', '80']
Slot Truth : ['O', 'O', 'O', 'B-restriction_code', 'I-restriction_code']
Slot Prediction : ['O', 'O', 'O', 'B-restriction_code', 'I-restriction_code']
Intent Truth : atis_abbreviation
Intent Prediction : atis_abbreviation
Intent accuracy for epoch 5: 0.9637096774193549
Slot accuracy for epoch 5: 0.9487780547076295
Slot F1 score for epoch 5: 0.9470619375330863
Average train loss at epoch 6, step 0: 0.151603
Average train loss at epoch 6, step 10: 0.230626
Average train loss at epoch 6, step 20: 0.283316
Average train loss at epoch 6, step 30: 0.203521
Average train loss at epoch 6, step 40: 0.241634
Average train loss at epoch 6, step 50: 0.214214
Average train loss at epoch 6, step 60: 0.240071
Average train loss at epoch 6, step 70: 0.231188
Average train loss at epoch 6, step 80: 0.151471
Average train loss at epoch 6, step 90: 0.159381
Average train loss at epoch 6, step 100: 0.251688
Average train loss at epoch 6, step 110: 0.195624
Average train loss at epoch 6, step 120: 0.169258
Average train loss at epoch 6, step 130: 0.196483
Average train loss at epoch 6, step 140: 0.195555
Average train loss at epoch 6, step 150: 0.148348
Average train loss at epoch 6, step 160: 0.159211
Average train loss at epoch 6, step 170: 0.159313
Average train loss at epoch 6, step 180: 0.171057
Average train loss at epoch 6, step 190: 0.286623
Average train loss at epoch 6, step 200: 0.153968
Average train loss at epoch 6, step 210: 0.142977
Average train loss at epoch 6, step 220: 0.180201
Average train loss at epoch 6, step 230: 0.218069
Average train loss at epoch 6, step 240: 0.170178
Average train loss at epoch 6, step 250: 0.155910
Average train loss at epoch 6, step 260: 0.169646
Average train loss at epoch 6, step 270: 0.186866
[Epoch 6] Average train loss: 0.1945986322471104
Input Sentence : ['what', 'fare', 'codes', '<UNK>', 'flights', 'from', 'philadelphia', 'to', 'san', 'francisco']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Intent Truth : atis_abbreviation
Intent Prediction : atis_airfare
Intent accuracy for epoch 6: 0.9536290322580645
Slot accuracy for epoch 6: 0.9544628410183036
Slot F1 score for epoch 6: 0.9536470796773908
Average train loss at epoch 7, step 0: 0.147488
Average train loss at epoch 7, step 10: 0.171457
Average train loss at epoch 7, step 20: 0.149740
Average train loss at epoch 7, step 30: 0.121836
Average train loss at epoch 7, step 40: 0.169647
Average train loss at epoch 7, step 50: 0.170614
Average train loss at epoch 7, step 60: 0.215434
Average train loss at epoch 7, step 70: 0.143335
Average train loss at epoch 7, step 80: 0.136278
Average train loss at epoch 7, step 90: 0.167179
Average train loss at epoch 7, step 100: 0.158245
Average train loss at epoch 7, step 110: 0.134468
Average train loss at epoch 7, step 120: 0.178124
Average train loss at epoch 7, step 130: 0.238596
Average train loss at epoch 7, step 140: 0.088161
Average train loss at epoch 7, step 150: 0.182570
Average train loss at epoch 7, step 160: 0.167328
Average train loss at epoch 7, step 170: 0.129045
Average train loss at epoch 7, step 180: 0.166971
Average train loss at epoch 7, step 190: 0.150139
Average train loss at epoch 7, step 200: 0.246368
Average train loss at epoch 7, step 210: 0.173217
Average train loss at epoch 7, step 220: 0.138727
Average train loss at epoch 7, step 230: 0.247284
Average train loss at epoch 7, step 240: 0.166972
Average train loss at epoch 7, step 250: 0.133826
Average train loss at epoch 7, step 260: 0.198575
Average train loss at epoch 7, step 270: 0.148311
[Epoch 7] Average train loss: 0.16711449315337512
Input Sentence : ['does', 'midwest', 'express', 'have', 'any', 'flights', 'from', 'montreal', 'to', 'nashville']
Slot Truth : ['O', 'B-airline_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'B-airline_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 7: 0.9616935483870968
Slot accuracy for epoch 7: 0.957069596225989
Slot F1 score for epoch 7: 0.9571213862611617
Average train loss at epoch 8, step 0: 0.118734
Average train loss at epoch 8, step 10: 0.125202
Average train loss at epoch 8, step 20: 0.118573
Average train loss at epoch 8, step 30: 0.147380
Average train loss at epoch 8, step 40: 0.105223
Average train loss at epoch 8, step 50: 0.124355
Average train loss at epoch 8, step 60: 0.176952
Average train loss at epoch 8, step 70: 0.088408
Average train loss at epoch 8, step 80: 0.098463
Average train loss at epoch 8, step 90: 0.130823
Average train loss at epoch 8, step 100: 0.103637
Average train loss at epoch 8, step 110: 0.157965
Average train loss at epoch 8, step 120: 0.157448
Average train loss at epoch 8, step 130: 0.102609
Average train loss at epoch 8, step 140: 0.188053
Average train loss at epoch 8, step 150: 0.111667
Average train loss at epoch 8, step 160: 0.114991
Average train loss at epoch 8, step 170: 0.125747
Average train loss at epoch 8, step 180: 0.147534
Average train loss at epoch 8, step 190: 0.122307
Average train loss at epoch 8, step 200: 0.096102
Average train loss at epoch 8, step 210: 0.137232
Average train loss at epoch 8, step 220: 0.112877
Average train loss at epoch 8, step 230: 0.159487
Average train loss at epoch 8, step 240: 0.132921
Average train loss at epoch 8, step 250: 0.097694
Average train loss at epoch 8, step 260: 0.129085
Average train loss at epoch 8, step 270: 0.117393
[Epoch 8] Average train loss: 0.12697895790206595
Input Sentence : ['what', 'flights', 'are', 'available', 'from', 'boston', 'to', 'washington', 'late', 'monday', 'evening', 'or', 'early', 'tuesday', 'morning']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-depart_time.period_mod', 'B-depart_date.day_name', 'B-depart_time.period_of_day', 'B-or', 'B-depart_time.period_mod', 'B-depart_date.day_name', 'B-depart_time.period_of_day']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-depart_time.period_mod', 'B-depart_date.day_name', 'B-depart_time.period_of_day', 'B-or', 'B-depart_time.period_mod', 'B-or', 'B-depart_time.period_of_day']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 8: 0.967741935483871
Slot accuracy for epoch 8: 0.9631806137239364
Slot F1 score for epoch 8: 0.9623874271587498
Average train loss at epoch 9, step 0: 0.066843
Average train loss at epoch 9, step 10: 0.075040
Average train loss at epoch 9, step 20: 0.105699
Average train loss at epoch 9, step 30: 0.083135
Average train loss at epoch 9, step 40: 0.072776
Average train loss at epoch 9, step 50: 0.085836
Average train loss at epoch 9, step 60: 0.090928
Average train loss at epoch 9, step 70: 0.078716
Average train loss at epoch 9, step 80: 0.090566
Average train loss at epoch 9, step 90: 0.081007
Average train loss at epoch 9, step 100: 0.065340
Average train loss at epoch 9, step 110: 0.059612
Average train loss at epoch 9, step 120: 0.108985
Average train loss at epoch 9, step 130: 0.085031
Average train loss at epoch 9, step 140: 0.077308
Average train loss at epoch 9, step 150: 0.108312
Average train loss at epoch 9, step 160: 0.091150
Average train loss at epoch 9, step 170: 0.237125
Average train loss at epoch 9, step 180: 0.129678
Average train loss at epoch 9, step 190: 0.139308
Average train loss at epoch 9, step 200: 0.100668
Average train loss at epoch 9, step 210: 0.096770
Average train loss at epoch 9, step 220: 0.106101
Average train loss at epoch 9, step 230: 0.126993
Average train loss at epoch 9, step 240: 0.110801
Average train loss at epoch 9, step 250: 0.096252
Average train loss at epoch 9, step 260: 0.152647
Average train loss at epoch 9, step 270: 0.088540
[Epoch 9] Average train loss: 0.10088263206037035
Input Sentence : ['show', 'me', 'a', 'list', 'of', 'flights', 'on', 'american', 'airlines', 'from', 'boston', 'to', 'dc', 'on', 'july', 'twenty', 'second']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-airline_name', 'I-airline_name', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.state_code', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number', 'I-depart_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-airline_name', 'I-airline_name', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.state_code', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number', 'I-depart_date.day_number']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 9: 0.9616935483870968
Slot accuracy for epoch 9: 0.9641985129213733
Slot F1 score for epoch 9: 0.9638596801272422
Average train loss at epoch 10, step 0: 0.057506
Average train loss at epoch 10, step 10: 0.064836
Average train loss at epoch 10, step 20: 0.058259
Average train loss at epoch 10, step 30: 0.065952
Average train loss at epoch 10, step 40: 0.050462
Average train loss at epoch 10, step 50: 0.089940
Average train loss at epoch 10, step 60: 0.093162
Average train loss at epoch 10, step 70: 0.149257
Average train loss at epoch 10, step 80: 0.087106
Average train loss at epoch 10, step 90: 0.077015
Average train loss at epoch 10, step 100: 0.067143
Average train loss at epoch 10, step 110: 0.085158
Average train loss at epoch 10, step 120: 0.088293
Average train loss at epoch 10, step 130: 0.065154
Average train loss at epoch 10, step 140: 0.078091
Average train loss at epoch 10, step 150: 0.096647
Average train loss at epoch 10, step 160: 0.089938
Average train loss at epoch 10, step 170: 0.054962
Average train loss at epoch 10, step 180: 0.108641
Average train loss at epoch 10, step 190: 0.097060
Average train loss at epoch 10, step 200: 0.081928
Average train loss at epoch 10, step 210: 0.074843
Average train loss at epoch 10, step 220: 0.092939
Average train loss at epoch 10, step 230: 0.118112
Average train loss at epoch 10, step 240: 0.065981
Average train loss at epoch 10, step 250: 0.058399
Average train loss at epoch 10, step 260: 0.148250
Average train loss at epoch 10, step 270: 0.092778
[Epoch 10] Average train loss: 0.08558638457969953
Input Sentence : ['list', 'the', 'fares', 'of', 'midway', 'airlines', 'flights', 'from', 'boston', 'to', 'philadelphia']
Slot Truth : ['O', 'O', 'O', 'O', 'B-airline_name', 'I-airline_name', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-airline_code', 'I-airline_name', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_airfare
Intent Prediction : atis_airfare
Intent accuracy for epoch 10: 0.9637096774193549
Slot accuracy for epoch 10: 0.9659356128240415
Slot F1 score for epoch 10: 0.9661869868455901
Average train loss at epoch 11, step 0: 0.090437
Average train loss at epoch 11, step 10: 0.045887
Average train loss at epoch 11, step 20: 0.048201
Average train loss at epoch 11, step 30: 0.053547
Average train loss at epoch 11, step 40: 0.057034
Average train loss at epoch 11, step 50: 0.057146
Average train loss at epoch 11, step 60: 0.071321
Average train loss at epoch 11, step 70: 0.096005
Average train loss at epoch 11, step 80: 0.057278
Average train loss at epoch 11, step 90: 0.046872
Average train loss at epoch 11, step 100: 0.067345
Average train loss at epoch 11, step 110: 0.067413
Average train loss at epoch 11, step 120: 0.063963
Average train loss at epoch 11, step 130: 0.054727
Average train loss at epoch 11, step 140: 0.051320
Average train loss at epoch 11, step 150: 0.061948
Average train loss at epoch 11, step 160: 0.059482
Average train loss at epoch 11, step 170: 0.060339
Average train loss at epoch 11, step 180: 0.038378
Average train loss at epoch 11, step 190: 0.046182
Average train loss at epoch 11, step 200: 0.049715
Average train loss at epoch 11, step 210: 0.040857
Average train loss at epoch 11, step 220: 0.066357
Average train loss at epoch 11, step 230: 0.093081
Average train loss at epoch 11, step 240: 0.090507
Average train loss at epoch 11, step 250: 0.072843
Average train loss at epoch 11, step 260: 0.071209
Average train loss at epoch 11, step 270: 0.065730
[Epoch 11] Average train loss: 0.06215851713392523
Input Sentence : ['give', 'me', 'information', 'on', 'flights', 'from', 'atlanta', 'to', 'washington', 'dc', 'on', 'wednesday', 'after', '4', 'pm', 'and', 'thursday', 'before', '9', 'am']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_code', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_code', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 11: 0.9657258064516129
Slot accuracy for epoch 11: 0.9694951806509141
Slot F1 score for epoch 11: 0.9683241904087772
Average train loss at epoch 12, step 0: 0.027543
Average train loss at epoch 12, step 10: 0.034042
Average train loss at epoch 12, step 20: 0.039300
Average train loss at epoch 12, step 30: 0.039878
Average train loss at epoch 12, step 40: 0.039115
Average train loss at epoch 12, step 50: 0.025670
Average train loss at epoch 12, step 60: 0.043728
Average train loss at epoch 12, step 70: 0.048214
Average train loss at epoch 12, step 80: 0.036764
Average train loss at epoch 12, step 90: 0.038555
Average train loss at epoch 12, step 100: 0.053589
Average train loss at epoch 12, step 110: 0.038250
Average train loss at epoch 12, step 120: 0.035740
Average train loss at epoch 12, step 130: 0.058656
Average train loss at epoch 12, step 140: 0.041694
Average train loss at epoch 12, step 150: 0.042503
Average train loss at epoch 12, step 160: 0.056443
Average train loss at epoch 12, step 170: 0.061347
Average train loss at epoch 12, step 180: 0.048053
Average train loss at epoch 12, step 190: 0.097939
Average train loss at epoch 12, step 200: 0.114660
Average train loss at epoch 12, step 210: 0.064729
Average train loss at epoch 12, step 220: 0.078587
Average train loss at epoch 12, step 230: 0.054244
Average train loss at epoch 12, step 240: 0.072219
Average train loss at epoch 12, step 250: 0.081582
Average train loss at epoch 12, step 260: 0.056005
Average train loss at epoch 12, step 270: 0.056465
[Epoch 12] Average train loss: 0.05403926984931085
Input Sentence : ['on', 'thursday', "i'd", 'like', 'a', 'flight', 'from', 'st.', 'petersburg', 'to', 'miami']
Slot Truth : ['O', 'B-depart_date.day_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'B-depart_date.day_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 12: 0.9576612903225806
Slot accuracy for epoch 12: 0.9676206431561856
Slot F1 score for epoch 12: 0.9674789543642002
Average train loss at epoch 13, step 0: 0.080024
Average train loss at epoch 13, step 10: 0.026971
Average train loss at epoch 13, step 20: 0.022070
Average train loss at epoch 13, step 30: 0.053747
Average train loss at epoch 13, step 40: 0.029316
Average train loss at epoch 13, step 50: 0.028761
Average train loss at epoch 13, step 60: 0.039542
Average train loss at epoch 13, step 70: 0.038502
Average train loss at epoch 13, step 80: 0.042908
Average train loss at epoch 13, step 90: 0.032180
Average train loss at epoch 13, step 100: 0.053276
Average train loss at epoch 13, step 110: 0.041697
Average train loss at epoch 13, step 120: 0.050530
Average train loss at epoch 13, step 130: 0.044990
Average train loss at epoch 13, step 140: 0.038949
Average train loss at epoch 13, step 150: 0.051255
Average train loss at epoch 13, step 160: 0.035665
Average train loss at epoch 13, step 170: 0.030100
Average train loss at epoch 13, step 180: 0.027956
Average train loss at epoch 13, step 190: 0.029009
Average train loss at epoch 13, step 200: 0.032380
Average train loss at epoch 13, step 210: 0.045514
Average train loss at epoch 13, step 220: 0.030177
Average train loss at epoch 13, step 230: 0.034314
Average train loss at epoch 13, step 240: 0.051635
Average train loss at epoch 13, step 250: 0.036927
Average train loss at epoch 13, step 260: 0.040567
Average train loss at epoch 13, step 270: 0.056816
[Epoch 13] Average train loss: 0.03909732699961699
Input Sentence : ['display', 'all', 'flights', 'from', 'pittsburgh', 'to', 'san', 'francisco', 'on', 'august', 'second']
Slot Truth : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 13: 0.9596774193548387
Slot accuracy for epoch 13: 0.9674605299387842
Slot F1 score for epoch 13: 0.9674057062096988
Average train loss at epoch 14, step 0: 0.014245
Average train loss at epoch 14, step 10: 0.048210
Average train loss at epoch 14, step 20: 0.046255
Average train loss at epoch 14, step 30: 0.032257
Average train loss at epoch 14, step 40: 0.041896
Average train loss at epoch 14, step 50: 0.037297
Average train loss at epoch 14, step 60: 0.031211
Average train loss at epoch 14, step 70: 0.034859
Average train loss at epoch 14, step 80: 0.028349
Average train loss at epoch 14, step 90: 0.032608
Average train loss at epoch 14, step 100: 0.049260
Average train loss at epoch 14, step 110: 0.047343
Average train loss at epoch 14, step 120: 0.056307
Average train loss at epoch 14, step 130: 0.024591
Average train loss at epoch 14, step 140: 0.022080
Average train loss at epoch 14, step 150: 0.046239
Average train loss at epoch 14, step 160: 0.036745
Average train loss at epoch 14, step 170: 0.024861
Average train loss at epoch 14, step 180: 0.031219
Average train loss at epoch 14, step 190: 0.040124
Average train loss at epoch 14, step 200: 0.019885
Average train loss at epoch 14, step 210: 0.074869
Average train loss at epoch 14, step 220: 0.065207
Average train loss at epoch 14, step 230: 0.146478
Average train loss at epoch 14, step 240: 0.060242
Average train loss at epoch 14, step 250: 0.043928
Average train loss at epoch 14, step 260: 0.029400
Average train loss at epoch 14, step 270: 0.124319
[Epoch 14] Average train loss: 0.04722311312339426
Input Sentence : ['i', 'need', 'a', 'flight', 'from', 'san', 'francisco', 'to', 'pittsburgh', 'and', 'then', 'pittsburgh', 'to', 'new', 'york', 'and', 'new', 'york', 'to', 'san', 'francisco']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-toloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 14: 0.969758064516129
Slot accuracy for epoch 14: 0.9713209336482291
Slot F1 score for epoch 14: 0.9711912336514669
Average train loss at epoch 15, step 0: 0.019832
Average train loss at epoch 15, step 10: 0.056807
Average train loss at epoch 15, step 20: 0.047652
Average train loss at epoch 15, step 30: 0.037568
Average train loss at epoch 15, step 40: 0.054000
Average train loss at epoch 15, step 50: 0.049854
Average train loss at epoch 15, step 60: 0.038444
Average train loss at epoch 15, step 70: 0.039145
Average train loss at epoch 15, step 80: 0.039839
Average train loss at epoch 15, step 90: 0.036676
Average train loss at epoch 15, step 100: 0.036410
Average train loss at epoch 15, step 110: 0.029009
Average train loss at epoch 15, step 120: 0.036190
Average train loss at epoch 15, step 130: 0.022928
Average train loss at epoch 15, step 140: 0.026823
Average train loss at epoch 15, step 150: 0.027221
Average train loss at epoch 15, step 160: 0.064311
Average train loss at epoch 15, step 170: 0.035124
Average train loss at epoch 15, step 180: 0.042737
Average train loss at epoch 15, step 190: 0.039115
Average train loss at epoch 15, step 200: 0.024561
Average train loss at epoch 15, step 210: 0.027326
Average train loss at epoch 15, step 220: 0.035002
Average train loss at epoch 15, step 230: 0.041291
Average train loss at epoch 15, step 240: 0.063390
Average train loss at epoch 15, step 250: 0.053936
Average train loss at epoch 15, step 260: 0.051994
Average train loss at epoch 15, step 270: 0.035862
[Epoch 15] Average train loss: 0.04078326693662579
Input Sentence : ['what', 'is', 'the', 'first', 'flight', 'from', 'atlanta', 'to', 'baltimore', 'that', 'serves', 'lunch']
Slot Truth : ['O', 'O', 'O', 'B-flight_mod', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-meal_description']
Slot Prediction : ['O', 'O', 'O', 'B-flight_mod', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-meal_description']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 15: 0.9637096774193549
Slot accuracy for epoch 15: 0.9704162465378487
Slot F1 score for epoch 15: 0.9696379569797291
Average train loss at epoch 16, step 0: 0.036669
Average train loss at epoch 16, step 10: 0.018828
Average train loss at epoch 16, step 20: 0.042189
Average train loss at epoch 16, step 30: 0.024866
Average train loss at epoch 16, step 40: 0.028839
Average train loss at epoch 16, step 50: 0.018547
Average train loss at epoch 16, step 60: 0.026783
Average train loss at epoch 16, step 70: 0.025657
Average train loss at epoch 16, step 80: 0.056875
Average train loss at epoch 16, step 90: 0.021849
Average train loss at epoch 16, step 100: 0.030216
Average train loss at epoch 16, step 110: 0.024109
Average train loss at epoch 16, step 120: 0.024825
Average train loss at epoch 16, step 130: 0.020941
Average train loss at epoch 16, step 140: 0.027923
Average train loss at epoch 16, step 150: 0.026772
Average train loss at epoch 16, step 160: 0.019839
Average train loss at epoch 16, step 170: 0.016037
Average train loss at epoch 16, step 180: 0.026736
Average train loss at epoch 16, step 190: 0.027905
Average train loss at epoch 16, step 200: 0.021666
Average train loss at epoch 16, step 210: 0.017939
Average train loss at epoch 16, step 220: 0.018624
Average train loss at epoch 16, step 230: 0.042233
Average train loss at epoch 16, step 240: 0.022216
Average train loss at epoch 16, step 250: 0.023153
Average train loss at epoch 16, step 260: 0.014839
Average train loss at epoch 16, step 270: 0.018945
[Epoch 16] Average train loss: 0.025684569667737703
Input Sentence : ['which', 'airlines', 'have', 'flights', 'between', 'philadelphia', 'and', 'pittsburgh']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_airline
Intent Prediction : atis_airline
Intent accuracy for epoch 16: 0.9637096774193549
Slot accuracy for epoch 16: 0.9738918068595048
Slot F1 score for epoch 16: 0.9734654165929594
Average train loss at epoch 17, step 0: 0.020185
Average train loss at epoch 17, step 10: 0.015448
Average train loss at epoch 17, step 20: 0.036749
Average train loss at epoch 17, step 30: 0.017599
Average train loss at epoch 17, step 40: 0.023427
Average train loss at epoch 17, step 50: 0.012459
Average train loss at epoch 17, step 60: 0.011984
Average train loss at epoch 17, step 70: 0.030225
Average train loss at epoch 17, step 80: 0.014714
Average train loss at epoch 17, step 90: 0.012691
Average train loss at epoch 17, step 100: 0.011399
Average train loss at epoch 17, step 110: 0.017688
Average train loss at epoch 17, step 120: 0.014782
Average train loss at epoch 17, step 130: 0.015359
Average train loss at epoch 17, step 140: 0.015747
Average train loss at epoch 17, step 150: 0.037733
Average train loss at epoch 17, step 160: 0.037968
Average train loss at epoch 17, step 170: 0.018873
Average train loss at epoch 17, step 180: 0.014224
Average train loss at epoch 17, step 190: 0.020438
Average train loss at epoch 17, step 200: 0.023461
Average train loss at epoch 17, step 210: 0.016335
Average train loss at epoch 17, step 220: 0.014508
Average train loss at epoch 17, step 230: 0.015614
Average train loss at epoch 17, step 240: 0.028820
Average train loss at epoch 17, step 250: 0.017550
Average train loss at epoch 17, step 260: 0.012190
Average train loss at epoch 17, step 270: 0.017432
[Epoch 17] Average train loss: 0.019763558756269676
Input Sentence : ['what', 'is', 'the', 'fare', 'from', 'atlanta', 'to', 'boston', 'on', 'coach', 'one', 'way']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-class_type', 'B-round_trip', 'I-round_trip']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-class_type', 'I-class_type', 'I-round_trip']
Intent Truth : atis_airfare
Intent Prediction : atis_airfare
Intent accuracy for epoch 17: 0.9616935483870968
Slot accuracy for epoch 17: 0.9736920496625947
Slot F1 score for epoch 17: 0.9729969012837539
Average train loss at epoch 18, step 0: 0.006000
Average train loss at epoch 18, step 10: 0.012223
Average train loss at epoch 18, step 20: 0.007201
Average train loss at epoch 18, step 30: 0.011228
Average train loss at epoch 18, step 40: 0.011340
Average train loss at epoch 18, step 50: 0.009279
Average train loss at epoch 18, step 60: 0.031329
Average train loss at epoch 18, step 70: 0.011476
Average train loss at epoch 18, step 80: 0.016576
Average train loss at epoch 18, step 90: 0.015969
Average train loss at epoch 18, step 100: 0.018991
Average train loss at epoch 18, step 110: 0.032542
Average train loss at epoch 18, step 120: 0.019694
Average train loss at epoch 18, step 130: 0.015138
Average train loss at epoch 18, step 140: 0.016095
Average train loss at epoch 18, step 150: 0.031162
Average train loss at epoch 18, step 160: 0.024558
Average train loss at epoch 18, step 170: 0.038129
Average train loss at epoch 18, step 180: 0.044243
Average train loss at epoch 18, step 190: 0.018134
Average train loss at epoch 18, step 200: 0.024380
Average train loss at epoch 18, step 210: 0.023097
Average train loss at epoch 18, step 220: 0.018369
Average train loss at epoch 18, step 230: 0.024343
Average train loss at epoch 18, step 240: 0.044280
Average train loss at epoch 18, step 250: 0.023395
Average train loss at epoch 18, step 260: 0.026500
Average train loss at epoch 18, step 270: 0.033080
[Epoch 18] Average train loss: 0.022673118791516244
Input Sentence : ['can', 'you', 'list', 'all', 'flights', 'that', 'depart', 'from', 'orlando', 'to', 'kansas', 'city']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 18: 0.9657258064516129
Slot accuracy for epoch 18: 0.9738438584839821
Slot F1 score for epoch 18: 0.9737748344370862
Average train loss at epoch 19, step 0: 0.002912
Average train loss at epoch 19, step 10: 0.014199
Average train loss at epoch 19, step 20: 0.022596
Average train loss at epoch 19, step 30: 0.017078
Average train loss at epoch 19, step 40: 0.016197
Average train loss at epoch 19, step 50: 0.014878
Average train loss at epoch 19, step 60: 0.015551
Average train loss at epoch 19, step 70: 0.017922
Average train loss at epoch 19, step 80: 0.010173
Average train loss at epoch 19, step 90: 0.028216
Average train loss at epoch 19, step 100: 0.013303
Average train loss at epoch 19, step 110: 0.016847
Average train loss at epoch 19, step 120: 0.015368
Average train loss at epoch 19, step 130: 0.029448
Average train loss at epoch 19, step 140: 0.011103
Average train loss at epoch 19, step 150: 0.023864
Average train loss at epoch 19, step 160: 0.014803
Average train loss at epoch 19, step 170: 0.012375
Average train loss at epoch 19, step 180: 0.013754
Average train loss at epoch 19, step 190: 0.016494
Average train loss at epoch 19, step 200: 0.027424
Average train loss at epoch 19, step 210: 0.024605
Average train loss at epoch 19, step 220: 0.021292
Average train loss at epoch 19, step 230: 0.025621
Average train loss at epoch 19, step 240: 0.018584
Average train loss at epoch 19, step 250: 0.028127
Average train loss at epoch 19, step 260: 0.016583
Average train loss at epoch 19, step 270: 0.036246
[Epoch 19] Average train loss: 0.01907866040585182
Input Sentence : ["what's", 'the', 'most', 'expensive', 'way', 'i', 'can', 'fly', 'to', 'washington']
Slot Truth : ['O', 'O', 'B-cost_relative', 'I-cost_relative', 'O', 'O', 'O', 'O', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'B-cost_relative', 'I-cost_relative', 'O', 'O', 'O', 'O', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 19: 0.9657258064516129
Slot accuracy for epoch 19: 0.9740533916518362
Slot F1 score for epoch 19: 0.9737794649951443
Average train loss at epoch 20, step 0: 0.003061
Average train loss at epoch 20, step 10: 0.015690
Average train loss at epoch 20, step 20: 0.015875
Average train loss at epoch 20, step 30: 0.011535
Average train loss at epoch 20, step 40: 0.011043
Average train loss at epoch 20, step 50: 0.011194
Average train loss at epoch 20, step 60: 0.011777
Average train loss at epoch 20, step 70: 0.008673
Average train loss at epoch 20, step 80: 0.011735
Average train loss at epoch 20, step 90: 0.007544
Average train loss at epoch 20, step 100: 0.005171
Average train loss at epoch 20, step 110: 0.005835
Average train loss at epoch 20, step 120: 0.006894
Average train loss at epoch 20, step 130: 0.005558
Average train loss at epoch 20, step 140: 0.012910
Average train loss at epoch 20, step 150: 0.004763
Average train loss at epoch 20, step 160: 0.010019
Average train loss at epoch 20, step 170: 0.006914
Average train loss at epoch 20, step 180: 0.009308
Average train loss at epoch 20, step 190: 0.008425
Average train loss at epoch 20, step 200: 0.011148
Average train loss at epoch 20, step 210: 0.013040
Average train loss at epoch 20, step 220: 0.007977
Average train loss at epoch 20, step 230: 0.020154
Average train loss at epoch 20, step 240: 0.005118
Average train loss at epoch 20, step 250: 0.010465
Average train loss at epoch 20, step 260: 0.025210
Average train loss at epoch 20, step 270: 0.010317
[Epoch 20] Average train loss: 0.010529694721348064
Input Sentence : ['show', 'prices', 'for', 'all', 'flights', 'from', 'baltimore', 'to', 'dallas', 'on', 'july', 'twenty', 'ninth']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number', 'I-depart_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number', 'I-depart_date.day_number']
Intent Truth : atis_airfare
Intent Prediction : atis_airfare
Intent accuracy for epoch 20: 0.9657258064516129
Slot accuracy for epoch 20: 0.9752131083539649
Slot F1 score for epoch 20: 0.9749180182575556
Average train loss at epoch 21, step 0: 0.248291
Average train loss at epoch 21, step 10: 0.012855
Average train loss at epoch 21, step 20: 0.016189
Average train loss at epoch 21, step 30: 0.011410
Average train loss at epoch 21, step 40: 0.007540
Average train loss at epoch 21, step 50: 0.013190
Average train loss at epoch 21, step 60: 0.013067
Average train loss at epoch 21, step 70: 0.007484
Average train loss at epoch 21, step 80: 0.006790
Average train loss at epoch 21, step 90: 0.012484
Average train loss at epoch 21, step 100: 0.004811
Average train loss at epoch 21, step 110: 0.005206
Average train loss at epoch 21, step 120: 0.004177
Average train loss at epoch 21, step 130: 0.017488
Average train loss at epoch 21, step 140: 0.009943
Average train loss at epoch 21, step 150: 0.009010
Average train loss at epoch 21, step 160: 0.005503
Average train loss at epoch 21, step 170: 0.012261
Average train loss at epoch 21, step 180: 0.014956
Average train loss at epoch 21, step 190: 0.009109
Average train loss at epoch 21, step 200: 0.006909
Average train loss at epoch 21, step 210: 0.010592
Average train loss at epoch 21, step 220: 0.010237
Average train loss at epoch 21, step 230: 0.006558
Average train loss at epoch 21, step 240: 0.011343
Average train loss at epoch 21, step 250: 0.006159
Average train loss at epoch 21, step 260: 0.019964
Average train loss at epoch 21, step 270: 0.013256
[Epoch 21] Average train loss: 0.011111396504127952
Input Sentence : ['give', 'me', 'morning', 'flights', 'from', 'charlotte', 'to', 'baltimore']
Slot Truth : ['O', 'O', 'B-depart_time.period_of_day', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'B-depart_time.period_of_day', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 21: 0.967741935483871
Slot accuracy for epoch 21: 0.9765058311462699
Slot F1 score for epoch 21: 0.9764726693790907
Average train loss at epoch 22, step 0: 0.007066
Average train loss at epoch 22, step 10: 0.006406
Average train loss at epoch 22, step 20: 0.013059
Average train loss at epoch 22, step 30: 0.006776
Average train loss at epoch 22, step 40: 0.004607
Average train loss at epoch 22, step 50: 0.011944
Average train loss at epoch 22, step 60: 0.005195
Average train loss at epoch 22, step 70: 0.022179
Average train loss at epoch 22, step 80: 0.008620
Average train loss at epoch 22, step 90: 0.004961
Average train loss at epoch 22, step 100: 0.014132
Average train loss at epoch 22, step 110: 0.027150
Average train loss at epoch 22, step 120: 0.006504
Average train loss at epoch 22, step 130: 0.004598
Average train loss at epoch 22, step 140: 0.008132
Average train loss at epoch 22, step 150: 0.009750
Average train loss at epoch 22, step 160: 0.011059
Average train loss at epoch 22, step 170: 0.004891
Average train loss at epoch 22, step 180: 0.020565
Average train loss at epoch 22, step 190: 0.019746
Average train loss at epoch 22, step 200: 0.010185
Average train loss at epoch 22, step 210: 0.012450
Average train loss at epoch 22, step 220: 0.006666
Average train loss at epoch 22, step 230: 0.018045
Average train loss at epoch 22, step 240: 0.021706
Average train loss at epoch 22, step 250: 0.009054
Average train loss at epoch 22, step 260: 0.013420
Average train loss at epoch 22, step 270: 0.011817
[Epoch 22] Average train loss: 0.011622142448927873
Input Sentence : ['show', 'me', 'flights', 'from', 'boston', 'to', 'washington', 'leaving', 'july', '<UNK>']
Slot Truth : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 22: 0.967741935483871
Slot accuracy for epoch 22: 0.976017129674294
Slot F1 score for epoch 22: 0.9757302974141736
Average train loss at epoch 23, step 0: 0.002031
Average train loss at epoch 23, step 10: 0.004839
Average train loss at epoch 23, step 20: 0.009436
Average train loss at epoch 23, step 30: 0.007233
Average train loss at epoch 23, step 40: 0.003145
Average train loss at epoch 23, step 50: 0.006475
Average train loss at epoch 23, step 60: 0.004077
Average train loss at epoch 23, step 70: 0.005113
Average train loss at epoch 23, step 80: 0.010001
Average train loss at epoch 23, step 90: 0.004650
Average train loss at epoch 23, step 100: 0.004278
Average train loss at epoch 23, step 110: 0.006452
Average train loss at epoch 23, step 120: 0.004308
Average train loss at epoch 23, step 130: 0.006282
Average train loss at epoch 23, step 140: 0.007403
Average train loss at epoch 23, step 150: 0.018865
Average train loss at epoch 23, step 160: 0.011670
Average train loss at epoch 23, step 170: 0.016844
Average train loss at epoch 23, step 180: 0.008917
Average train loss at epoch 23, step 190: 0.012193
Average train loss at epoch 23, step 200: 0.009647
Average train loss at epoch 23, step 210: 0.021288
Average train loss at epoch 23, step 220: 0.010716
Average train loss at epoch 23, step 230: 0.021081
Average train loss at epoch 23, step 240: 0.018961
Average train loss at epoch 23, step 250: 0.012005
Average train loss at epoch 23, step 260: 0.014445
Average train loss at epoch 23, step 270: 0.025609
[Epoch 23] Average train loss: 0.010937444610445256
Input Sentence : ['what', 'is', 'fare', 'class', 'h']
Slot Truth : ['O', 'O', 'O', 'O', 'B-fare_basis_code']
Slot Prediction : ['O', 'O', 'O', 'B-cost_relative', 'B-fare_basis_code']
Intent Truth : atis_abbreviation
Intent Prediction : atis_abbreviation
Intent accuracy for epoch 23: 0.9616935483870968
Slot accuracy for epoch 23: 0.9725178616957766
Slot F1 score for epoch 23: 0.972652447119214
Average train loss at epoch 24, step 0: 0.015435
Average train loss at epoch 24, step 10: 0.018277
Average train loss at epoch 24, step 20: 0.020671
Average train loss at epoch 24, step 30: 0.021048
Average train loss at epoch 24, step 40: 0.012048
Average train loss at epoch 24, step 50: 0.009401
Average train loss at epoch 24, step 60: 0.039661
Average train loss at epoch 24, step 70: 0.014902
Average train loss at epoch 24, step 80: 0.013916
Average train loss at epoch 24, step 90: 0.012944
Average train loss at epoch 24, step 100: 0.011422
Average train loss at epoch 24, step 110: 0.007933
Average train loss at epoch 24, step 120: 0.022257
Average train loss at epoch 24, step 130: 0.052222
Average train loss at epoch 24, step 140: 0.027200
Average train loss at epoch 24, step 150: 0.035897
Average train loss at epoch 24, step 160: 0.044330
Average train loss at epoch 24, step 170: 0.022024
Average train loss at epoch 24, step 180: 0.033075
Average train loss at epoch 24, step 190: 0.021282
Average train loss at epoch 24, step 200: 0.036372
Average train loss at epoch 24, step 210: 0.025915
Average train loss at epoch 24, step 220: 0.038602
Average train loss at epoch 24, step 230: 0.033395
Average train loss at epoch 24, step 240: 0.023754
Average train loss at epoch 24, step 250: 0.029977
Average train loss at epoch 24, step 260: 0.094802
Average train loss at epoch 24, step 270: 0.051039
[Epoch 24] Average train loss: 0.029322519881515612
Input Sentence : ['give', 'me', 'information', 'on', 'flights', 'from', 'atlanta', 'to', 'washington', 'dc', 'on', 'wednesday', 'after', '4', 'pm', 'and', 'thursday', 'before', '9', 'am']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_code', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'B-toloc.state_code', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time', 'O', 'B-depart_date.day_name', 'B-depart_time.time_relative', 'B-depart_time.time', 'I-depart_time.time']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 24: 0.9657258064516129
Slot accuracy for epoch 24: 0.9697049444068471
Slot F1 score for epoch 24: 0.9697559250088433
Average train loss at epoch 25, step 0: 0.010022
Average train loss at epoch 25, step 10: 0.032288
Average train loss at epoch 25, step 20: 0.024835
Average train loss at epoch 25, step 30: 0.032864
Average train loss at epoch 25, step 40: 0.058787
Average train loss at epoch 25, step 50: 0.052823
Average train loss at epoch 25, step 60: 0.022200
Average train loss at epoch 25, step 70: 0.107779
Average train loss at epoch 25, step 80: 0.037592
Average train loss at epoch 25, step 90: 0.089486
Average train loss at epoch 25, step 100: 0.086794
Average train loss at epoch 25, step 110: 0.120572
Average train loss at epoch 25, step 120: 0.070776
Average train loss at epoch 25, step 130: 0.030866
Average train loss at epoch 25, step 140: 0.047122
Average train loss at epoch 25, step 150: 0.074191
Average train loss at epoch 25, step 160: 0.159370
Average train loss at epoch 25, step 170: 0.054483
Average train loss at epoch 25, step 180: 0.074248
Average train loss at epoch 25, step 190: 0.024893
Average train loss at epoch 25, step 200: 0.083146
Average train loss at epoch 25, step 210: 0.055447
Average train loss at epoch 25, step 220: 0.037999
Average train loss at epoch 25, step 230: 0.100988
Average train loss at epoch 25, step 240: 0.050811
Average train loss at epoch 25, step 250: 0.042464
Average train loss at epoch 25, step 260: 0.033671
Average train loss at epoch 25, step 270: 0.039045
[Epoch 25] Average train loss: 0.060325998841287524
Input Sentence : ['flights', 'from', 'phoenix', 'to', 'newark']
Slot Truth : ['O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 25: 0.9596774193548387
Slot accuracy for epoch 25: 0.975268964972938
Slot F1 score for epoch 25: 0.9747215838783807
Average train loss at epoch 26, step 0: 0.019843
Average train loss at epoch 26, step 10: 0.044455
Average train loss at epoch 26, step 20: 0.032283
Average train loss at epoch 26, step 30: 0.017763
Average train loss at epoch 26, step 40: 0.021739
Average train loss at epoch 26, step 50: 0.024169
Average train loss at epoch 26, step 60: 0.048804
Average train loss at epoch 26, step 70: 0.018500
Average train loss at epoch 26, step 80: 0.006752
Average train loss at epoch 26, step 90: 0.018723
Average train loss at epoch 26, step 100: 0.014755
Average train loss at epoch 26, step 110: 0.024301
Average train loss at epoch 26, step 120: 0.020245
Average train loss at epoch 26, step 130: 0.019452
Average train loss at epoch 26, step 140: 0.015886
Average train loss at epoch 26, step 150: 0.013170
Average train loss at epoch 26, step 160: 0.017548
Average train loss at epoch 26, step 170: 0.014509
Average train loss at epoch 26, step 180: 0.031750
Average train loss at epoch 26, step 190: 0.017010
Average train loss at epoch 26, step 200: 0.090508
Average train loss at epoch 26, step 210: 0.032633
Average train loss at epoch 26, step 220: 0.024805
Average train loss at epoch 26, step 230: 0.032137
Average train loss at epoch 26, step 240: 0.047898
Average train loss at epoch 26, step 250: 0.015818
Average train loss at epoch 26, step 260: 0.021133
Average train loss at epoch 26, step 270: 0.012433
[Epoch 26] Average train loss: 0.025610320375628076
Input Sentence : ['can', 'you', 'list', 'all', 'flights', 'leaving', 'from', 'st.', 'louis', 'and', 'arriving', 'in', 'milwaukee']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'O', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'O', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 26: 0.967741935483871
Slot accuracy for epoch 26: 0.9774924149957657
Slot F1 score for epoch 26: 0.9779548472775563
Average train loss at epoch 27, step 0: 0.006697
Average train loss at epoch 27, step 10: 0.009271
Average train loss at epoch 27, step 20: 0.014439
Average train loss at epoch 27, step 30: 0.015323
Average train loss at epoch 27, step 40: 0.014076
Average train loss at epoch 27, step 50: 0.005956
Average train loss at epoch 27, step 60: 0.004623
Average train loss at epoch 27, step 70: 0.005294
Average train loss at epoch 27, step 80: 0.012399
Average train loss at epoch 27, step 90: 0.008111
Average train loss at epoch 27, step 100: 0.017690
Average train loss at epoch 27, step 110: 0.007407
Average train loss at epoch 27, step 120: 0.010175
Average train loss at epoch 27, step 130: 0.005275
Average train loss at epoch 27, step 140: 0.006150
Average train loss at epoch 27, step 150: 0.008753
Average train loss at epoch 27, step 160: 0.004892
Average train loss at epoch 27, step 170: 0.008000
Average train loss at epoch 27, step 180: 0.009509
Average train loss at epoch 27, step 190: 0.005686
Average train loss at epoch 27, step 200: 0.005063
Average train loss at epoch 27, step 210: 0.006054
Average train loss at epoch 27, step 220: 0.003709
Average train loss at epoch 27, step 230: 0.003283
Average train loss at epoch 27, step 240: 0.005045
Average train loss at epoch 27, step 250: 0.005336
Average train loss at epoch 27, step 260: 0.011170
Average train loss at epoch 27, step 270: 0.005564
[Epoch 27] Average train loss: 0.008533686176226157
Input Sentence : ['show', 'me', 'the', 'united', 'airlines', 'flights', 'from', 'denver', 'to', 'baltimore', 'leaving', 'on', 'june', 'fourteenth']
Slot Truth : ['O', 'O', 'O', 'B-airline_name', 'I-airline_name', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Slot Prediction : ['O', 'O', 'O', 'B-airline_name', 'I-airline_name', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-depart_date.month_name', 'B-depart_date.day_number']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 27: 0.9657258064516129
Slot accuracy for epoch 27: 0.9771690790222614
Slot F1 score for epoch 27: 0.9773731659890401
Average train loss at epoch 28, step 0: 0.001396
Average train loss at epoch 28, step 10: 0.002792
Average train loss at epoch 28, step 20: 0.008359
Average train loss at epoch 28, step 30: 0.002651
Average train loss at epoch 28, step 40: 0.007282
Average train loss at epoch 28, step 50: 0.004588
Average train loss at epoch 28, step 60: 0.005353
Average train loss at epoch 28, step 70: 0.003447
Average train loss at epoch 28, step 80: 0.006324
Average train loss at epoch 28, step 90: 0.003723
Average train loss at epoch 28, step 100: 0.002641
Average train loss at epoch 28, step 110: 0.007702
Average train loss at epoch 28, step 120: 0.009795
Average train loss at epoch 28, step 130: 0.005640
Average train loss at epoch 28, step 140: 0.001987
Average train loss at epoch 28, step 150: 0.007539
Average train loss at epoch 28, step 160: 0.002888
Average train loss at epoch 28, step 170: 0.002400
Average train loss at epoch 28, step 180: 0.004866
Average train loss at epoch 28, step 190: 0.009354
Average train loss at epoch 28, step 200: 0.008055
Average train loss at epoch 28, step 210: 0.004342
Average train loss at epoch 28, step 220: 0.003001
Average train loss at epoch 28, step 230: 0.010016
Average train loss at epoch 28, step 240: 0.003798
Average train loss at epoch 28, step 250: 0.004825
Average train loss at epoch 28, step 260: 0.004554
Average train loss at epoch 28, step 270: 0.027764
[Epoch 28] Average train loss: 0.006001654748400543
Input Sentence : ['in', 'new', 'york', "i'll", 'need', 'to', 'rent', 'a', 'car']
Slot Truth : ['O', 'B-city_name', 'I-city_name', 'O', 'O', 'O', 'O', 'O', 'B-transport_type']
Slot Prediction : ['O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'O', 'O', 'O', 'O', 'O']
Intent Truth : atis_ground_service
Intent Prediction : atis_flight
Intent accuracy for epoch 28: 0.9657258064516129
Slot accuracy for epoch 28: 0.977408223546554
Slot F1 score for epoch 28: 0.9772465692784418
Average train loss at epoch 29, step 0: 0.006912
Average train loss at epoch 29, step 10: 0.008918
Average train loss at epoch 29, step 20: 0.001773
Average train loss at epoch 29, step 30: 0.002763
Average train loss at epoch 29, step 40: 0.003024
Average train loss at epoch 29, step 50: 0.003416
Average train loss at epoch 29, step 60: 0.004213
Average train loss at epoch 29, step 70: 0.002129
Average train loss at epoch 29, step 80: 0.002763
Average train loss at epoch 29, step 90: 0.001780
Average train loss at epoch 29, step 100: 0.002042
Average train loss at epoch 29, step 110: 0.002634
Average train loss at epoch 29, step 120: 0.002713
Average train loss at epoch 29, step 130: 0.001765
Average train loss at epoch 29, step 140: 0.002279
Average train loss at epoch 29, step 150: 0.003028
Average train loss at epoch 29, step 160: 0.002136
Average train loss at epoch 29, step 170: 0.002541
Average train loss at epoch 29, step 180: 0.001705
Average train loss at epoch 29, step 190: 0.001977
Average train loss at epoch 29, step 200: 0.002292
Average train loss at epoch 29, step 210: 0.001093
Average train loss at epoch 29, step 220: 0.001614
Average train loss at epoch 29, step 230: 0.002977
Average train loss at epoch 29, step 240: 0.007170
Average train loss at epoch 29, step 250: 0.004322
Average train loss at epoch 29, step 260: 0.002690
Average train loss at epoch 29, step 270: 0.011819
[Epoch 29] Average train loss: 0.0032372615940820452
Input Sentence : ['what', 'flights', 'are', 'there', 'from', 'minneapolis', 'to', 'chicago']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 29: 0.9637096774193549
Slot accuracy for epoch 29: 0.9786174614191451
Slot F1 score for epoch 29: 0.9789455060155697
Average train loss at epoch 30, step 0: 0.001727
Average train loss at epoch 30, step 10: 0.001942
Average train loss at epoch 30, step 20: 0.004045
Average train loss at epoch 30, step 30: 0.001782
Average train loss at epoch 30, step 40: 0.002729
Average train loss at epoch 30, step 50: 0.001644
Average train loss at epoch 30, step 60: 0.003038
Average train loss at epoch 30, step 70: 0.004927
Average train loss at epoch 30, step 80: 0.001816
Average train loss at epoch 30, step 90: 0.003731
Average train loss at epoch 30, step 100: 0.002121
Average train loss at epoch 30, step 110: 0.001434
Average train loss at epoch 30, step 120: 0.001978
Average train loss at epoch 30, step 130: 0.002166
Average train loss at epoch 30, step 140: 0.001257
Average train loss at epoch 30, step 150: 0.001390
Average train loss at epoch 30, step 160: 0.004921
Average train loss at epoch 30, step 170: 0.002387
Average train loss at epoch 30, step 180: 0.001720
Average train loss at epoch 30, step 190: 0.004879
Average train loss at epoch 30, step 200: 0.001058
Average train loss at epoch 30, step 210: 0.002685
Average train loss at epoch 30, step 220: 0.001512
Average train loss at epoch 30, step 230: 0.000964
Average train loss at epoch 30, step 240: 0.001151
Average train loss at epoch 30, step 250: 0.001467
Average train loss at epoch 30, step 260: 0.001640
Average train loss at epoch 30, step 270: 0.002040
[Epoch 30] Average train loss: 0.002975001502195857
Input Sentence : ['what', 'airlines', 'have', 'business', 'class']
Slot Truth : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Slot Prediction : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Intent Truth : atis_airline
Intent Prediction : atis_airline
Intent accuracy for epoch 30: 0.9616935483870968
Slot accuracy for epoch 30: 0.9793612160978026
Slot F1 score for epoch 30: 0.9793723554301833
Average train loss at epoch 31, step 0: 0.001036
Average train loss at epoch 31, step 10: 0.000818
Average train loss at epoch 31, step 20: 0.000847
Average train loss at epoch 31, step 30: 0.000729
Average train loss at epoch 31, step 40: 0.000872
Average train loss at epoch 31, step 50: 0.001094
Average train loss at epoch 31, step 60: 0.001378
Average train loss at epoch 31, step 70: 0.000683
Average train loss at epoch 31, step 80: 0.000703
Average train loss at epoch 31, step 90: 0.015509
Average train loss at epoch 31, step 100: 0.000943
Average train loss at epoch 31, step 110: 0.013991
Average train loss at epoch 31, step 120: 0.000555
Average train loss at epoch 31, step 130: 0.000659
Average train loss at epoch 31, step 140: 0.000660
Average train loss at epoch 31, step 150: 0.001089
Average train loss at epoch 31, step 160: 0.000605
Average train loss at epoch 31, step 170: 0.000994
Average train loss at epoch 31, step 180: 0.002818
Average train loss at epoch 31, step 190: 0.001423
Average train loss at epoch 31, step 200: 0.000981
Average train loss at epoch 31, step 210: 0.000734
Average train loss at epoch 31, step 220: 0.000893
Average train loss at epoch 31, step 230: 0.002136
Average train loss at epoch 31, step 240: 0.000654
Average train loss at epoch 31, step 250: 0.004461
Average train loss at epoch 31, step 260: 0.000570
Average train loss at epoch 31, step 270: 0.001133
[Epoch 31] Average train loss: 0.002117301973558697
Input Sentence : ['what', 'airlines', 'have', 'business', 'class']
Slot Truth : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Slot Prediction : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Intent Truth : atis_airline
Intent Prediction : atis_airline
Intent accuracy for epoch 31: 0.9616935483870968
Slot accuracy for epoch 31: 0.9789653667824831
Slot F1 score for epoch 31: 0.9781628503226948
Input Sentence : ['what', 'airlines', 'have', 'business', 'class']
Slot Truth : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Slot Prediction : ['O', 'O', 'O', 'B-class_type', 'I-class_type']
Intent Truth : atis_airline
Intent Prediction : atis_airline
Intent accuracy for epoch 31: 0.9616935483870968
Slot accuracy for epoch 31: 0.9789653667824831
Slot F1 score for epoch 31: 0.9781628503226948
Average train loss at epoch 32, step 0: 0.082271
Average train loss at epoch 32, step 10: 0.000828
Average train loss at epoch 32, step 20: 0.002460
Average train loss at epoch 32, step 30: 0.000807
Average train loss at epoch 32, step 40: 0.001316
Average train loss at epoch 32, step 50: 0.001085
Average train loss at epoch 32, step 60: 0.000489
Average train loss at epoch 32, step 70: 0.000795
Average train loss at epoch 32, step 80: 0.000624
Average train loss at epoch 32, step 90: 0.003678
Average train loss at epoch 32, step 100: 0.000767
Average train loss at epoch 32, step 110: 0.000982
Average train loss at epoch 32, step 120: 0.000562
Average train loss at epoch 32, step 130: 0.000738
Average train loss at epoch 32, step 140: 0.000568
Average train loss at epoch 32, step 150: 0.013705
Average train loss at epoch 32, step 160: 0.000527
Average train loss at epoch 32, step 170: 0.000677
Average train loss at epoch 32, step 180: 0.000604
Average train loss at epoch 32, step 190: 0.000531
Average train loss at epoch 32, step 200: 0.000609
Average train loss at epoch 32, step 210: 0.004773
Average train loss at epoch 32, step 220: 0.002539
Average train loss at epoch 32, step 230: 0.001079
Average train loss at epoch 32, step 240: 0.000987
Average train loss at epoch 32, step 250: 0.000784
Average train loss at epoch 32, step 260: 0.000810
Average train loss at epoch 32, step 270: 0.000704
[Epoch 32] Average train loss: 0.0020829558193441195
Input Sentence : ['give', 'me', 'flights', 'from', 'denver', 'to', 'baltimore']
Slot Truth : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 32: 0.9657258064516129
Slot accuracy for epoch 32: 0.9804678413167424
Slot F1 score for epoch 32: 0.9803055727280756
Average train loss at epoch 33, step 0: 0.000932
Average train loss at epoch 33, step 10: 0.012746
Average train loss at epoch 33, step 20: 0.001033
Average train loss at epoch 33, step 30: 0.000493
Average train loss at epoch 33, step 40: 0.000335
Average train loss at epoch 33, step 50: 0.016074
Average train loss at epoch 33, step 60: 0.000488
Average train loss at epoch 33, step 70: 0.000849
Average train loss at epoch 33, step 80: 0.000699
Average train loss at epoch 33, step 90: 0.000769
Average train loss at epoch 33, step 100: 0.001877
Average train loss at epoch 33, step 110: 0.001328
Average train loss at epoch 33, step 120: 0.000373
Average train loss at epoch 33, step 130: 0.000397
Average train loss at epoch 33, step 140: 0.000540
Average train loss at epoch 33, step 150: 0.001089
Average train loss at epoch 33, step 160: 0.000747
Average train loss at epoch 33, step 170: 0.000816
Average train loss at epoch 33, step 180: 0.000959
Average train loss at epoch 33, step 190: 0.000713
Average train loss at epoch 33, step 200: 0.000495
Average train loss at epoch 33, step 210: 0.000541
Average train loss at epoch 33, step 220: 0.000682
Average train loss at epoch 33, step 230: 0.002786
Average train loss at epoch 33, step 240: 0.000473
Average train loss at epoch 33, step 250: 0.000692
Average train loss at epoch 33, step 260: 0.000569
Average train loss at epoch 33, step 270: 0.000900
[Epoch 33] Average train loss: 0.0017877790011218532
Input Sentence : ['what', 'flights', 'are', 'available', 'from', 'pittsburgh', 'to', 'boston', 'on', 'wednesday', 'of', 'next', 'week']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.day_name', 'O', 'B-depart_date.date_relative', 'O']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-depart_date.day_name', 'O', 'B-depart_date.date_relative', 'O']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 33: 0.9657258064516129
Slot accuracy for epoch 33: 0.9810328355214977
Slot F1 score for epoch 33: 0.9808083488104713
Average train loss at epoch 34, step 0: 0.000149
Average train loss at epoch 34, step 10: 0.000363
Average train loss at epoch 34, step 20: 0.000431
Average train loss at epoch 34, step 30: 0.000335
Average train loss at epoch 34, step 40: 0.007764
Average train loss at epoch 34, step 50: 0.000475
Average train loss at epoch 34, step 60: 0.000662
Average train loss at epoch 34, step 70: 0.000580
Average train loss at epoch 34, step 80: 0.000694
Average train loss at epoch 34, step 90: 0.000460
Average train loss at epoch 34, step 100: 0.000449
Average train loss at epoch 34, step 110: 0.000600
Average train loss at epoch 34, step 120: 0.000774
Average train loss at epoch 34, step 130: 0.000712
Average train loss at epoch 34, step 140: 0.000334
Average train loss at epoch 34, step 150: 0.000339
Average train loss at epoch 34, step 160: 0.000445
Average train loss at epoch 34, step 170: 0.003164
Average train loss at epoch 34, step 180: 0.001971
Average train loss at epoch 34, step 190: 0.002798
Average train loss at epoch 34, step 200: 0.002842
Average train loss at epoch 34, step 210: 0.003890
Average train loss at epoch 34, step 220: 0.005791
Average train loss at epoch 34, step 230: 0.004597
Average train loss at epoch 34, step 240: 0.003266
Average train loss at epoch 34, step 250: 0.006498
Average train loss at epoch 34, step 260: 0.028131
Average train loss at epoch 34, step 270: 0.023064
[Epoch 34] Average train loss: 0.004583107371993762
Input Sentence : ['i', 'want', 'to', 'fly', 'from', 'denver', 'to', 'san', 'francisco', 'with', 'at', 'least', 'one', 'stop']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'O', 'O', 'B-flight_stop', 'I-flight_stop']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'O', 'O', 'B-flight_time', 'I-flight_time', 'I-flight_time']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 34: 0.9616935483870968
Slot accuracy for epoch 34: 0.9682382105709002
Slot F1 score for epoch 34: 0.9679929266136162
Average train loss at epoch 35, step 0: 0.036409
Average train loss at epoch 35, step 10: 0.081254
Average train loss at epoch 35, step 20: 0.099604
Average train loss at epoch 35, step 30: 0.074494
Average train loss at epoch 35, step 40: 0.041485
Average train loss at epoch 35, step 50: 0.033791
Average train loss at epoch 35, step 60: 0.059040
Average train loss at epoch 35, step 70: 0.079200
Average train loss at epoch 35, step 80: 0.055178
Average train loss at epoch 35, step 90: 0.080968
Average train loss at epoch 35, step 100: 0.057278
Average train loss at epoch 35, step 110: 0.046596
Average train loss at epoch 35, step 120: 0.087217
Average train loss at epoch 35, step 130: 0.061365
Average train loss at epoch 35, step 140: 0.087148
Average train loss at epoch 35, step 150: 0.086454
Average train loss at epoch 35, step 160: 0.079773
Average train loss at epoch 35, step 170: 0.098665
Average train loss at epoch 35, step 180: 0.116320
Average train loss at epoch 35, step 190: 0.084128
Average train loss at epoch 35, step 200: 0.070380
Average train loss at epoch 35, step 210: 0.055261
Average train loss at epoch 35, step 220: 0.076757
Average train loss at epoch 35, step 230: 0.122895
Average train loss at epoch 35, step 240: 0.096483
Average train loss at epoch 35, step 250: 0.031867
Average train loss at epoch 35, step 260: 0.139289
Average train loss at epoch 35, step 270: 0.060217
[Epoch 35] Average train loss: 0.07703702646644793
Input Sentence : ['what', 'are', 'the', 'flights', 'and', 'fares', 'from', 'atlanta', 'to', 'philadelphia']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight#atis_airfare
Intent Prediction : atis_flight#atis_airfare
Intent accuracy for epoch 35: 0.9556451612903226
Slot accuracy for epoch 35: 0.9725626975941148
Slot F1 score for epoch 35: 0.9729681978798587
Average train loss at epoch 36, step 0: 0.013089
Average train loss at epoch 36, step 10: 0.060648
Average train loss at epoch 36, step 20: 0.063337
Average train loss at epoch 36, step 30: 0.041129
Average train loss at epoch 36, step 40: 0.041671
Average train loss at epoch 36, step 50: 0.016690
Average train loss at epoch 36, step 60: 0.044820
Average train loss at epoch 36, step 70: 0.022702
Average train loss at epoch 36, step 80: 0.032921
Average train loss at epoch 36, step 90: 0.032665
Average train loss at epoch 36, step 100: 0.044248
Average train loss at epoch 36, step 110: 0.013940
Average train loss at epoch 36, step 120: 0.035706
Average train loss at epoch 36, step 130: 0.026703
Average train loss at epoch 36, step 140: 0.025165
Average train loss at epoch 36, step 150: 0.050930
Average train loss at epoch 36, step 160: 0.022215
Average train loss at epoch 36, step 170: 0.031991
Average train loss at epoch 36, step 180: 0.018973
Average train loss at epoch 36, step 190: 0.020266
Average train loss at epoch 36, step 200: 0.015024
Average train loss at epoch 36, step 210: 0.015599
Average train loss at epoch 36, step 220: 0.020083
Average train loss at epoch 36, step 230: 0.026796
Average train loss at epoch 36, step 240: 0.020844
Average train loss at epoch 36, step 250: 0.019137
Average train loss at epoch 36, step 260: 0.075893
Average train loss at epoch 36, step 270: 0.029712
[Epoch 36] Average train loss: 0.03193422264000568
Input Sentence : ['i', 'need', 'the', 'cost', 'of', 'a', 'ticket', 'going', 'from', 'denver', 'to', 'baltimore', 'a', 'first', 'class', 'ticket', 'on', 'united', 'airlines']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-class_type', 'I-class_type', 'O', 'O', 'B-airline_name', 'I-airline_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-class_type', 'I-class_type', 'O', 'O', 'B-airline_name', 'I-airline_name']
Intent Truth : atis_airfare
Intent Prediction : atis_airfare
Intent accuracy for epoch 36: 0.9657258064516129
Slot accuracy for epoch 36: 0.9745640727638772
Slot F1 score for epoch 36: 0.9749333333333334
Average train loss at epoch 37, step 0: 0.021752
Average train loss at epoch 37, step 10: 0.013199
Average train loss at epoch 37, step 20: 0.014832
Average train loss at epoch 37, step 30: 0.007650
Average train loss at epoch 37, step 40: 0.006772
Average train loss at epoch 37, step 50: 0.013168
Average train loss at epoch 37, step 60: 0.024948
Average train loss at epoch 37, step 70: 0.010542
Average train loss at epoch 37, step 80: 0.010576
Average train loss at epoch 37, step 90: 0.013612
Average train loss at epoch 37, step 100: 0.010042
Average train loss at epoch 37, step 110: 0.017142
Average train loss at epoch 37, step 120: 0.007908
Average train loss at epoch 37, step 130: 0.005438
Average train loss at epoch 37, step 140: 0.004653
Average train loss at epoch 37, step 150: 0.005933
Average train loss at epoch 37, step 160: 0.006859
Average train loss at epoch 37, step 170: 0.042116
Average train loss at epoch 37, step 180: 0.007112
Average train loss at epoch 37, step 190: 0.008222
Average train loss at epoch 37, step 200: 0.020510
Average train loss at epoch 37, step 210: 0.019297
Average train loss at epoch 37, step 220: 0.006445
Average train loss at epoch 37, step 230: 0.007620
Average train loss at epoch 37, step 240: 0.028645
Average train loss at epoch 37, step 250: 0.050412
Average train loss at epoch 37, step 260: 0.017016
Average train loss at epoch 37, step 270: 0.011915
[Epoch 37] Average train loss: 0.014315436145634554
Input Sentence : ['show', 'me', 'the', 'flights', 'that', 'go', 'from', 'san', 'diego', 'to', 'newark', 'with', 'one', 'stop', 'in', 'houston']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-flight_stop', 'I-flight_stop', 'O', 'B-stoploc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-flight_stop', 'I-flight_stop', 'O', 'B-stoploc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 37: 0.969758064516129
Slot accuracy for epoch 37: 0.9753915386250649
Slot F1 score for epoch 37: 0.9755665722379603
Average train loss at epoch 38, step 0: 0.001591
Average train loss at epoch 38, step 10: 0.003777
Average train loss at epoch 38, step 20: 0.013705
Average train loss at epoch 38, step 30: 0.009927
Average train loss at epoch 38, step 40: 0.010710
Average train loss at epoch 38, step 50: 0.009133
Average train loss at epoch 38, step 60: 0.012245
Average train loss at epoch 38, step 70: 0.027080
Average train loss at epoch 38, step 80: 0.002627
Average train loss at epoch 38, step 90: 0.005350
Average train loss at epoch 38, step 100: 0.002057
Average train loss at epoch 38, step 110: 0.002666
Average train loss at epoch 38, step 120: 0.005275
Average train loss at epoch 38, step 130: 0.002326
Average train loss at epoch 38, step 140: 0.008833
Average train loss at epoch 38, step 150: 0.006558
Average train loss at epoch 38, step 160: 0.011842
Average train loss at epoch 38, step 170: 0.003198
Average train loss at epoch 38, step 180: 0.003142
Average train loss at epoch 38, step 190: 0.004405
Average train loss at epoch 38, step 200: 0.003294
Average train loss at epoch 38, step 210: 0.004071
Average train loss at epoch 38, step 220: 0.010312
Average train loss at epoch 38, step 230: 0.007012
Average train loss at epoch 38, step 240: 0.001992
Average train loss at epoch 38, step 250: 0.003616
Average train loss at epoch 38, step 260: 0.002802
Average train loss at epoch 38, step 270: 0.001718
[Epoch 38] Average train loss: 0.006562304855462024
Input Sentence : ['on', 'thursday', "i'd", 'like', 'a', 'flight', 'from', 'st.', 'petersburg', 'to', 'miami']
Slot Truth : ['O', 'B-depart_date.day_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'B-depart_date.day_name', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 38: 0.969758064516129
Slot accuracy for epoch 38: 0.97759226353157
Slot F1 score for epoch 38: 0.9776482021379981
Average train loss at epoch 39, step 0: 0.000620
Average train loss at epoch 39, step 10: 0.002228
Average train loss at epoch 39, step 20: 0.001321
Average train loss at epoch 39, step 30: 0.005137
Average train loss at epoch 39, step 40: 0.003268
Average train loss at epoch 39, step 50: 0.002052
Average train loss at epoch 39, step 60: 0.001125
Average train loss at epoch 39, step 70: 0.001508
Average train loss at epoch 39, step 80: 0.003340
Average train loss at epoch 39, step 90: 0.003293
Average train loss at epoch 39, step 100: 0.001560
Average train loss at epoch 39, step 110: 0.001645
Average train loss at epoch 39, step 120: 0.001038
Average train loss at epoch 39, step 130: 0.001930
Average train loss at epoch 39, step 140: 0.001015
Average train loss at epoch 39, step 150: 0.002459
Average train loss at epoch 39, step 160: 0.001778
Average train loss at epoch 39, step 170: 0.001743
Average train loss at epoch 39, step 180: 0.001836
Average train loss at epoch 39, step 190: 0.000870
Average train loss at epoch 39, step 200: 0.001473
Average train loss at epoch 39, step 210: 0.006317
Average train loss at epoch 39, step 220: 0.002103
Average train loss at epoch 39, step 230: 0.001005
Average train loss at epoch 39, step 240: 0.001121
Average train loss at epoch 39, step 250: 0.000952
Average train loss at epoch 39, step 260: 0.001041
Average train loss at epoch 39, step 270: 0.001083
[Epoch 39] Average train loss: 0.0019743283068315597
Input Sentence : ['show', 'me', 'the', 'ground', 'transportation', 'schedule', 'in', 'philadelphia', 'in', 'the', 'morning', 'on', 'wednesday']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-city_name', 'O', 'O', 'B-period_of_day', 'O', 'B-day_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'O', 'B-city_name', 'O', 'O', 'B-period_of_day', 'O', 'B-day_name']
Intent Truth : atis_ground_service
Intent Prediction : atis_ground_service
Intent accuracy for epoch 39: 0.969758064516129
Slot accuracy for epoch 39: 0.9795945874930111
Slot F1 score for epoch 39: 0.9796098508253156
Average train loss at epoch 40, step 0: 0.000610
Average train loss at epoch 40, step 10: 0.001088
Average train loss at epoch 40, step 20: 0.000730
Average train loss at epoch 40, step 30: 0.000756
Average train loss at epoch 40, step 40: 0.001209
Average train loss at epoch 40, step 50: 0.001196
Average train loss at epoch 40, step 60: 0.000697
Average train loss at epoch 40, step 70: 0.000476
Average train loss at epoch 40, step 80: 0.000888
Average train loss at epoch 40, step 90: 0.001604
Average train loss at epoch 40, step 100: 0.000853
Average train loss at epoch 40, step 110: 0.000970
Average train loss at epoch 40, step 120: 0.001008
Average train loss at epoch 40, step 130: 0.000897
Average train loss at epoch 40, step 140: 0.000892
Average train loss at epoch 40, step 150: 0.000580
Average train loss at epoch 40, step 160: 0.000786
Average train loss at epoch 40, step 170: 0.000770
Average train loss at epoch 40, step 180: 0.000512
Average train loss at epoch 40, step 190: 0.001424
Average train loss at epoch 40, step 200: 0.000797
Average train loss at epoch 40, step 210: 0.000676
Average train loss at epoch 40, step 220: 0.002561
Average train loss at epoch 40, step 230: 0.003374
Average train loss at epoch 40, step 240: 0.000546
Average train loss at epoch 40, step 250: 0.001088
Average train loss at epoch 40, step 260: 0.000867
Average train loss at epoch 40, step 270: 0.000927
[Epoch 40] Average train loss: 0.0010426641272057156
Input Sentence : ['what', 'kind', 'of', 'airplane', 'is', 'flight', 'ua', '270', 'from', 'denver', 'to', 'philadelphia']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-airline_code', 'B-flight_number', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-airline_code', 'B-flight_number', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_aircraft
Intent Prediction : atis_aircraft
Intent accuracy for epoch 40: 0.9717741935483871
Slot accuracy for epoch 40: 0.9787205776120826
Slot F1 score for epoch 40: 0.9788289485339712
Average train loss at epoch 41, step 0: 0.000290
Average train loss at epoch 41, step 10: 0.000506
Average train loss at epoch 41, step 20: 0.000625
Average train loss at epoch 41, step 30: 0.000835
Average train loss at epoch 41, step 40: 0.000632
Average train loss at epoch 41, step 50: 0.000532
Average train loss at epoch 41, step 60: 0.000616
Average train loss at epoch 41, step 70: 0.000421
Average train loss at epoch 41, step 80: 0.000686
Average train loss at epoch 41, step 90: 0.000447
Average train loss at epoch 41, step 100: 0.000615
Average train loss at epoch 41, step 110: 0.000692
Average train loss at epoch 41, step 120: 0.000751
Average train loss at epoch 41, step 130: 0.001128
Average train loss at epoch 41, step 140: 0.000443
Average train loss at epoch 41, step 150: 0.000508
Average train loss at epoch 41, step 160: 0.000573
Average train loss at epoch 41, step 170: 0.000666
Average train loss at epoch 41, step 180: 0.000497
Average train loss at epoch 41, step 190: 0.000576
Average train loss at epoch 41, step 200: 0.000534
Average train loss at epoch 41, step 210: 0.001155
Average train loss at epoch 41, step 220: 0.002683
Average train loss at epoch 41, step 230: 0.000481
Average train loss at epoch 41, step 240: 0.000535
Average train loss at epoch 41, step 250: 0.000738
Average train loss at epoch 41, step 260: 0.000479
Average train loss at epoch 41, step 270: 0.002323
[Epoch 41] Average train loss: 0.0007598561208797819
Input Sentence : ['list', 'list', 'flights', 'between', 'oakland', 'and', 'denver']
Slot Truth : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 41: 0.969758064516129
Slot accuracy for epoch 41: 0.9796411888079459
Slot F1 score for epoch 41: 0.9798693272117251
Average train loss at epoch 42, step 0: 0.000309
Average train loss at epoch 42, step 10: 0.000448
Average train loss at epoch 42, step 20: 0.000466
Average train loss at epoch 42, step 30: 0.000467
Average train loss at epoch 42, step 40: 0.000657
Average train loss at epoch 42, step 50: 0.000809
Average train loss at epoch 42, step 60: 0.000442
Average train loss at epoch 42, step 70: 0.000529
Average train loss at epoch 42, step 80: 0.001939
Average train loss at epoch 42, step 90: 0.000342
Average train loss at epoch 42, step 100: 0.000559
Average train loss at epoch 42, step 110: 0.000788
Average train loss at epoch 42, step 120: 0.000586
Average train loss at epoch 42, step 130: 0.000595
Average train loss at epoch 42, step 140: 0.000273
Average train loss at epoch 42, step 150: 0.000455
Average train loss at epoch 42, step 160: 0.000559
Average train loss at epoch 42, step 170: 0.000545
Average train loss at epoch 42, step 180: 0.000649
Average train loss at epoch 42, step 190: 0.000417
Average train loss at epoch 42, step 200: 0.000455
Average train loss at epoch 42, step 210: 0.003424
Average train loss at epoch 42, step 220: 0.000763
Average train loss at epoch 42, step 230: 0.000455
Average train loss at epoch 42, step 240: 0.000801
Average train loss at epoch 42, step 250: 0.000439
Average train loss at epoch 42, step 260: 0.000537
Average train loss at epoch 42, step 270: 0.000367
[Epoch 42] Average train loss: 0.0006853678009665143
Input Sentence : ['what', 'time', 'is', 'the', 'last', 'flight', 'from', 'washington', 'to', 'san', 'francisco']
Slot Truth : ['O', 'B-flight_time', 'O', 'O', 'B-flight_mod', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Slot Prediction : ['O', 'B-flight_time', 'O', 'O', 'B-flight_mod', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Intent Truth : atis_flight_time
Intent Prediction : atis_flight_time
Intent accuracy for epoch 42: 0.969758064516129
Slot accuracy for epoch 42: 0.9803188811335569
Slot F1 score for epoch 42: 0.9799858306765851
Average train loss at epoch 43, step 0: 0.000202
Average train loss at epoch 43, step 10: 0.000428
Average train loss at epoch 43, step 20: 0.000408
Average train loss at epoch 43, step 30: 0.000350
Average train loss at epoch 43, step 40: 0.000371
Average train loss at epoch 43, step 50: 0.000289
Average train loss at epoch 43, step 60: 0.000441
Average train loss at epoch 43, step 70: 0.000424
Average train loss at epoch 43, step 80: 0.000327
Average train loss at epoch 43, step 90: 0.000255
Average train loss at epoch 43, step 100: 0.000464
Average train loss at epoch 43, step 110: 0.000308
Average train loss at epoch 43, step 120: 0.000244
Average train loss at epoch 43, step 130: 0.000760
Average train loss at epoch 43, step 140: 0.000456
Average train loss at epoch 43, step 150: 0.000263
Average train loss at epoch 43, step 160: 0.000469
Average train loss at epoch 43, step 170: 0.000571
Average train loss at epoch 43, step 180: 0.000435
Average train loss at epoch 43, step 190: 0.000295
Average train loss at epoch 43, step 200: 0.000395
Average train loss at epoch 43, step 210: 0.002194
Average train loss at epoch 43, step 220: 0.000260
Average train loss at epoch 43, step 230: 0.000448
Average train loss at epoch 43, step 240: 0.000479
Average train loss at epoch 43, step 250: 0.000833
Average train loss at epoch 43, step 260: 0.000333
Average train loss at epoch 43, step 270: 0.000373
[Epoch 43] Average train loss: 0.00046886888766718867
Input Sentence : ['<UNK>', 'and', "what's", 'the', 'last', 'flight', 'back', 'from', 'washington', 'to', 'boston']
Slot Truth : ['O', 'O', 'O', 'O', 'B-flight_mod', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'B-flight_mod', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 43: 0.967741935483871
Slot accuracy for epoch 43: 0.980219971995553
Slot F1 score for epoch 43: 0.9796891557753444
Average train loss at epoch 44, step 0: 0.000197
Average train loss at epoch 44, step 10: 0.000265
Average train loss at epoch 44, step 20: 0.000316
Average train loss at epoch 44, step 30: 0.000276
Average train loss at epoch 44, step 40: 0.000253
Average train loss at epoch 44, step 50: 0.002281
Average train loss at epoch 44, step 60: 0.000359
Average train loss at epoch 44, step 70: 0.000624
Average train loss at epoch 44, step 80: 0.000387
Average train loss at epoch 44, step 90: 0.000365
Average train loss at epoch 44, step 100: 0.000502
Average train loss at epoch 44, step 110: 0.000296
Average train loss at epoch 44, step 120: 0.000292
Average train loss at epoch 44, step 130: 0.000242
Average train loss at epoch 44, step 140: 0.000287
Average train loss at epoch 44, step 150: 0.000255
Average train loss at epoch 44, step 160: 0.000371
Average train loss at epoch 44, step 170: 0.000259
Average train loss at epoch 44, step 180: 0.000281
Average train loss at epoch 44, step 190: 0.000320
Average train loss at epoch 44, step 200: 0.000375
Average train loss at epoch 44, step 210: 0.000276
Average train loss at epoch 44, step 220: 0.001866
Average train loss at epoch 44, step 230: 0.000276
Average train loss at epoch 44, step 240: 0.000555
Average train loss at epoch 44, step 250: 0.000375
Average train loss at epoch 44, step 260: 0.000256
Average train loss at epoch 44, step 270: 0.000367
[Epoch 44] Average train loss: 0.00046141473184985204
Input Sentence : ['show', 'me', 'the', 'flights', 'from', 'love', 'field', 'to', 'other', 'airports']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.airport_name', 'I-fromloc.airport_name', 'O', 'O', 'O']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.airport_name', 'I-fromloc.airport_name', 'O', 'O', 'O']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 44: 0.967741935483871
Slot accuracy for epoch 44: 0.9793088437017158
Slot F1 score for epoch 44: 0.9792311091471497
Average train loss at epoch 45, step 0: 0.000213
Average train loss at epoch 45, step 10: 0.000287
Average train loss at epoch 45, step 20: 0.000294
Average train loss at epoch 45, step 30: 0.000484
Average train loss at epoch 45, step 40: 0.000178
Average train loss at epoch 45, step 50: 0.000340
Average train loss at epoch 45, step 60: 0.000342
Average train loss at epoch 45, step 70: 0.000347
Average train loss at epoch 45, step 80: 0.000252
Average train loss at epoch 45, step 90: 0.000172
Average train loss at epoch 45, step 100: 0.003181
Average train loss at epoch 45, step 110: 0.000297
Average train loss at epoch 45, step 120: 0.000401
Average train loss at epoch 45, step 130: 0.000272
Average train loss at epoch 45, step 140: 0.000378
Average train loss at epoch 45, step 150: 0.000341
Average train loss at epoch 45, step 160: 0.000264
Average train loss at epoch 45, step 170: 0.001639
Average train loss at epoch 45, step 180: 0.000270
Average train loss at epoch 45, step 190: 0.000261
Average train loss at epoch 45, step 200: 0.000265
Average train loss at epoch 45, step 210: 0.000239
Average train loss at epoch 45, step 220: 0.000238
Average train loss at epoch 45, step 230: 0.000195
Average train loss at epoch 45, step 240: 0.000316
Average train loss at epoch 45, step 250: 0.000455
Average train loss at epoch 45, step 260: 0.000194
Average train loss at epoch 45, step 270: 0.000307
[Epoch 45] Average train loss: 0.0004459860643809436
Input Sentence : ["i'm", 'flying', 'from', 'boston', 'to', 'the', '<UNK>', 'area']
Slot Truth : ['O', 'O', 'O', 'B-fromloc.city_name', 'O', 'O', 'B-toloc.city_name', 'I-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'B-fromloc.city_name', 'O', 'O', 'O', 'O']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 45: 0.967741935483871
Slot accuracy for epoch 45: 0.9801553772577061
Slot F1 score for epoch 45: 0.979768530788939
Average train loss at epoch 46, step 0: 0.000164
Average train loss at epoch 46, step 10: 0.000258
Average train loss at epoch 46, step 20: 0.000181
Average train loss at epoch 46, step 30: 0.000313
Average train loss at epoch 46, step 40: 0.000372
Average train loss at epoch 46, step 50: 0.000288
Average train loss at epoch 46, step 60: 0.000222
Average train loss at epoch 46, step 70: 0.003434
Average train loss at epoch 46, step 80: 0.000236
Average train loss at epoch 46, step 90: 0.000191
Average train loss at epoch 46, step 100: 0.000221
Average train loss at epoch 46, step 110: 0.000235
Average train loss at epoch 46, step 120: 0.000386
Average train loss at epoch 46, step 130: 0.000241
Average train loss at epoch 46, step 140: 0.000301
Average train loss at epoch 46, step 150: 0.000204
Average train loss at epoch 46, step 160: 0.000187
Average train loss at epoch 46, step 170: 0.000229
Average train loss at epoch 46, step 180: 0.000145
Average train loss at epoch 46, step 190: 0.000266
Average train loss at epoch 46, step 200: 0.000189
Average train loss at epoch 46, step 210: 0.000314
Average train loss at epoch 46, step 220: 0.002141
Average train loss at epoch 46, step 230: 0.000293
Average train loss at epoch 46, step 240: 0.000236
Average train loss at epoch 46, step 250: 0.000273
Average train loss at epoch 46, step 260: 0.000260
Average train loss at epoch 46, step 270: 0.000194
[Epoch 46] Average train loss: 0.0004308010843406368
Input Sentence : ['list', 'round', 'trip', 'flights', 'between', 'boston', 'and', 'oakland', 'using', 'twa']
Slot Truth : ['O', 'B-round_trip', 'I-round_trip', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-airline_code']
Slot Prediction : ['O', 'B-round_trip', 'I-round_trip', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'B-airline_code']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 46: 0.967741935483871
Slot accuracy for epoch 46: 0.9794142724212399
Slot F1 score for epoch 46: 0.9792274374613277
Average train loss at epoch 47, step 0: 0.000099
Average train loss at epoch 47, step 10: 0.000207
Average train loss at epoch 47, step 20: 0.000208
Average train loss at epoch 47, step 30: 0.000312
Average train loss at epoch 47, step 40: 0.000170
Average train loss at epoch 47, step 50: 0.000139
Average train loss at epoch 47, step 60: 0.000158
Average train loss at epoch 47, step 70: 0.000185
Average train loss at epoch 47, step 80: 0.000218
Average train loss at epoch 47, step 90: 0.000159
Average train loss at epoch 47, step 100: 0.000159
Average train loss at epoch 47, step 110: 0.000224
Average train loss at epoch 47, step 120: 0.000321
Average train loss at epoch 47, step 130: 0.000218
Average train loss at epoch 47, step 140: 0.000177
Average train loss at epoch 47, step 150: 0.000194
Average train loss at epoch 47, step 160: 0.000157
Average train loss at epoch 47, step 170: 0.000224
Average train loss at epoch 47, step 180: 0.000261
Average train loss at epoch 47, step 190: 0.000199
Average train loss at epoch 47, step 200: 0.004010
Average train loss at epoch 47, step 210: 0.000158
Average train loss at epoch 47, step 220: 0.000301
Average train loss at epoch 47, step 230: 0.000323
Average train loss at epoch 47, step 240: 0.002345
Average train loss at epoch 47, step 250: 0.000190
Average train loss at epoch 47, step 260: 0.000429
Average train loss at epoch 47, step 270: 0.000186
[Epoch 47] Average train loss: 0.0004330150426161917
Input Sentence : ['i', 'need', 'a', 'flight', 'from', 'montreal', 'quebec', 'to', 'san', 'diego', 'california', 'leaving', 'this', 'sunday']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'B-fromloc.state_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'B-toloc.state_name', 'O', 'B-depart_date.date_relative', 'B-depart_date.day_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'B-fromloc.state_name', 'O', 'B-toloc.city_name', 'I-toloc.city_name', 'B-toloc.state_name', 'O', 'O', 'B-depart_date.day_name']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 47: 0.967741935483871
Slot accuracy for epoch 47: 0.9797565923045982
Slot F1 score for epoch 47: 0.979245782919721
Average train loss at epoch 48, step 0: 0.000284
Average train loss at epoch 48, step 10: 0.000169
Average train loss at epoch 48, step 20: 0.000176
Average train loss at epoch 48, step 30: 0.000269
Average train loss at epoch 48, step 40: 0.000752
Average train loss at epoch 48, step 50: 0.000177
Average train loss at epoch 48, step 60: 0.000262
Average train loss at epoch 48, step 70: 0.000215
Average train loss at epoch 48, step 80: 0.003735
Average train loss at epoch 48, step 90: 0.000189
Average train loss at epoch 48, step 100: 0.000270
Average train loss at epoch 48, step 110: 0.000274
Average train loss at epoch 48, step 120: 0.000217
Average train loss at epoch 48, step 130: 0.000229
Average train loss at epoch 48, step 140: 0.000167
Average train loss at epoch 48, step 150: 0.000120
Average train loss at epoch 48, step 160: 0.000205
Average train loss at epoch 48, step 170: 0.000245
Average train loss at epoch 48, step 180: 0.000304
Average train loss at epoch 48, step 190: 0.000201
Average train loss at epoch 48, step 200: 0.000157
Average train loss at epoch 48, step 210: 0.000188
Average train loss at epoch 48, step 220: 0.000177
Average train loss at epoch 48, step 230: 0.000165
Average train loss at epoch 48, step 240: 0.000116
Average train loss at epoch 48, step 250: 0.000172
Average train loss at epoch 48, step 260: 0.000242
Average train loss at epoch 48, step 270: 0.000201
[Epoch 48] Average train loss: 0.00035079111088028486
Input Sentence : ['show', 'nonstop', 'flights', 'from', 'new', 'york', 'to', 'miami', 'on', 'a', 'tuesday', 'which', 'cost', 'less', 'than', '466', 'dollars', 'one', 'way']
Slot Truth : ['O', 'B-flight_stop', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-arrive_date.day_name', 'O', 'O', 'B-cost_relative', 'O', 'B-fare_amount', 'I-fare_amount', 'B-round_trip', 'I-round_trip']
Slot Prediction : ['O', 'B-flight_stop', 'O', 'O', 'B-fromloc.city_name', 'I-fromloc.city_name', 'O', 'B-toloc.city_name', 'O', 'O', 'B-arrive_date.day_name', 'O', 'O', 'B-cost_relative', 'O', 'B-fare_amount', 'I-fare_amount', 'B-round_trip', 'I-round_trip']
Intent Truth : atis_flight
Intent Prediction : atis_flight
Intent accuracy for epoch 48: 0.967741935483871
Slot accuracy for epoch 48: 0.9802638800758828
Slot F1 score for epoch 48: 0.9799911855442925
Average train loss at epoch 49, step 0: 0.000367
Average train loss at epoch 49, step 10: 0.000187
Average train loss at epoch 49, step 20: 0.000149
Average train loss at epoch 49, step 30: 0.000165
Average train loss at epoch 49, step 40: 0.000146
Average train loss at epoch 49, step 50: 0.000970
Average train loss at epoch 49, step 60: 0.000212
Average train loss at epoch 49, step 70: 0.000125
Average train loss at epoch 49, step 80: 0.000187
Average train loss at epoch 49, step 90: 0.000201
Average train loss at epoch 49, step 100: 0.000235
Average train loss at epoch 49, step 110: 0.000125
Average train loss at epoch 49, step 120: 0.000120
Average train loss at epoch 49, step 130: 0.000132
Average train loss at epoch 49, step 140: 0.000246
Average train loss at epoch 49, step 150: 0.000146
Average train loss at epoch 49, step 160: 0.000109
Average train loss at epoch 49, step 170: 0.000267
Average train loss at epoch 49, step 180: 0.000105
Average train loss at epoch 49, step 190: 0.000251
Average train loss at epoch 49, step 200: 0.000157
Average train loss at epoch 49, step 210: 0.000151
Average train loss at epoch 49, step 220: 0.000120
Average train loss at epoch 49, step 230: 0.000115
Average train loss at epoch 49, step 240: 0.000148
Average train loss at epoch 49, step 250: 0.000252
Average train loss at epoch 49, step 260: 0.000125
Average train loss at epoch 49, step 270: 0.001226
[Epoch 49] Average train loss: 0.00023392133372523915
Input Sentence : ['i', 'would', 'like', 'to', 'know', 'the', 'first', 'class', 'fare', 'on', 'a', 'flight', 'from', 'baltimore', 'to', 'denver']
Slot Truth : ['O', 'O', 'O', 'O', 'O', 'O', 'B-class_type', 'I-class_type', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Slot Prediction : ['O', 'O', 'O', 'O', 'O', 'O', 'B-class_type', 'I-class_type', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_name', 'O', 'B-toloc.city_name']
Intent Truth : atis_airfare
Intent Prediction : atis_airfare
Intent accuracy for epoch 49: 0.967741935483871
Slot accuracy for epoch 49: 0.9791084705454024
Slot F1 score for epoch 49: 0.9787346686667255
283
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
