spark：在spark-shell上用260M的数据包做简单的sparkSQL练习--13

今天用一个260M的数据包做了简单的sparksql练习

scala> val sqlContext = new org.apache.spark.sql.SQLContext(sc)
sqlContext: org.apache.spark.sql.SQLContext = org.apache.spark.sql.SQLContext@2d5385c6

scala> val wikiData = sqlContext.parquetFile("/datatnt/wiki_parquet")
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
15/03/19 14:17:43 INFO parquet.ParquetTypesConverter: Falling back to schema conversion from Parquet types; result: ArrayBuffer(id#0, title#1, modified#2L, text#3, username#4)
wikiData: org.apache.spark.sql.SchemaRDD = 
SchemaRDD[0] at RDD at SchemaRDD.scala:108
== Query Plan ==
== Physical Plan ==
ParquetTableScan [id#0,title#1,modified#2L,text#3,username#4], (ParquetRelation /datatnt/wiki_parquet, Some(Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml), org.apache.spark.sql.SQLContext@2d5385c6, []), []

scala> wikiData.count()
15/03/19 14:18:26 INFO storage.MemoryStore: ensureFreeSpace(236243) called with curMem=0, maxMem=280248975
15/03/19 14:18:26 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 230.7 KB, free 267.0 MB)
15/03/19 14:18:27 INFO storage.MemoryStore: ensureFreeSpace(32390) called with curMem=236243, maxMem=280248975
15/03/19 14:18:27 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 31.6 KB, free 267.0 MB)
15/03/19 14:18:27 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:42723 (size: 31.6 KB, free: 267.2 MB)
15/03/19 14:18:27 INFO storage.BlockManagerMaster: Updated info of block broadcast_0_piece0
15/03/19 14:18:27 INFO spark.SparkContext: Created broadcast 0 from NewHadoopRDD at ParquetTableOperations.scala:120
15/03/19 14:18:29 INFO spark.SparkContext: Starting job: collect at SparkPlan.scala:84
15/03/19 14:18:30 INFO input.FileInputFormat: Total input paths to process : 10
15/03/19 14:18:30 INFO hadoop.ParquetInputFormat: Total input paths to process : 10
15/03/19 14:18:30 INFO hadoop.ParquetFileReader: Initiating action with parallelism: 5
15/03/19 14:18:30 INFO hadoop.ParquetFileReader: reading summary file: hdfs://localhost:9000/datatnt/wiki_parquet/_metadata
15/03/19 14:18:31 INFO parquet.FilteringParquetRowInputFormat: Fetched [LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-1.parquet; isDirectory=false; length=24971367; replication=1; blocksize=134217728; modification_time=1426745155417; access_time=1426745147855; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-10.parquet; isDirectory=false; length=25584174; replication=1; blocksize=134217728; modification_time=1426745160207; access_time=1426745155633; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-2.parquet; isDirectory=false; length=25201263; replication=1; blocksize=134217728; modification_time=1426745167788; access_time=1426745160335; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-3.parquet; isDirectory=false; length=24959586; replication=1; blocksize=134217728; modification_time=1426745172875; access_time=1426745167984; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-4.parquet; isDirectory=false; length=24549830; replication=1; blocksize=134217728; modification_time=1426745177395; access_time=1426745172945; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-5.parquet; isDirectory=false; length=24557353; replication=1; blocksize=134217728; modification_time=1426745182178; access_time=1426745177989; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-6.parquet; isDirectory=false; length=24498982; replication=1; blocksize=134217728; modification_time=1426745189932; access_time=1426745182333; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-7.parquet; isDirectory=false; length=25414808; replication=1; blocksize=134217728; modification_time=1426745193424; access_time=1426745190054; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-8.parquet; isDirectory=false; length=25094311; replication=1; blocksize=134217728; modification_time=1426745197168; access_time=1426745193530; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=hdfs://localhost:9000/datatnt/wiki_parquet/part-r-9.parquet; isDirectory=false; length=25721430; replication=1; blocksize=134217728; modification_time=1426745204204; access_time=1426745197304; owner=root; group=supergroup; permission=rw-r--r--; isSymlink=false}] footers in 345 ms
15/03/19 14:18:31 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
15/03/19 14:18:31 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
15/03/19 14:18:31 INFO parquet.FilteringParquetRowInputFormat: Using Task Side Metadata Split Strategy
15/03/19 14:18:31 INFO scheduler.DAGScheduler: Registering RDD 5 (mapPartitions at Exchange.scala:100)
15/03/19 14:18:31 INFO scheduler.DAGScheduler: Got job 0 (collect at SparkPlan.scala:84) with 1 output partitions (allowLocal=false)
15/03/19 14:18:31 INFO scheduler.DAGScheduler: Final stage: Stage 1(collect at SparkPlan.scala:84)
15/03/19 14:18:31 INFO scheduler.DAGScheduler: Parents of final stage: List(Stage 0)
15/03/19 14:18:31 INFO scheduler.DAGScheduler: Missing parents: List(Stage 0)
15/03/19 14:18:32 INFO scheduler.DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[5] at mapPartitions at Exchange.scala:100), which has no missing parents
15/03/19 14:18:32 INFO storage.MemoryStore: ensureFreeSpace(7856) called with curMem=268633, maxMem=280248975
15/03/19 14:18:32 INFO storage.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 7.7 KB, free 267.0 MB)
15/03/19 14:18:32 INFO storage.MemoryStore: ensureFreeSpace(5140) called with curMem=276489, maxMem=280248975
15/03/19 14:18:32 INFO storage.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 5.0 KB, free 267.0 MB)
15/03/19 14:18:32 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on localhost:42723 (size: 5.0 KB, free: 267.2 MB)
15/03/19 14:18:32 INFO storage.BlockManagerMaster: Updated info of block broadcast_1_piece0
15/03/19 14:18:32 INFO spark.SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:838
15/03/19 14:18:32 INFO scheduler.DAGScheduler: Submitting 10 missing tasks from Stage 0 (MapPartitionsRDD[5] at mapPartitions at Exchange.scala:100)
15/03/19 14:18:32 INFO scheduler.TaskSchedulerImpl: Adding task set 0.0 with 10 tasks
15/03/19 14:18:32 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, PROCESS_LOCAL, 1505 bytes)
15/03/19 14:18:32 INFO executor.Executor: Running task 0.0 in stage 0.0 (TID 0)
15/03/19 14:18:32 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-1.parquet start: 0 end: 24971367 length: 24971367 hosts: [] requestedSchema: message root {
}

 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:18:39 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:18:39 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3936 records.
15/03/19 14:18:39 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:18:39 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3936
15/03/19 14:18:39 INFO executor.Executor: Finished task 9.0 in stage 0.0 (TID 9). 1895 bytes result sent to driver
15/03/19 14:18:39 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 223 ms on localhost (10/10)
15/03/19 14:18:39 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
15/03/19 14:18:39 INFO scheduler.DAGScheduler: Stage 0 (mapPartitions at Exchange.scala:100) finished in 7.285 s
15/03/19 14:18:39 INFO scheduler.DAGScheduler: looking for newly runnable stages
15/03/19 14:18:39 INFO scheduler.DAGScheduler: running: Set()
15/03/19 14:18:39 INFO scheduler.DAGScheduler: waiting: Set(Stage 1)
15/03/19 14:18:39 INFO scheduler.DAGScheduler: failed: Set()
15/03/19 14:18:39 INFO scheduler.DAGScheduler: Missing parents for Stage 1: List()
15/03/19 14:18:39 INFO scheduler.DAGScheduler: Submitting Stage 1 (MappedRDD[9] at map at SparkPlan.scala:84), which is now runnable
15/03/19 14:18:39 INFO storage.MemoryStore: ensureFreeSpace(8416) called with curMem=281629, maxMem=280248975
15/03/19 14:18:39 INFO storage.MemoryStore: Block broadcast_2 stored as values in memory (estimated size 8.2 KB, free 267.0 MB)
15/03/19 14:18:39 INFO storage.MemoryStore: ensureFreeSpace(5512) called with curMem=290045, maxMem=280248975
15/03/19 14:18:39 INFO storage.MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 5.4 KB, free 267.0 MB)
15/03/19 14:18:39 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on localhost:42723 (size: 5.4 KB, free: 267.2 MB)
15/03/19 14:18:39 INFO storage.BlockManagerMaster: Updated info of block broadcast_2_piece0
15/03/19 14:18:39 INFO spark.SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:838
15/03/19 14:18:39 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from Stage 1 (MappedRDD[9] at map at SparkPlan.scala:84)
15/03/19 14:18:39 INFO scheduler.TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
15/03/19 14:18:39 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 1.0 (TID 10, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:18:39 INFO executor.Executor: Running task 0.0 in stage 1.0 (TID 10)
15/03/19 14:18:40 INFO storage.ShuffleBlockFetcherIterator: Getting 10 non-empty blocks out of 10 blocks
15/03/19 14:18:40 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 73 ms
15/03/19 14:18:40 INFO executor.Executor: Finished task 0.0 in stage 1.0 (TID 10). 1074 bytes result sent to driver
15/03/19 14:18:40 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 1.0 (TID 10) in 1047 ms on localhost (1/1)
15/03/19 14:18:40 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 
15/03/19 14:18:40 INFO scheduler.DAGScheduler: Stage 1 (collect at SparkPlan.scala:84) finished in 1.052 s
15/03/19 14:18:40 INFO scheduler.DAGScheduler: Job 0 finished: collect at SparkPlan.scala:84, took 11.229042 s
res0: Long = 39365

scala> wikiData.registerAsTable("wikiData")
warning: there were 1 deprecation warning(s); re-run with -deprecation for details

scala> val countResult = sqlContext.sql("SELECT COUNT(*) FROM wikiData").collect()
15/03/19 14:24:39 INFO storage.BlockManager: Removing broadcast 2
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_2
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_2 of size 8416 dropped from memory (free 279961834)
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_2_piece0
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_2_piece0 of size 5512 dropped from memory (free 279967346)
15/03/19 14:24:39 INFO storage.BlockManagerInfo: Removed broadcast_2_piece0 on localhost:42723 in memory (size: 5.4 KB, free: 267.2 MB)
15/03/19 14:24:39 INFO storage.BlockManagerMaster: Updated info of block broadcast_2_piece0
15/03/19 14:24:39 INFO spark.ContextCleaner: Cleaned broadcast 2
15/03/19 14:24:39 INFO storage.BlockManager: Removing broadcast 1
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_1_piece0
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_1_piece0 of size 5140 dropped from memory (free 279972486)
15/03/19 14:24:39 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on localhost:42723 in memory (size: 5.0 KB, free: 267.2 MB)
15/03/19 14:24:39 INFO storage.BlockManagerMaster: Updated info of block broadcast_1_piece0
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_1
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_1 of size 7856 dropped from memory (free 279980342)
15/03/19 14:24:39 INFO spark.ContextCleaner: Cleaned broadcast 1
15/03/19 14:24:39 INFO spark.ContextCleaner: Cleaned shuffle 0
15/03/19 14:24:39 INFO storage.BlockManager: Removing broadcast 0
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_0
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_0 of size 236243 dropped from memory (free 280216585)
15/03/19 14:24:39 INFO storage.BlockManager: Removing block broadcast_0_piece0
15/03/19 14:24:39 INFO storage.MemoryStore: Block broadcast_0_piece0 of size 32390 dropped from memory (free 280248975)
15/03/19 14:24:39 INFO storage.BlockManagerInfo: Removed broadcast_0_piece0 on localhost:42723 in memory (size: 31.6 KB, free: 267.3 MB)
15/03/19 14:24:39 INFO storage.BlockManagerMaster: Updated info of block broadcast_0_piece0
15/03/19 14:24:39 INFO spark.ContextCleaner: Cleaned broadcast 0
15/03/19 14:24:44 INFO storage.MemoryStore: ensureFreeSpace(236243) called with curMem=0, maxMem=280248975
15/03/19 14:24:44 INFO storage.MemoryStore: Block broadcast_3 stored as values in memory (estimated size 230.7 KB, free 267.0 MB)
15/03/19 14:24:44 INFO storage.MemoryStore: ensureFreeSpace(32390) called with curMem=236243, maxMem=280248975
15/03/19 14:24:44 INFO storage.MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 31.6 KB, free 267.0 MB)
15/03/19 14:24:44 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on localhost:42723 (size: 31.6 KB, free: 267.2 MB)
15/03/19 14:24:44 INFO storage.BlockManagerMaster: Updated info of block broadcast_3_piece0
15/03/19 14:24:44 INFO spark.SparkContext: Created broadcast 3 from NewHadoopRDD at ParquetTableOperations.scala:120
15/03/19 14:24:45 INFO spark.SparkContext: Starting job: collect at SparkPlan.scala:84
15/03/19 14:24:45 INFO input.FileInputFormat: Total input paths to process : 10
15/03/19 14:24:45 INFO hadoop.ParquetInputFormat: Total input paths to process : 10
15/03/19 14:24:45 INFO parquet.FilteringParquetRowInputFormat: Using Task Side Metadata Split Strategy
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Registering RDD 14 (mapPartitions at Exchange.scala:100)
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Got job 1 (collect at SparkPlan.scala:84) with 1 output partitions (allowLocal=false)
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Final stage: Stage 3(collect at SparkPlan.scala:84)
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Parents of final stage: List(Stage 2)
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Missing parents: List(Stage 2)
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Submitting Stage 2 (MapPartitionsRDD[14] at mapPartitions at Exchange.scala:100), which has no missing parents
15/03/19 14:24:46 INFO storage.MemoryStore: ensureFreeSpace(7856) called with curMem=268633, maxMem=280248975
15/03/19 14:24:46 INFO storage.MemoryStore: Block broadcast_4 stored as values in memory (estimated size 7.7 KB, free 267.0 MB)
15/03/19 14:24:46 INFO storage.MemoryStore: ensureFreeSpace(5140) called with curMem=276489, maxMem=280248975
15/03/19 14:24:46 INFO storage.MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 5.0 KB, free 267.0 MB)
15/03/19 14:24:46 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on localhost:42723 (size: 5.0 KB, free: 267.2 MB)
15/03/19 14:24:46 INFO storage.BlockManagerMaster: Updated info of block broadcast_4_piece0
15/03/19 14:24:46 INFO spark.SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:838
15/03/19 14:24:46 INFO scheduler.DAGScheduler: Submitting 10 missing tasks from Stage 2 (MapPartitionsRDD[14] at mapPartitions at Exchange.scala:100)
15/03/19 14:24:46 INFO scheduler.TaskSchedulerImpl: Adding task set 2.0 with 10 tasks
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 2.0 (TID 11, localhost, PROCESS_LOCAL, 1505 bytes)
15/03/19 14:24:46 INFO executor.Executor: Running task 0.0 in stage 2.0 (TID 11)
15/03/19 14:24:46 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-1.parquet start: 0 end: 24971367 length: 24971367 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:46 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3944 records.
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3944
15/03/19 14:24:46 INFO executor.Executor: Finished task 0.0 in stage 2.0 (TID 11). 1895 bytes result sent to driver
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 2.0 (TID 12, localhost, PROCESS_LOCAL, 1507 bytes)
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 2.0 (TID 11) in 286 ms on localhost (1/10)
15/03/19 14:24:46 INFO executor.Executor: Running task 1.0 in stage 2.0 (TID 12)
15/03/19 14:24:46 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-10.parquet start: 0 end: 25584174 length: 25584174 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:46 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3930 records.
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3930
15/03/19 14:24:46 INFO executor.Executor: Finished task 1.0 in stage 2.0 (TID 12). 1895 bytes result sent to driver
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 2.0 (TID 13, localhost, PROCESS_LOCAL, 1508 bytes)
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 2.0 (TID 12) in 166 ms on localhost (2/10)
15/03/19 14:24:46 INFO executor.Executor: Running task 2.0 in stage 2.0 (TID 13)
15/03/19 14:24:46 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-2.parquet start: 0 end: 25201263 length: 25201263 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:46 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3939 records.
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:46 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3939
15/03/19 14:24:46 INFO executor.Executor: Finished task 2.0 in stage 2.0 (TID 13). 1895 bytes result sent to driver
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 2.0 (TID 14, localhost, PROCESS_LOCAL, 1508 bytes)
15/03/19 14:24:46 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 2.0 (TID 13) in 273 ms on localhost (3/10)
15/03/19 14:24:46 INFO executor.Executor: Running task 3.0 in stage 2.0 (TID 14)
15/03/19 14:24:46 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-3.parquet start: 0 end: 24959586 length: 24959586 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:46 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3938 records.
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3938
15/03/19 14:24:47 INFO executor.Executor: Finished task 3.0 in stage 2.0 (TID 14). 1895 bytes result sent to driver
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Starting task 4.0 in stage 2.0 (TID 15, localhost, PROCESS_LOCAL, 1510 bytes)
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 2.0 (TID 14) in 249 ms on localhost (4/10)
15/03/19 14:24:47 INFO executor.Executor: Running task 4.0 in stage 2.0 (TID 15)
15/03/19 14:24:47 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-4.parquet start: 0 end: 24549830 length: 24549830 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:47 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3929 records.
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3929
15/03/19 14:24:47 INFO executor.Executor: Finished task 4.0 in stage 2.0 (TID 15). 1895 bytes result sent to driver
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Starting task 5.0 in stage 2.0 (TID 16, localhost, PROCESS_LOCAL, 1509 bytes)
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Finished task 4.0 in stage 2.0 (TID 15) in 305 ms on localhost (5/10)
15/03/19 14:24:47 INFO executor.Executor: Running task 5.0 in stage 2.0 (TID 16)
15/03/19 14:24:47 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-5.parquet start: 0 end: 24557353 length: 24557353 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:47 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3930 records.
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3930
15/03/19 14:24:47 INFO executor.Executor: Finished task 5.0 in stage 2.0 (TID 16). 1895 bytes result sent to driver
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Starting task 6.0 in stage 2.0 (TID 17, localhost, PROCESS_LOCAL, 1509 bytes)
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 2.0 (TID 16) in 266 ms on localhost (6/10)
15/03/19 14:24:47 INFO executor.Executor: Running task 6.0 in stage 2.0 (TID 17)
15/03/19 14:24:47 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-6.parquet start: 0 end: 24498982 length: 24498982 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:47 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3938 records.
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:47 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3938
15/03/19 14:24:47 INFO executor.Executor: Finished task 6.0 in stage 2.0 (TID 17). 1895 bytes result sent to driver
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Starting task 7.0 in stage 2.0 (TID 18, localhost, PROCESS_LOCAL, 1511 bytes)
15/03/19 14:24:47 INFO scheduler.TaskSetManager: Finished task 6.0 in stage 2.0 (TID 17) in 304 ms on localhost (7/10)
15/03/19 14:24:47 INFO executor.Executor: Running task 7.0 in stage 2.0 (TID 18)
15/03/19 14:24:47 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-7.parquet start: 0 end: 25414808 length: 25414808 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:47 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3937 records.
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 3937
15/03/19 14:24:48 INFO executor.Executor: Finished task 7.0 in stage 2.0 (TID 18). 1895 bytes result sent to driver
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Starting task 8.0 in stage 2.0 (TID 19, localhost, PROCESS_LOCAL, 1510 bytes)
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Finished task 7.0 in stage 2.0 (TID 18) in 343 ms on localhost (8/10)
15/03/19 14:24:48 INFO executor.Executor: Running task 8.0 in stage 2.0 (TID 19)
15/03/19 14:24:48 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-8.parquet start: 0 end: 25094311 length: 25094311 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:48 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3944 records.
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3944
15/03/19 14:24:48 INFO executor.Executor: Finished task 8.0 in stage 2.0 (TID 19). 1895 bytes result sent to driver
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Starting task 9.0 in stage 2.0 (TID 20, localhost, PROCESS_LOCAL, 1507 bytes)
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Finished task 8.0 in stage 2.0 (TID 19) in 297 ms on localhost (9/10)
15/03/19 14:24:48 INFO executor.Executor: Running task 9.0 in stage 2.0 (TID 20)
15/03/19 14:24:48 INFO rdd.NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://localhost:9000/datatnt/wiki_parquet/part-r-9.parquet start: 0 end: 25721430 length: 25721430 hosts: [] requestedSchema: message root {
}
 readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"id","type":"integer","nullable":true,"metadata":{}},{"name":"title","type":"binary","nullable":true,"metadata":{}},{"name":"modified","type":"long","nullable":true,"metadata":{}},{"name":"text","type":"binary","nullable":true,"metadata":{}},{"name":"username","type":"binary","nullable":true,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[]}}}
15/03/19 14:24:48 WARN hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3936 records.
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
15/03/19 14:24:48 INFO hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 3936
15/03/19 14:24:48 INFO executor.Executor: Finished task 9.0 in stage 2.0 (TID 20). 1895 bytes result sent to driver
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 2.0 (TID 20) in 270 ms on localhost (10/10)
15/03/19 14:24:48 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 
15/03/19 14:24:48 INFO scheduler.DAGScheduler: Stage 2 (mapPartitions at Exchange.scala:100) finished in 2.627 s
15/03/19 14:24:48 INFO scheduler.DAGScheduler: looking for newly runnable stages
15/03/19 14:24:48 INFO scheduler.DAGScheduler: running: Set()
15/03/19 14:24:48 INFO scheduler.DAGScheduler: waiting: Set(Stage 3)
15/03/19 14:24:48 INFO scheduler.DAGScheduler: failed: Set()
15/03/19 14:24:48 INFO scheduler.DAGScheduler: Missing parents for Stage 3: List()
15/03/19 14:24:48 INFO scheduler.DAGScheduler: Submitting Stage 3 (MappedRDD[18] at map at SparkPlan.scala:84), which is now runnable
15/03/19 14:24:48 INFO storage.MemoryStore: ensureFreeSpace(8384) called with curMem=281629, maxMem=280248975
15/03/19 14:24:48 INFO storage.MemoryStore: Block broadcast_5 stored as values in memory (estimated size 8.2 KB, free 267.0 MB)
15/03/19 14:24:48 INFO storage.MemoryStore: ensureFreeSpace(5531) called with curMem=290013, maxMem=280248975
15/03/19 14:24:48 INFO storage.MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 5.4 KB, free 267.0 MB)
15/03/19 14:24:48 INFO storage.BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:42723 (size: 5.4 KB, free: 267.2 MB)
15/03/19 14:24:48 INFO storage.BlockManagerMaster: Updated info of block broadcast_5_piece0
15/03/19 14:24:48 INFO spark.SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:838
15/03/19 14:24:48 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from Stage 3 (MappedRDD[18] at map at SparkPlan.scala:84)
15/03/19 14:24:48 INFO scheduler.TaskSchedulerImpl: Adding task set 3.0 with 1 tasks
15/03/19 14:24:48 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 3.0 (TID 21, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:24:48 INFO executor.Executor: Running task 0.0 in stage 3.0 (TID 21)
15/03/19 14:24:48 INFO storage.ShuffleBlockFetcherIterator: Getting 10 non-empty blocks out of 10 blocks
15/03/19 14:24:48 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:24:49 INFO executor.Executor: Finished task 0.0 in stage 3.0 (TID 21). 1074 bytes result sent to driver
15/03/19 14:24:49 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 3.0 (TID 21) in 265 ms on localhost (1/1)
15/03/19 14:24:49 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 
15/03/19 14:24:49 INFO scheduler.DAGScheduler: Stage 3 (collect at SparkPlan.scala:84) finished in 0.270 s
15/03/19 14:24:49 INFO scheduler.DAGScheduler: Job 1 finished: collect at SparkPlan.scala:84, took 3.997253 s
countResult: Array[org.apache.spark.sql.Row] = Array([39365])

scala> sqlContext.sql("SELECT username, COUNT(*) AS cnt FROM wikiData WHERE username <> '' GROUP BY username ORDER BY cnt DESC LIMIT 10").collect().foreach(println)
15/03/19 14:30:58 INFO storage.BlockManager: Removing broadcast 3
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_3_piece0
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_3_piece0 of size 32390 dropped from memory (free 279985821)
15/03/19 14:30:58 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on localhost:42723 in memory (size: 31.6 KB, free: 267.3 MB)
15/03/19 14:30:58 INFO storage.BlockManagerMaster: Updated info of block broadcast_3_piece0
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_3
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_3 of size 236243 dropped from memory (free 280222064)
15/03/19 14:30:58 INFO spark.ContextCleaner: Cleaned broadcast 3
15/03/19 14:30:58 INFO spark.ContextCleaner: Cleaned shuffle 1
15/03/19 14:30:58 INFO storage.BlockManager: Removing broadcast 4
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_4
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_4 of size 7856 dropped from memory (free 280229920)
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_4_piece0
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_4_piece0 of size 5140 dropped from memory (free 280235060)
15/03/19 14:30:58 INFO storage.BlockManagerInfo: Removed broadcast_4_piece0 on localhost:42723 in memory (size: 5.0 KB, free: 267.3 MB)
15/03/19 14:30:58 INFO storage.BlockManagerMaster: Updated info of block broadcast_4_piece0
15/03/19 14:30:58 INFO spark.ContextCleaner: Cleaned broadcast 4
15/03/19 14:30:58 INFO storage.BlockManager: Removing broadcast 5
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_5_piece0
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_5_piece0 of size 5531 dropped from memory (free 280240591)
15/03/19 14:30:58 INFO storage.BlockManagerInfo: Removed broadcast_5_piece0 on localhost:42723 in memory (size: 5.4 KB, free: 267.3 MB)
15/03/19 14:30:58 INFO storage.BlockManagerMaster: Updated info of block broadcast_5_piece0
15/03/19 14:30:58 INFO storage.BlockManager: Removing block broadcast_5
15/03/19 14:30:58 INFO storage.MemoryStore: Block broadcast_5 of size 8384 dropped from memory (free 280248975)
15/03/19 14:30:58 INFO spark.ContextCleaner: Cleaned broadcast 5
15/03/19 14:31:05 INFO spark.SparkContext: Starting job: takeOrdered at basicOperators.scala:183
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Registering RDD 24 (mapPartitions at Exchange.scala:64)
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Got job 2 (takeOrdered at basicOperators.scala:183) with 200 output partitions (allowLocal=false)
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Final stage: Stage 5(takeOrdered at basicOperators.scala:183)
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Parents of final stage: List(Stage 4)
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Missing parents: List(Stage 4)
15/03/19 14:31:05 INFO scheduler.DAGScheduler: Submitting Stage 4 (MapPartitionsRDD[24] at mapPartitions at Exchange.scala:64), which has no missing parents
15/03/19 14:31:06 INFO storage.MemoryStore: ensureFreeSpace(8400) called with curMem=0, maxMem=280248975
15/03/19 14:31:06 INFO storage.MemoryStore: Block broadcast_6 stored as values in memory (estimated size 8.2 KB, free 267.3 MB)
15/03/19 14:31:06 INFO storage.MemoryStore: ensureFreeSpace(5455) called with curMem=8400, maxMem=280248975
15/03/19 14:31:06 INFO storage.MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 5.3 KB, free 267.3 MB)
15/03/19 14:31:06 INFO storage.BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:42723 (size: 5.3 KB, free: 267.3 MB)
15/03/19 14:31:06 INFO storage.BlockManagerMaster: Updated info of block broadcast_6_piece0
15/03/19 14:31:06 INFO spark.SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:838
15/03/19 14:31:06 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from Stage 4 (MapPartitionsRDD[24] at mapPartitions at Exchange.scala:64)
15/03/19 14:31:06 INFO scheduler.TaskSchedulerImpl: Adding task set 4.0 with 1 tasks
15/03/19 14:31:06 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 4.0 (TID 22, localhost, PROCESS_LOCAL, 1248 bytes)
15/03/19 14:31:06 INFO executor.Executor: Running task 0.0 in stage 4.0 (TID 22)
15/03/19 14:31:06 INFO executor.Executor: Finished task 0.0 in stage 4.0 (TID 22). 1039 bytes result sent to driver
15/03/19 14:31:06 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 4.0 (TID 22) in 637 ms on localhost (1/1)
15/03/19 14:31:06 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 
15/03/19 14:31:06 INFO scheduler.DAGScheduler: Stage 4 (mapPartitions at Exchange.scala:64) finished in 0.640 s
15/03/19 14:31:06 INFO scheduler.DAGScheduler: looking for newly runnable stages
15/03/19 14:31:06 INFO scheduler.DAGScheduler: running: Set()
15/03/19 14:31:06 INFO scheduler.DAGScheduler: waiting: Set(Stage 5)
15/03/19 14:31:06 INFO scheduler.DAGScheduler: failed: Set()
15/03/19 14:31:06 INFO scheduler.DAGScheduler: Missing parents for Stage 5: List()
15/03/19 14:31:06 INFO scheduler.DAGScheduler: Submitting Stage 5 (MapPartitionsRDD[29] at takeOrdered at basicOperators.scala:183), which is now runnable
15/03/19 14:31:06 INFO storage.MemoryStore: ensureFreeSpace(9968) called with curMem=13855, maxMem=280248975
15/03/19 14:31:06 INFO storage.MemoryStore: Block broadcast_7 stored as values in memory (estimated size 9.7 KB, free 267.2 MB)
15/03/19 14:31:06 INFO storage.MemoryStore: ensureFreeSpace(6656) called with curMem=23823, maxMem=280248975
15/03/19 14:31:06 INFO storage.MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 6.5 KB, free 267.2 MB)
15/03/19 14:31:06 INFO storage.BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:42723 (size: 6.5 KB, free: 267.3 MB)
15/03/19 14:31:06 INFO storage.BlockManagerMaster: Updated info of block broadcast_7_piece0
15/03/19 14:31:06 INFO spark.SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:838
15/03/19 14:31:06 INFO scheduler.DAGScheduler: Submitting 200 missing tasks from Stage 5 (MapPartitionsRDD[29] at takeOrdered at basicOperators.scala:183)
15/03/19 14:31:06 INFO scheduler.TaskSchedulerImpl: Adding task set 5.0 with 200 tasks
15/03/19 14:31:06 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 5.0 (TID 23, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:06 INFO executor.Executor: Running task 0.0 in stage 5.0 (TID 23)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 0.0 in stage 5.0 (TID 23). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 5.0 (TID 24, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO executor.Executor: Running task 1.0 in stage 5.0 (TID 24)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 5.0 (TID 23) in 473 ms on localhost (1/200)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 1.0 in stage 5.0 (TID 24). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 5.0 (TID 25, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO executor.Executor: Running task 2.0 in stage 5.0 (TID 25)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 5.0 (TID 24) in 106 ms on localhost (2/200)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 2.0 in stage 5.0 (TID 25). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 5.0 (TID 26, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO executor.Executor: Running task 3.0 in stage 5.0 (TID 26)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 5.0 (TID 25) in 95 ms on localhost (3/200)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 3.0 in stage 5.0 (TID 26). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 4.0 in stage 5.0 (TID 27, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 5.0 (TID 26) in 51 ms on localhost (4/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 4.0 in stage 5.0 (TID 27)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 4.0 in stage 5.0 (TID 27). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 5.0 in stage 5.0 (TID 28, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 4.0 in stage 5.0 (TID 27) in 40 ms on localhost (5/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 5.0 in stage 5.0 (TID 28)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 5.0 in stage 5.0 (TID 28). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 6.0 in stage 5.0 (TID 29, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 5.0 (TID 28) in 38 ms on localhost (6/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 6.0 in stage 5.0 (TID 29)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 6.0 in stage 5.0 (TID 29). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 7.0 in stage 5.0 (TID 30, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 6.0 in stage 5.0 (TID 29) in 47 ms on localhost (7/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 7.0 in stage 5.0 (TID 30)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 7.0 in stage 5.0 (TID 30). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 8.0 in stage 5.0 (TID 31, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 7.0 in stage 5.0 (TID 30) in 83 ms on localhost (8/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 8.0 in stage 5.0 (TID 31)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 8.0 in stage 5.0 (TID 31). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 9.0 in stage 5.0 (TID 32, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 8.0 in stage 5.0 (TID 31) in 44 ms on localhost (9/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 9.0 in stage 5.0 (TID 32)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 9.0 in stage 5.0 (TID 32). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 10.0 in stage 5.0 (TID 33, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 5.0 (TID 32) in 60 ms on localhost (10/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 10.0 in stage 5.0 (TID 33)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:07 INFO executor.Executor: Finished task 10.0 in stage 5.0 (TID 33). 2168 bytes result sent to driver
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Starting task 11.0 in stage 5.0 (TID 34, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:07 INFO scheduler.TaskSetManager: Finished task 10.0 in stage 5.0 (TID 33) in 67 ms on localhost (11/200)
15/03/19 14:31:07 INFO executor.Executor: Running task 11.0 in stage 5.0 (TID 34)
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 11.0 in stage 5.0 (TID 34). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 12.0 in stage 5.0 (TID 35, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 11.0 in stage 5.0 (TID 34) in 41 ms on localhost (12/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 12.0 in stage 5.0 (TID 35)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 12.0 in stage 5.0 (TID 35). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 13.0 in stage 5.0 (TID 36, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 12.0 in stage 5.0 (TID 35) in 84 ms on localhost (13/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 13.0 in stage 5.0 (TID 36)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 13.0 in stage 5.0 (TID 36). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 14.0 in stage 5.0 (TID 37, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 13.0 in stage 5.0 (TID 36) in 44 ms on localhost (14/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 14.0 in stage 5.0 (TID 37)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 14.0 in stage 5.0 (TID 37). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 15.0 in stage 5.0 (TID 38, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 14.0 in stage 5.0 (TID 37) in 71 ms on localhost (15/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 15.0 in stage 5.0 (TID 38)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 15.0 in stage 5.0 (TID 38). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 16.0 in stage 5.0 (TID 39, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 15.0 in stage 5.0 (TID 38) in 53 ms on localhost (16/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 16.0 in stage 5.0 (TID 39)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 16.0 in stage 5.0 (TID 39). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 17.0 in stage 5.0 (TID 40, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 16.0 in stage 5.0 (TID 39) in 63 ms on localhost (17/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 17.0 in stage 5.0 (TID 40)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 17.0 in stage 5.0 (TID 40). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 18.0 in stage 5.0 (TID 41, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 17.0 in stage 5.0 (TID 40) in 63 ms on localhost (18/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 18.0 in stage 5.0 (TID 41)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 18.0 in stage 5.0 (TID 41). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 19.0 in stage 5.0 (TID 42, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 18.0 in stage 5.0 (TID 41) in 67 ms on localhost (19/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 19.0 in stage 5.0 (TID 42)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 19.0 in stage 5.0 (TID 42). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 20.0 in stage 5.0 (TID 43, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 19.0 in stage 5.0 (TID 42) in 92 ms on localhost (20/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 20.0 in stage 5.0 (TID 43)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 20.0 in stage 5.0 (TID 43). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 21.0 in stage 5.0 (TID 44, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 20.0 in stage 5.0 (TID 43) in 86 ms on localhost (21/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 21.0 in stage 5.0 (TID 44)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 21.0 in stage 5.0 (TID 44). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 22.0 in stage 5.0 (TID 45, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 21.0 in stage 5.0 (TID 44) in 64 ms on localhost (22/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 22.0 in stage 5.0 (TID 45)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 22.0 in stage 5.0 (TID 45). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 23.0 in stage 5.0 (TID 46, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 22.0 in stage 5.0 (TID 45) in 74 ms on localhost (23/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 23.0 in stage 5.0 (TID 46)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 38 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 23.0 in stage 5.0 (TID 46). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 24.0 in stage 5.0 (TID 47, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 23.0 in stage 5.0 (TID 46) in 78 ms on localhost (24/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 24.0 in stage 5.0 (TID 47)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 37 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 24.0 in stage 5.0 (TID 47). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 25.0 in stage 5.0 (TID 48, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 24.0 in stage 5.0 (TID 47) in 70 ms on localhost (25/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 25.0 in stage 5.0 (TID 48)
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:08 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:08 INFO executor.Executor: Finished task 25.0 in stage 5.0 (TID 48). 2168 bytes result sent to driver
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Starting task 26.0 in stage 5.0 (TID 49, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:08 INFO scheduler.TaskSetManager: Finished task 25.0 in stage 5.0 (TID 48) in 80 ms on localhost (26/200)
15/03/19 14:31:08 INFO executor.Executor: Running task 26.0 in stage 5.0 (TID 49)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 26.0 in stage 5.0 (TID 49). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 27.0 in stage 5.0 (TID 50, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 26.0 in stage 5.0 (TID 49) in 66 ms on localhost (27/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 27.0 in stage 5.0 (TID 50)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 27.0 in stage 5.0 (TID 50). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 28.0 in stage 5.0 (TID 51, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 27.0 in stage 5.0 (TID 50) in 94 ms on localhost (28/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 28.0 in stage 5.0 (TID 51)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 28.0 in stage 5.0 (TID 51). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 29.0 in stage 5.0 (TID 52, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 28.0 in stage 5.0 (TID 51) in 90 ms on localhost (29/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 29.0 in stage 5.0 (TID 52)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 29.0 in stage 5.0 (TID 52). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 30.0 in stage 5.0 (TID 53, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 29.0 in stage 5.0 (TID 52) in 79 ms on localhost (30/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 30.0 in stage 5.0 (TID 53)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 30.0 in stage 5.0 (TID 53). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 31.0 in stage 5.0 (TID 54, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 30.0 in stage 5.0 (TID 53) in 83 ms on localhost (31/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 31.0 in stage 5.0 (TID 54)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 31.0 in stage 5.0 (TID 54). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 32.0 in stage 5.0 (TID 55, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 31.0 in stage 5.0 (TID 54) in 57 ms on localhost (32/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 32.0 in stage 5.0 (TID 55)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 32.0 in stage 5.0 (TID 55). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 33.0 in stage 5.0 (TID 56, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 32.0 in stage 5.0 (TID 55) in 20 ms on localhost (33/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 33.0 in stage 5.0 (TID 56)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 33.0 in stage 5.0 (TID 56). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 34.0 in stage 5.0 (TID 57, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 33.0 in stage 5.0 (TID 56) in 94 ms on localhost (34/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 34.0 in stage 5.0 (TID 57)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 34.0 in stage 5.0 (TID 57). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 35.0 in stage 5.0 (TID 58, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 34.0 in stage 5.0 (TID 57) in 58 ms on localhost (35/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 35.0 in stage 5.0 (TID 58)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 35.0 in stage 5.0 (TID 58). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 36.0 in stage 5.0 (TID 59, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 35.0 in stage 5.0 (TID 58) in 23 ms on localhost (36/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 36.0 in stage 5.0 (TID 59)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 36.0 in stage 5.0 (TID 59). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 37.0 in stage 5.0 (TID 60, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 36.0 in stage 5.0 (TID 59) in 97 ms on localhost (37/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 37.0 in stage 5.0 (TID 60)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 37.0 in stage 5.0 (TID 60). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 38.0 in stage 5.0 (TID 61, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 37.0 in stage 5.0 (TID 60) in 22 ms on localhost (38/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 38.0 in stage 5.0 (TID 61)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 38.0 in stage 5.0 (TID 61). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 39.0 in stage 5.0 (TID 62, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 38.0 in stage 5.0 (TID 61) in 53 ms on localhost (39/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 39.0 in stage 5.0 (TID 62)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 39.0 in stage 5.0 (TID 62). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 40.0 in stage 5.0 (TID 63, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 39.0 in stage 5.0 (TID 62) in 42 ms on localhost (40/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 40.0 in stage 5.0 (TID 63)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 40.0 in stage 5.0 (TID 63). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 41.0 in stage 5.0 (TID 64, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 40.0 in stage 5.0 (TID 63) in 43 ms on localhost (41/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 41.0 in stage 5.0 (TID 64)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 41.0 in stage 5.0 (TID 64). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 42.0 in stage 5.0 (TID 65, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 41.0 in stage 5.0 (TID 64) in 69 ms on localhost (42/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 42.0 in stage 5.0 (TID 65)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 42.0 in stage 5.0 (TID 65). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 43.0 in stage 5.0 (TID 66, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 42.0 in stage 5.0 (TID 65) in 44 ms on localhost (43/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 43.0 in stage 5.0 (TID 66)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 43.0 in stage 5.0 (TID 66). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 44.0 in stage 5.0 (TID 67, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 43.0 in stage 5.0 (TID 66) in 27 ms on localhost (44/200)
15/03/19 14:31:09 INFO executor.Executor: Running task 44.0 in stage 5.0 (TID 67)
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:09 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:09 INFO executor.Executor: Finished task 44.0 in stage 5.0 (TID 67). 2168 bytes result sent to driver
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Starting task 45.0 in stage 5.0 (TID 68, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:09 INFO scheduler.TaskSetManager: Finished task 44.0 in stage 5.0 (TID 67) in 14 ms on localhost (45/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 45.0 in stage 5.0 (TID 68)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 45.0 in stage 5.0 (TID 68). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 46.0 in stage 5.0 (TID 69, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 45.0 in stage 5.0 (TID 68) in 32 ms on localhost (46/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 46.0 in stage 5.0 (TID 69)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 46.0 in stage 5.0 (TID 69). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 47.0 in stage 5.0 (TID 70, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 46.0 in stage 5.0 (TID 69) in 43 ms on localhost (47/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 47.0 in stage 5.0 (TID 70)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 47.0 in stage 5.0 (TID 70). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 48.0 in stage 5.0 (TID 71, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 47.0 in stage 5.0 (TID 70) in 47 ms on localhost (48/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 48.0 in stage 5.0 (TID 71)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 48.0 in stage 5.0 (TID 71). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 49.0 in stage 5.0 (TID 72, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 48.0 in stage 5.0 (TID 71) in 41 ms on localhost (49/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 49.0 in stage 5.0 (TID 72)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 49.0 in stage 5.0 (TID 72). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 50.0 in stage 5.0 (TID 73, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 49.0 in stage 5.0 (TID 72) in 22 ms on localhost (50/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 50.0 in stage 5.0 (TID 73)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 50.0 in stage 5.0 (TID 73). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 51.0 in stage 5.0 (TID 74, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 50.0 in stage 5.0 (TID 73) in 36 ms on localhost (51/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 51.0 in stage 5.0 (TID 74)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 51.0 in stage 5.0 (TID 74). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 52.0 in stage 5.0 (TID 75, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 51.0 in stage 5.0 (TID 74) in 44 ms on localhost (52/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 52.0 in stage 5.0 (TID 75)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 52.0 in stage 5.0 (TID 75). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 53.0 in stage 5.0 (TID 76, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 52.0 in stage 5.0 (TID 75) in 29 ms on localhost (53/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 53.0 in stage 5.0 (TID 76)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 53.0 in stage 5.0 (TID 76). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 54.0 in stage 5.0 (TID 77, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 53.0 in stage 5.0 (TID 76) in 33 ms on localhost (54/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 54.0 in stage 5.0 (TID 77)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 54.0 in stage 5.0 (TID 77). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 55.0 in stage 5.0 (TID 78, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 54.0 in stage 5.0 (TID 77) in 27 ms on localhost (55/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 55.0 in stage 5.0 (TID 78)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 55.0 in stage 5.0 (TID 78). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 56.0 in stage 5.0 (TID 79, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 55.0 in stage 5.0 (TID 78) in 31 ms on localhost (56/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 56.0 in stage 5.0 (TID 79)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 56.0 in stage 5.0 (TID 79). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 57.0 in stage 5.0 (TID 80, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 56.0 in stage 5.0 (TID 79) in 43 ms on localhost (57/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 57.0 in stage 5.0 (TID 80)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 57.0 in stage 5.0 (TID 80). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 58.0 in stage 5.0 (TID 81, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 57.0 in stage 5.0 (TID 80) in 33 ms on localhost (58/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 58.0 in stage 5.0 (TID 81)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 58.0 in stage 5.0 (TID 81). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 59.0 in stage 5.0 (TID 82, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 58.0 in stage 5.0 (TID 81) in 35 ms on localhost (59/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 59.0 in stage 5.0 (TID 82)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 59.0 in stage 5.0 (TID 82). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 60.0 in stage 5.0 (TID 83, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 59.0 in stage 5.0 (TID 82) in 41 ms on localhost (60/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 60.0 in stage 5.0 (TID 83)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 60.0 in stage 5.0 (TID 83). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 61.0 in stage 5.0 (TID 84, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 60.0 in stage 5.0 (TID 83) in 35 ms on localhost (61/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 61.0 in stage 5.0 (TID 84)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 61.0 in stage 5.0 (TID 84). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 62.0 in stage 5.0 (TID 85, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 61.0 in stage 5.0 (TID 84) in 73 ms on localhost (62/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 62.0 in stage 5.0 (TID 85)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 62.0 in stage 5.0 (TID 85). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 63.0 in stage 5.0 (TID 86, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 62.0 in stage 5.0 (TID 85) in 22 ms on localhost (63/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 63.0 in stage 5.0 (TID 86)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 63.0 in stage 5.0 (TID 86). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 64.0 in stage 5.0 (TID 87, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 63.0 in stage 5.0 (TID 86) in 34 ms on localhost (64/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 64.0 in stage 5.0 (TID 87)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 64.0 in stage 5.0 (TID 87). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 65.0 in stage 5.0 (TID 88, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 64.0 in stage 5.0 (TID 87) in 25 ms on localhost (65/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 65.0 in stage 5.0 (TID 88)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 65.0 in stage 5.0 (TID 88). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 66.0 in stage 5.0 (TID 89, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 65.0 in stage 5.0 (TID 88) in 29 ms on localhost (66/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 66.0 in stage 5.0 (TID 89)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 66.0 in stage 5.0 (TID 89). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 67.0 in stage 5.0 (TID 90, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 66.0 in stage 5.0 (TID 89) in 28 ms on localhost (67/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 67.0 in stage 5.0 (TID 90)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 67.0 in stage 5.0 (TID 90). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 68.0 in stage 5.0 (TID 91, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 67.0 in stage 5.0 (TID 90) in 35 ms on localhost (68/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 68.0 in stage 5.0 (TID 91)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 68.0 in stage 5.0 (TID 91). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 69.0 in stage 5.0 (TID 92, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 68.0 in stage 5.0 (TID 91) in 16 ms on localhost (69/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 69.0 in stage 5.0 (TID 92)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 69.0 in stage 5.0 (TID 92). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 70.0 in stage 5.0 (TID 93, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 69.0 in stage 5.0 (TID 92) in 39 ms on localhost (70/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 70.0 in stage 5.0 (TID 93)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 70.0 in stage 5.0 (TID 93). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 71.0 in stage 5.0 (TID 94, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 70.0 in stage 5.0 (TID 93) in 52 ms on localhost (71/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 71.0 in stage 5.0 (TID 94)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 71.0 in stage 5.0 (TID 94). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 72.0 in stage 5.0 (TID 95, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 71.0 in stage 5.0 (TID 94) in 67 ms on localhost (72/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 72.0 in stage 5.0 (TID 95)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 72.0 in stage 5.0 (TID 95). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 73.0 in stage 5.0 (TID 96, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 72.0 in stage 5.0 (TID 95) in 53 ms on localhost (73/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 73.0 in stage 5.0 (TID 96)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 73.0 in stage 5.0 (TID 96). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 74.0 in stage 5.0 (TID 97, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Finished task 73.0 in stage 5.0 (TID 96) in 43 ms on localhost (74/200)
15/03/19 14:31:10 INFO executor.Executor: Running task 74.0 in stage 5.0 (TID 97)
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:10 INFO executor.Executor: Finished task 74.0 in stage 5.0 (TID 97). 2168 bytes result sent to driver
15/03/19 14:31:10 INFO scheduler.TaskSetManager: Starting task 75.0 in stage 5.0 (TID 98, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 74.0 in stage 5.0 (TID 97) in 42 ms on localhost (75/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 75.0 in stage 5.0 (TID 98)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 75.0 in stage 5.0 (TID 98). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 76.0 in stage 5.0 (TID 99, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 75.0 in stage 5.0 (TID 98) in 55 ms on localhost (76/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 76.0 in stage 5.0 (TID 99)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 76.0 in stage 5.0 (TID 99). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 77.0 in stage 5.0 (TID 100, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 76.0 in stage 5.0 (TID 99) in 42 ms on localhost (77/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 77.0 in stage 5.0 (TID 100)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 77.0 in stage 5.0 (TID 100). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 78.0 in stage 5.0 (TID 101, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 77.0 in stage 5.0 (TID 100) in 34 ms on localhost (78/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 78.0 in stage 5.0 (TID 101)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 78.0 in stage 5.0 (TID 101). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 79.0 in stage 5.0 (TID 102, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 78.0 in stage 5.0 (TID 101) in 21 ms on localhost (79/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 79.0 in stage 5.0 (TID 102)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 79.0 in stage 5.0 (TID 102). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 80.0 in stage 5.0 (TID 103, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 79.0 in stage 5.0 (TID 102) in 26 ms on localhost (80/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 80.0 in stage 5.0 (TID 103)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 80.0 in stage 5.0 (TID 103). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 81.0 in stage 5.0 (TID 104, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 80.0 in stage 5.0 (TID 103) in 41 ms on localhost (81/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 81.0 in stage 5.0 (TID 104)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 81.0 in stage 5.0 (TID 104). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 82.0 in stage 5.0 (TID 105, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 81.0 in stage 5.0 (TID 104) in 56 ms on localhost (82/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 82.0 in stage 5.0 (TID 105)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 82.0 in stage 5.0 (TID 105). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 83.0 in stage 5.0 (TID 106, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 82.0 in stage 5.0 (TID 105) in 25 ms on localhost (83/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 83.0 in stage 5.0 (TID 106)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 83.0 in stage 5.0 (TID 106). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 84.0 in stage 5.0 (TID 107, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 83.0 in stage 5.0 (TID 106) in 31 ms on localhost (84/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 84.0 in stage 5.0 (TID 107)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 84.0 in stage 5.0 (TID 107). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 85.0 in stage 5.0 (TID 108, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 84.0 in stage 5.0 (TID 107) in 54 ms on localhost (85/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 85.0 in stage 5.0 (TID 108)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 85.0 in stage 5.0 (TID 108). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 86.0 in stage 5.0 (TID 109, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 85.0 in stage 5.0 (TID 108) in 48 ms on localhost (86/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 86.0 in stage 5.0 (TID 109)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 86.0 in stage 5.0 (TID 109). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 87.0 in stage 5.0 (TID 110, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 86.0 in stage 5.0 (TID 109) in 30 ms on localhost (87/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 87.0 in stage 5.0 (TID 110)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 87.0 in stage 5.0 (TID 110). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 88.0 in stage 5.0 (TID 111, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 87.0 in stage 5.0 (TID 110) in 36 ms on localhost (88/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 88.0 in stage 5.0 (TID 111)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 88.0 in stage 5.0 (TID 111). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 89.0 in stage 5.0 (TID 112, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 88.0 in stage 5.0 (TID 111) in 45 ms on localhost (89/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 89.0 in stage 5.0 (TID 112)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 89.0 in stage 5.0 (TID 112). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 90.0 in stage 5.0 (TID 113, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 89.0 in stage 5.0 (TID 112) in 81 ms on localhost (90/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 90.0 in stage 5.0 (TID 113)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 90.0 in stage 5.0 (TID 113). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 91.0 in stage 5.0 (TID 114, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 90.0 in stage 5.0 (TID 113) in 42 ms on localhost (91/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 91.0 in stage 5.0 (TID 114)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 91.0 in stage 5.0 (TID 114). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 92.0 in stage 5.0 (TID 115, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 91.0 in stage 5.0 (TID 114) in 25 ms on localhost (92/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 92.0 in stage 5.0 (TID 115)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 92.0 in stage 5.0 (TID 115). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 93.0 in stage 5.0 (TID 116, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 92.0 in stage 5.0 (TID 115) in 62 ms on localhost (93/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 93.0 in stage 5.0 (TID 116)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 93.0 in stage 5.0 (TID 116). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 94.0 in stage 5.0 (TID 117, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 93.0 in stage 5.0 (TID 116) in 39 ms on localhost (94/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 94.0 in stage 5.0 (TID 117)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 94.0 in stage 5.0 (TID 117). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 95.0 in stage 5.0 (TID 118, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 94.0 in stage 5.0 (TID 117) in 50 ms on localhost (95/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 95.0 in stage 5.0 (TID 118)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 95.0 in stage 5.0 (TID 118). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 96.0 in stage 5.0 (TID 119, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 95.0 in stage 5.0 (TID 118) in 39 ms on localhost (96/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 96.0 in stage 5.0 (TID 119)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 96.0 in stage 5.0 (TID 119). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 97.0 in stage 5.0 (TID 120, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 96.0 in stage 5.0 (TID 119) in 29 ms on localhost (97/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 97.0 in stage 5.0 (TID 120)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 97.0 in stage 5.0 (TID 120). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 98.0 in stage 5.0 (TID 121, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 97.0 in stage 5.0 (TID 120) in 35 ms on localhost (98/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 98.0 in stage 5.0 (TID 121)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 98.0 in stage 5.0 (TID 121). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 99.0 in stage 5.0 (TID 122, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 98.0 in stage 5.0 (TID 121) in 17 ms on localhost (99/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 99.0 in stage 5.0 (TID 122)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 99.0 in stage 5.0 (TID 122). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 100.0 in stage 5.0 (TID 123, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 99.0 in stage 5.0 (TID 122) in 35 ms on localhost (100/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 100.0 in stage 5.0 (TID 123)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 100.0 in stage 5.0 (TID 123). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 101.0 in stage 5.0 (TID 124, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 100.0 in stage 5.0 (TID 123) in 42 ms on localhost (101/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 101.0 in stage 5.0 (TID 124)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 101.0 in stage 5.0 (TID 124). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 102.0 in stage 5.0 (TID 125, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Finished task 101.0 in stage 5.0 (TID 124) in 53 ms on localhost (102/200)
15/03/19 14:31:11 INFO executor.Executor: Running task 102.0 in stage 5.0 (TID 125)
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:11 INFO executor.Executor: Finished task 102.0 in stage 5.0 (TID 125). 2168 bytes result sent to driver
15/03/19 14:31:11 INFO scheduler.TaskSetManager: Starting task 103.0 in stage 5.0 (TID 126, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 102.0 in stage 5.0 (TID 125) in 14 ms on localhost (103/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 103.0 in stage 5.0 (TID 126)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 103.0 in stage 5.0 (TID 126). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 104.0 in stage 5.0 (TID 127, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 103.0 in stage 5.0 (TID 126) in 41 ms on localhost (104/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 104.0 in stage 5.0 (TID 127)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 104.0 in stage 5.0 (TID 127). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 105.0 in stage 5.0 (TID 128, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 104.0 in stage 5.0 (TID 127) in 34 ms on localhost (105/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 105.0 in stage 5.0 (TID 128)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 105.0 in stage 5.0 (TID 128). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 106.0 in stage 5.0 (TID 129, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 105.0 in stage 5.0 (TID 128) in 40 ms on localhost (106/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 106.0 in stage 5.0 (TID 129)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 106.0 in stage 5.0 (TID 129). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 107.0 in stage 5.0 (TID 130, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 106.0 in stage 5.0 (TID 129) in 68 ms on localhost (107/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 107.0 in stage 5.0 (TID 130)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 107.0 in stage 5.0 (TID 130). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 108.0 in stage 5.0 (TID 131, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 107.0 in stage 5.0 (TID 130) in 13 ms on localhost (108/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 108.0 in stage 5.0 (TID 131)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 108.0 in stage 5.0 (TID 131). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 109.0 in stage 5.0 (TID 132, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 108.0 in stage 5.0 (TID 131) in 40 ms on localhost (109/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 109.0 in stage 5.0 (TID 132)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 109.0 in stage 5.0 (TID 132). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 110.0 in stage 5.0 (TID 133, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 109.0 in stage 5.0 (TID 132) in 39 ms on localhost (110/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 110.0 in stage 5.0 (TID 133)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 110.0 in stage 5.0 (TID 133). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 111.0 in stage 5.0 (TID 134, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 110.0 in stage 5.0 (TID 133) in 18 ms on localhost (111/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 111.0 in stage 5.0 (TID 134)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 111.0 in stage 5.0 (TID 134). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 112.0 in stage 5.0 (TID 135, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 111.0 in stage 5.0 (TID 134) in 62 ms on localhost (112/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 112.0 in stage 5.0 (TID 135)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 112.0 in stage 5.0 (TID 135). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 113.0 in stage 5.0 (TID 136, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 112.0 in stage 5.0 (TID 135) in 14 ms on localhost (113/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 113.0 in stage 5.0 (TID 136)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 113.0 in stage 5.0 (TID 136). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 114.0 in stage 5.0 (TID 137, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 113.0 in stage 5.0 (TID 136) in 26 ms on localhost (114/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 114.0 in stage 5.0 (TID 137)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 114.0 in stage 5.0 (TID 137). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 115.0 in stage 5.0 (TID 138, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 114.0 in stage 5.0 (TID 137) in 15 ms on localhost (115/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 115.0 in stage 5.0 (TID 138)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 115.0 in stage 5.0 (TID 138). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 116.0 in stage 5.0 (TID 139, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 115.0 in stage 5.0 (TID 138) in 23 ms on localhost (116/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 116.0 in stage 5.0 (TID 139)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 116.0 in stage 5.0 (TID 139). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 117.0 in stage 5.0 (TID 140, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 116.0 in stage 5.0 (TID 139) in 30 ms on localhost (117/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 117.0 in stage 5.0 (TID 140)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 117.0 in stage 5.0 (TID 140). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 118.0 in stage 5.0 (TID 141, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 117.0 in stage 5.0 (TID 140) in 16 ms on localhost (118/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 118.0 in stage 5.0 (TID 141)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 118.0 in stage 5.0 (TID 141). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 119.0 in stage 5.0 (TID 142, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 118.0 in stage 5.0 (TID 141) in 41 ms on localhost (119/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 119.0 in stage 5.0 (TID 142)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 119.0 in stage 5.0 (TID 142). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 120.0 in stage 5.0 (TID 143, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 119.0 in stage 5.0 (TID 142) in 25 ms on localhost (120/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 120.0 in stage 5.0 (TID 143)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 120.0 in stage 5.0 (TID 143). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 121.0 in stage 5.0 (TID 144, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 120.0 in stage 5.0 (TID 143) in 28 ms on localhost (121/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 121.0 in stage 5.0 (TID 144)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 121.0 in stage 5.0 (TID 144). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 122.0 in stage 5.0 (TID 145, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 121.0 in stage 5.0 (TID 144) in 44 ms on localhost (122/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 122.0 in stage 5.0 (TID 145)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 122.0 in stage 5.0 (TID 145). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 123.0 in stage 5.0 (TID 146, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 122.0 in stage 5.0 (TID 145) in 38 ms on localhost (123/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 123.0 in stage 5.0 (TID 146)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 123.0 in stage 5.0 (TID 146). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 124.0 in stage 5.0 (TID 147, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 123.0 in stage 5.0 (TID 146) in 23 ms on localhost (124/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 124.0 in stage 5.0 (TID 147)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 124.0 in stage 5.0 (TID 147). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 125.0 in stage 5.0 (TID 148, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 124.0 in stage 5.0 (TID 147) in 20 ms on localhost (125/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 125.0 in stage 5.0 (TID 148)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 125.0 in stage 5.0 (TID 148). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 126.0 in stage 5.0 (TID 149, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 125.0 in stage 5.0 (TID 148) in 24 ms on localhost (126/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 126.0 in stage 5.0 (TID 149)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 126.0 in stage 5.0 (TID 149). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 127.0 in stage 5.0 (TID 150, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 126.0 in stage 5.0 (TID 149) in 32 ms on localhost (127/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 127.0 in stage 5.0 (TID 150)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 127.0 in stage 5.0 (TID 150). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 128.0 in stage 5.0 (TID 151, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 127.0 in stage 5.0 (TID 150) in 47 ms on localhost (128/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 128.0 in stage 5.0 (TID 151)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 128.0 in stage 5.0 (TID 151). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 129.0 in stage 5.0 (TID 152, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 128.0 in stage 5.0 (TID 151) in 22 ms on localhost (129/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 129.0 in stage 5.0 (TID 152)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 129.0 in stage 5.0 (TID 152). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 130.0 in stage 5.0 (TID 153, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 129.0 in stage 5.0 (TID 152) in 40 ms on localhost (130/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 130.0 in stage 5.0 (TID 153)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 130.0 in stage 5.0 (TID 153). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 131.0 in stage 5.0 (TID 154, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 130.0 in stage 5.0 (TID 153) in 33 ms on localhost (131/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 131.0 in stage 5.0 (TID 154)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 131.0 in stage 5.0 (TID 154). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 132.0 in stage 5.0 (TID 155, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 131.0 in stage 5.0 (TID 154) in 12 ms on localhost (132/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 132.0 in stage 5.0 (TID 155)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 132.0 in stage 5.0 (TID 155). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 133.0 in stage 5.0 (TID 156, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 132.0 in stage 5.0 (TID 155) in 39 ms on localhost (133/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 133.0 in stage 5.0 (TID 156)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 133.0 in stage 5.0 (TID 156). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 134.0 in stage 5.0 (TID 157, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 133.0 in stage 5.0 (TID 156) in 44 ms on localhost (134/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 134.0 in stage 5.0 (TID 157)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 134.0 in stage 5.0 (TID 157). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 135.0 in stage 5.0 (TID 158, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 134.0 in stage 5.0 (TID 157) in 16 ms on localhost (135/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 135.0 in stage 5.0 (TID 158)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 135.0 in stage 5.0 (TID 158). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 136.0 in stage 5.0 (TID 159, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 135.0 in stage 5.0 (TID 158) in 37 ms on localhost (136/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 136.0 in stage 5.0 (TID 159)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 136.0 in stage 5.0 (TID 159). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 137.0 in stage 5.0 (TID 160, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 136.0 in stage 5.0 (TID 159) in 12 ms on localhost (137/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 137.0 in stage 5.0 (TID 160)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 137.0 in stage 5.0 (TID 160). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 138.0 in stage 5.0 (TID 161, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 137.0 in stage 5.0 (TID 160) in 30 ms on localhost (138/200)
15/03/19 14:31:12 INFO executor.Executor: Running task 138.0 in stage 5.0 (TID 161)
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:12 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:12 INFO executor.Executor: Finished task 138.0 in stage 5.0 (TID 161). 2168 bytes result sent to driver
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Starting task 139.0 in stage 5.0 (TID 162, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:12 INFO scheduler.TaskSetManager: Finished task 138.0 in stage 5.0 (TID 161) in 23 ms on localhost (139/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 139.0 in stage 5.0 (TID 162)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 139.0 in stage 5.0 (TID 162). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 140.0 in stage 5.0 (TID 163, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 139.0 in stage 5.0 (TID 162) in 15 ms on localhost (140/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 140.0 in stage 5.0 (TID 163)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 140.0 in stage 5.0 (TID 163). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 141.0 in stage 5.0 (TID 164, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 140.0 in stage 5.0 (TID 163) in 18 ms on localhost (141/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 141.0 in stage 5.0 (TID 164)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 141.0 in stage 5.0 (TID 164). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 142.0 in stage 5.0 (TID 165, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 141.0 in stage 5.0 (TID 164) in 43 ms on localhost (142/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 142.0 in stage 5.0 (TID 165)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 142.0 in stage 5.0 (TID 165). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 143.0 in stage 5.0 (TID 166, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 142.0 in stage 5.0 (TID 165) in 39 ms on localhost (143/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 143.0 in stage 5.0 (TID 166)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 143.0 in stage 5.0 (TID 166). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 144.0 in stage 5.0 (TID 167, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 143.0 in stage 5.0 (TID 166) in 11 ms on localhost (144/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 144.0 in stage 5.0 (TID 167)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 144.0 in stage 5.0 (TID 167). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 145.0 in stage 5.0 (TID 168, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 144.0 in stage 5.0 (TID 167) in 30 ms on localhost (145/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 145.0 in stage 5.0 (TID 168)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 145.0 in stage 5.0 (TID 168). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 146.0 in stage 5.0 (TID 169, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 145.0 in stage 5.0 (TID 168) in 12 ms on localhost (146/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 146.0 in stage 5.0 (TID 169)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 146.0 in stage 5.0 (TID 169). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 147.0 in stage 5.0 (TID 170, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 146.0 in stage 5.0 (TID 169) in 39 ms on localhost (147/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 147.0 in stage 5.0 (TID 170)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 147.0 in stage 5.0 (TID 170). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 148.0 in stage 5.0 (TID 171, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 147.0 in stage 5.0 (TID 170) in 26 ms on localhost (148/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 148.0 in stage 5.0 (TID 171)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 148.0 in stage 5.0 (TID 171). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 149.0 in stage 5.0 (TID 172, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 148.0 in stage 5.0 (TID 171) in 26 ms on localhost (149/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 149.0 in stage 5.0 (TID 172)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 149.0 in stage 5.0 (TID 172). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 150.0 in stage 5.0 (TID 173, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 149.0 in stage 5.0 (TID 172) in 46 ms on localhost (150/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 150.0 in stage 5.0 (TID 173)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 150.0 in stage 5.0 (TID 173). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 151.0 in stage 5.0 (TID 174, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 150.0 in stage 5.0 (TID 173) in 26 ms on localhost (151/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 151.0 in stage 5.0 (TID 174)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 151.0 in stage 5.0 (TID 174). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 152.0 in stage 5.0 (TID 175, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 151.0 in stage 5.0 (TID 174) in 29 ms on localhost (152/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 152.0 in stage 5.0 (TID 175)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 152.0 in stage 5.0 (TID 175). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 153.0 in stage 5.0 (TID 176, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 152.0 in stage 5.0 (TID 175) in 29 ms on localhost (153/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 153.0 in stage 5.0 (TID 176)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 153.0 in stage 5.0 (TID 176). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 154.0 in stage 5.0 (TID 177, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 153.0 in stage 5.0 (TID 176) in 38 ms on localhost (154/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 154.0 in stage 5.0 (TID 177)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 154.0 in stage 5.0 (TID 177). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 155.0 in stage 5.0 (TID 178, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 154.0 in stage 5.0 (TID 177) in 55 ms on localhost (155/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 155.0 in stage 5.0 (TID 178)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 155.0 in stage 5.0 (TID 178). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 156.0 in stage 5.0 (TID 179, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 155.0 in stage 5.0 (TID 178) in 27 ms on localhost (156/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 156.0 in stage 5.0 (TID 179)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 156.0 in stage 5.0 (TID 179). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 157.0 in stage 5.0 (TID 180, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 156.0 in stage 5.0 (TID 179) in 52 ms on localhost (157/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 157.0 in stage 5.0 (TID 180)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 157.0 in stage 5.0 (TID 180). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 158.0 in stage 5.0 (TID 181, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 157.0 in stage 5.0 (TID 180) in 38 ms on localhost (158/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 158.0 in stage 5.0 (TID 181)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 158.0 in stage 5.0 (TID 181). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 159.0 in stage 5.0 (TID 182, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 158.0 in stage 5.0 (TID 181) in 15 ms on localhost (159/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 159.0 in stage 5.0 (TID 182)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 159.0 in stage 5.0 (TID 182). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 160.0 in stage 5.0 (TID 183, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 159.0 in stage 5.0 (TID 182) in 53 ms on localhost (160/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 160.0 in stage 5.0 (TID 183)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 160.0 in stage 5.0 (TID 183). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 161.0 in stage 5.0 (TID 184, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 160.0 in stage 5.0 (TID 183) in 41 ms on localhost (161/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 161.0 in stage 5.0 (TID 184)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 161.0 in stage 5.0 (TID 184). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 162.0 in stage 5.0 (TID 185, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 161.0 in stage 5.0 (TID 184) in 56 ms on localhost (162/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 162.0 in stage 5.0 (TID 185)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 162.0 in stage 5.0 (TID 185). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 163.0 in stage 5.0 (TID 186, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 162.0 in stage 5.0 (TID 185) in 51 ms on localhost (163/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 163.0 in stage 5.0 (TID 186)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 163.0 in stage 5.0 (TID 186). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 164.0 in stage 5.0 (TID 187, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 163.0 in stage 5.0 (TID 186) in 12 ms on localhost (164/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 164.0 in stage 5.0 (TID 187)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 164.0 in stage 5.0 (TID 187). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 165.0 in stage 5.0 (TID 188, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 164.0 in stage 5.0 (TID 187) in 50 ms on localhost (165/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 165.0 in stage 5.0 (TID 188)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 165.0 in stage 5.0 (TID 188). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 166.0 in stage 5.0 (TID 189, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 165.0 in stage 5.0 (TID 188) in 11 ms on localhost (166/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 166.0 in stage 5.0 (TID 189)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 166.0 in stage 5.0 (TID 189). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 167.0 in stage 5.0 (TID 190, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 166.0 in stage 5.0 (TID 189) in 38 ms on localhost (167/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 167.0 in stage 5.0 (TID 190)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 167.0 in stage 5.0 (TID 190). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 168.0 in stage 5.0 (TID 191, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 167.0 in stage 5.0 (TID 190) in 19 ms on localhost (168/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 168.0 in stage 5.0 (TID 191)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 168.0 in stage 5.0 (TID 191). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 169.0 in stage 5.0 (TID 192, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 168.0 in stage 5.0 (TID 191) in 27 ms on localhost (169/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 169.0 in stage 5.0 (TID 192)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 169.0 in stage 5.0 (TID 192). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 170.0 in stage 5.0 (TID 193, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 169.0 in stage 5.0 (TID 192) in 13 ms on localhost (170/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 170.0 in stage 5.0 (TID 193)
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:13 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:13 INFO executor.Executor: Finished task 170.0 in stage 5.0 (TID 193). 2168 bytes result sent to driver
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Starting task 171.0 in stage 5.0 (TID 194, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:13 INFO scheduler.TaskSetManager: Finished task 170.0 in stage 5.0 (TID 193) in 24 ms on localhost (171/200)
15/03/19 14:31:13 INFO executor.Executor: Running task 171.0 in stage 5.0 (TID 194)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 171.0 in stage 5.0 (TID 194). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 172.0 in stage 5.0 (TID 195, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 171.0 in stage 5.0 (TID 194) in 169 ms on localhost (172/200)
15/03/19 14:31:14 INFO storage.BlockManager: Removing broadcast 6
15/03/19 14:31:14 INFO storage.BlockManager: Removing block broadcast_6_piece0
15/03/19 14:31:14 INFO storage.MemoryStore: Block broadcast_6_piece0 of size 5455 dropped from memory (free 280223951)
15/03/19 14:31:14 INFO storage.BlockManagerInfo: Removed broadcast_6_piece0 on localhost:42723 in memory (size: 5.3 KB, free: 267.3 MB)
15/03/19 14:31:14 INFO executor.Executor: Running task 172.0 in stage 5.0 (TID 195)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 172.0 in stage 5.0 (TID 195). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 173.0 in stage 5.0 (TID 196, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 172.0 in stage 5.0 (TID 195) in 26 ms on localhost (173/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 173.0 in stage 5.0 (TID 196)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 173.0 in stage 5.0 (TID 196). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 174.0 in stage 5.0 (TID 197, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 173.0 in stage 5.0 (TID 196) in 16 ms on localhost (174/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 174.0 in stage 5.0 (TID 197)
15/03/19 14:31:14 INFO storage.BlockManagerMaster: Updated info of block broadcast_6_piece0
15/03/19 14:31:14 INFO storage.BlockManager: Removing block broadcast_6
15/03/19 14:31:14 INFO storage.MemoryStore: Block broadcast_6 of size 8400 dropped from memory (free 280232351)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 174.0 in stage 5.0 (TID 197). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 175.0 in stage 5.0 (TID 198, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO spark.ContextCleaner: Cleaned broadcast 6
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 174.0 in stage 5.0 (TID 197) in 50 ms on localhost (175/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 175.0 in stage 5.0 (TID 198)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 175.0 in stage 5.0 (TID 198). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 176.0 in stage 5.0 (TID 199, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 175.0 in stage 5.0 (TID 198) in 37 ms on localhost (176/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 176.0 in stage 5.0 (TID 199)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 176.0 in stage 5.0 (TID 199). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 177.0 in stage 5.0 (TID 200, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 176.0 in stage 5.0 (TID 199) in 12 ms on localhost (177/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 177.0 in stage 5.0 (TID 200)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 177.0 in stage 5.0 (TID 200). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 178.0 in stage 5.0 (TID 201, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 177.0 in stage 5.0 (TID 200) in 28 ms on localhost (178/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 178.0 in stage 5.0 (TID 201)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 178.0 in stage 5.0 (TID 201). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 179.0 in stage 5.0 (TID 202, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 178.0 in stage 5.0 (TID 201) in 13 ms on localhost (179/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 179.0 in stage 5.0 (TID 202)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 179.0 in stage 5.0 (TID 202). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 180.0 in stage 5.0 (TID 203, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 179.0 in stage 5.0 (TID 202) in 21 ms on localhost (180/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 180.0 in stage 5.0 (TID 203)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 180.0 in stage 5.0 (TID 203). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 181.0 in stage 5.0 (TID 204, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 180.0 in stage 5.0 (TID 203) in 14 ms on localhost (181/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 181.0 in stage 5.0 (TID 204)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 181.0 in stage 5.0 (TID 204). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 182.0 in stage 5.0 (TID 205, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 181.0 in stage 5.0 (TID 204) in 26 ms on localhost (182/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 182.0 in stage 5.0 (TID 205)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 182.0 in stage 5.0 (TID 205). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 183.0 in stage 5.0 (TID 206, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 182.0 in stage 5.0 (TID 205) in 13 ms on localhost (183/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 183.0 in stage 5.0 (TID 206)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 183.0 in stage 5.0 (TID 206). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 184.0 in stage 5.0 (TID 207, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 183.0 in stage 5.0 (TID 206) in 26 ms on localhost (184/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 184.0 in stage 5.0 (TID 207)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 184.0 in stage 5.0 (TID 207). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 185.0 in stage 5.0 (TID 208, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 184.0 in stage 5.0 (TID 207) in 10 ms on localhost (185/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 185.0 in stage 5.0 (TID 208)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 185.0 in stage 5.0 (TID 208). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 186.0 in stage 5.0 (TID 209, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 185.0 in stage 5.0 (TID 208) in 24 ms on localhost (186/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 186.0 in stage 5.0 (TID 209)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 186.0 in stage 5.0 (TID 209). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 187.0 in stage 5.0 (TID 210, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 186.0 in stage 5.0 (TID 209) in 16 ms on localhost (187/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 187.0 in stage 5.0 (TID 210)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 187.0 in stage 5.0 (TID 210). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 188.0 in stage 5.0 (TID 211, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 187.0 in stage 5.0 (TID 210) in 31 ms on localhost (188/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 188.0 in stage 5.0 (TID 211)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 188.0 in stage 5.0 (TID 211). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 189.0 in stage 5.0 (TID 212, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 188.0 in stage 5.0 (TID 211) in 29 ms on localhost (189/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 189.0 in stage 5.0 (TID 212)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 189.0 in stage 5.0 (TID 212). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 190.0 in stage 5.0 (TID 213, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 189.0 in stage 5.0 (TID 212) in 16 ms on localhost (190/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 190.0 in stage 5.0 (TID 213)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 190.0 in stage 5.0 (TID 213). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 191.0 in stage 5.0 (TID 214, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 190.0 in stage 5.0 (TID 213) in 36 ms on localhost (191/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 191.0 in stage 5.0 (TID 214)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 191.0 in stage 5.0 (TID 214). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 192.0 in stage 5.0 (TID 215, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 191.0 in stage 5.0 (TID 214) in 31 ms on localhost (192/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 192.0 in stage 5.0 (TID 215)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 192.0 in stage 5.0 (TID 215). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 193.0 in stage 5.0 (TID 216, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 192.0 in stage 5.0 (TID 215) in 16 ms on localhost (193/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 193.0 in stage 5.0 (TID 216)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 193.0 in stage 5.0 (TID 216). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 194.0 in stage 5.0 (TID 217, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 193.0 in stage 5.0 (TID 216) in 34 ms on localhost (194/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 194.0 in stage 5.0 (TID 217)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 194.0 in stage 5.0 (TID 217). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 195.0 in stage 5.0 (TID 218, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 194.0 in stage 5.0 (TID 217) in 15 ms on localhost (195/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 195.0 in stage 5.0 (TID 218)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 195.0 in stage 5.0 (TID 218). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 196.0 in stage 5.0 (TID 219, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 195.0 in stage 5.0 (TID 218) in 35 ms on localhost (196/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 196.0 in stage 5.0 (TID 219)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 196.0 in stage 5.0 (TID 219). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 197.0 in stage 5.0 (TID 220, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 196.0 in stage 5.0 (TID 219) in 14 ms on localhost (197/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 197.0 in stage 5.0 (TID 220)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 197.0 in stage 5.0 (TID 220). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 198.0 in stage 5.0 (TID 221, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 197.0 in stage 5.0 (TID 220) in 34 ms on localhost (198/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 198.0 in stage 5.0 (TID 221)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 198.0 in stage 5.0 (TID 221). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Starting task 199.0 in stage 5.0 (TID 222, localhost, PROCESS_LOCAL, 1056 bytes)
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 198.0 in stage 5.0 (TID 221) in 30 ms on localhost (199/200)
15/03/19 14:31:14 INFO executor.Executor: Running task 199.0 in stage 5.0 (TID 222)
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Getting 0 non-empty blocks out of 1 blocks
15/03/19 14:31:14 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/19 14:31:14 INFO executor.Executor: Finished task 199.0 in stage 5.0 (TID 222). 2168 bytes result sent to driver
15/03/19 14:31:14 INFO scheduler.TaskSetManager: Finished task 199.0 in stage 5.0 (TID 222) in 16 ms on localhost (200/200)
15/03/19 14:31:14 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 
15/03/19 14:31:14 INFO scheduler.DAGScheduler: Stage 5 (takeOrdered at basicOperators.scala:183) finished in 7.711 s
15/03/19 14:31:14 INFO scheduler.DAGScheduler: Job 2 finished: takeOrdered at basicOperators.scala:183,took 9.176817 s