LoggingRepo/output at master · autumnust/LoggingRepo · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Stage_0(3):ResultTask0
	 - RDD_0:Generating InputData(9)
		 Start:2016-11-14 07:22:08.110000 End: 2016-11-14 07:22:08.650000  Lasting: 540ms
	 - RDD_1:Generating InputData(9)
		 Start:2016-11-14 07:22:08.108000 End: 2016-11-14 07:22:08.654000  Lasting: 546ms
	 - RDD_2:Generating PythonRDD(9)
		 Start:2016-11-14 07:22:08.096000 End: 2016-11-14 07:22:37.146000  Lasting: 29050ms


Stage_1(3):ResultTask1
	 - RDD_0:Generating InputData(9)
		 Start:2016-11-14 07:22:38.738000 End: 2016-11-14 07:22:39.386000  Lasting: 648ms
	 - RDD_1:Generating InputData(9)
		 Start:2016-11-14 07:22:38.737000 End: 2016-11-14 07:22:39.388000  Lasting: 651ms
	 - RDD_3:Generating PythonRDD(9)
		 Start:2016-11-14 07:22:38.654000 End: 2016-11-14 07:23:07.468000  Lasting: 28814ms


Stage_2(4):ShuffleMapTask2
	 - RDD_0:Generating InputData(9)
		 Start:2016-11-14 07:23:10.162000 End: 2016-11-14 07:23:10.175000  Lasting: 13ms
	 - RDD_1:Generating InputData(9)
		 Start:2016-11-14 07:23:10.161000 End: 2016-11-14 07:23:10.176000  Lasting: 15ms
	 - RDD_4:Generating PythonRDD(9)
		 Start:2016-11-14 07:23:10.119000 End: 2016-11-14 07:23:10.249000  Lasting: 130ms
	 - RDD_5:Generating PairwiseRDD(9)
		 Start:2016-11-14 07:23:10.114000 End: 2016-11-14 07:23:10.254000  Lasting: 140ms


			Shuffle Write Timing:[9]
		 Start:2016-11-14 07:23:10.249000 End: 2016-11-14 07:23:46.838000  Lasting: 36589ms


			Shuffle Read Timing:[0]
		 Start:1970-01-01 00:00:00 End: 1970-01-01 00:00:00  Lasting: 0ms


Stage_3(8):ShuffleMapTask3
	 - RDD_6:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:23:47.615000 End: 2016-11-14 07:23:48.015000  Lasting: 400ms
	 - RDD_7:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:23:47.613000 End: 2016-11-14 07:23:48.015000  Lasting: 402ms
	 - RDD_8:Generating ParallelCollectionRDD(32)
		 Start:2016-11-14 07:23:47.623000 End: 2016-11-14 07:23:47.724000  Lasting: 101ms
	 - RDD_9:Generating PythonRDD(32)
		 Start:2016-11-14 07:23:47.603000 End: 2016-11-14 07:23:52.906000  Lasting: 5303ms
	 - RDD_10:Generating PythonRDD(32)
		 Start:2016-11-14 07:23:47.596000 End: 2016-11-14 07:23:47.970000  Lasting: 374ms
	 - RDD_11:Generating UnionRDD(64)
		 Start:2016-11-14 07:23:47.595000 End: 2016-11-14 07:23:52.907000  Lasting: 5312ms
	 - RDD_12:Generating PythonRDD(64)
		 Start:2016-11-14 07:23:47.590000 End: 2016-11-14 07:23:55.198000  Lasting: 7608ms
	 - RDD_13:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:23:47.586000 End: 2016-11-14 07:23:55.198000  Lasting: 7612ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:23:47.928000 End: 2016-11-14 07:23:48.947000  Lasting: 1019ms


			Shuffle Read Timing:[32]
		 Start:2016-11-14 07:23:47.632000 End: 2016-11-14 07:23:47.969000  Lasting: 337ms


Stage_4(8):ShuffleMapTask4
	 - RDD_8:Generating ParallelCollectionRDD(32)
		 Start:2016-11-14 07:23:56.113000 End: 2016-11-14 07:23:56.144000  Lasting: 31ms
	 - RDD_14:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:23:56.047000 End: 2016-11-14 07:23:56.245000  Lasting: 198ms
	 - RDD_15:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:23:56.041000 End: 2016-11-14 07:23:56.245000  Lasting: 204ms
	 - RDD_16:Generating PythonRDD(32)
		 Start:2016-11-14 07:23:56.118000 End: 2016-11-14 07:23:59.504000  Lasting: 3386ms
	 - RDD_17:Generating PythonRDD(32)
		 Start:2016-11-14 07:23:56.088000 End: 2016-11-14 07:23:56.394000  Lasting: 306ms
	 - RDD_18:Generating UnionRDD(64)
		 Start:2016-11-14 07:23:56.101000 End: 2016-11-14 07:23:59.504000  Lasting: 3403ms
	 - RDD_19:Generating PythonRDD(64)
		 Start:2016-11-14 07:23:56.080000 End: 2016-11-14 07:24:01.962000  Lasting: 5882ms
	 - RDD_20:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:23:56.080000 End: 2016-11-14 07:24:01.962000  Lasting: 5882ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:24:00.893000 End: 2016-11-14 07:24:01.853000  Lasting: 960ms


			Shuffle Read Timing:[32]
		 Start:2016-11-14 07:23:56.049000 End: 2016-11-14 07:23:56.232000  Lasting: 183ms


Stage_5(7):ShuffleMapTask5
	 - RDD_21:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:24:02.563000 End: 2016-11-14 07:24:02.696000  Lasting: 133ms
	 - RDD_22:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:24:02.559000 End: 2016-11-14 07:24:02.696000  Lasting: 137ms
	 - RDD_23:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:02.562000 End: 2016-11-14 07:24:17.561000  Lasting: 14999ms
	 - RDD_24:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:02.564000 End: 2016-11-14 07:24:16.115000  Lasting: 13551ms
	 - RDD_25:Generating UnionRDD(64)
		 Start:2016-11-14 07:24:02.555000 End: 2016-11-14 07:24:17.561000  Lasting: 15006ms
	 - RDD_26:Generating PythonRDD(64)
		 Start:2016-11-14 07:24:02.551000 End: 2016-11-14 07:24:19.366000  Lasting: 16815ms
	 - RDD_27:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:24:02.551000 End: 2016-11-14 07:24:19.366000  Lasting: 16815ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:24:08.002000 End: 2016-11-14 07:24:08.542000  Lasting: 540ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:24:02.578000 End: 2016-11-14 07:24:02.707000  Lasting: 129ms


Stage_6(7):ShuffleMapTask6
	 - RDD_32:Generating UnionRDD(64)
		 Start:2016-11-14 07:24:19.888000 End: 2016-11-14 07:24:34.383000  Lasting: 14495ms
	 - RDD_33:Generating PythonRDD(64)
		 Start:2016-11-14 07:24:19.880000 End: 2016-11-14 07:24:36.169000  Lasting: 16289ms
	 - RDD_34:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:24:19.876000 End: 2016-11-14 07:24:36.169000  Lasting: 16293ms
	 - RDD_28:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:24:19.897000 End: 2016-11-14 07:24:20.024000  Lasting: 127ms
	 - RDD_29:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:24:19.894000 End: 2016-11-14 07:24:20.024000  Lasting: 130ms
	 - RDD_30:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:19.889000 End: 2016-11-14 07:24:34.383000  Lasting: 14494ms
	 - RDD_31:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:21.650000 End: 2016-11-14 07:24:34.017000  Lasting: 12367ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:24:25.780000 End: 2016-11-14 07:24:26.754000  Lasting: 974ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:24:21.633000 End: 2016-11-14 07:24:21.760000  Lasting: 127ms


Stage_7(7):ShuffleMapTask7
	 - RDD_35:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:24:36.710000 End: 2016-11-14 07:24:37.120000  Lasting: 410ms
	 - RDD_36:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:24:36.709000 End: 2016-11-14 07:24:37.120000  Lasting: 411ms
	 - RDD_37:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:36.704000 End: 2016-11-14 07:24:50.727000  Lasting: 14023ms
	 - RDD_38:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:38.511000 End: 2016-11-14 07:24:50.923000  Lasting: 12412ms
	 - RDD_39:Generating UnionRDD(64)
		 Start:2016-11-14 07:24:36.704000 End: 2016-11-14 07:24:50.728000  Lasting: 14024ms
	 - RDD_40:Generating PythonRDD(64)
		 Start:2016-11-14 07:24:36.695000 End: 2016-11-14 07:24:52.566000  Lasting: 15871ms
	 - RDD_41:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:24:36.691000 End: 2016-11-14 07:24:52.566000  Lasting: 15875ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:24:41.473000 End: 2016-11-14 07:24:42.092000  Lasting: 619ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:24:36.711000 End: 2016-11-14 07:24:37.116000  Lasting: 405ms


Stage_8(7):ShuffleMapTask8
	 - RDD_42:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:24:53.064000 End: 2016-11-14 07:24:53.164000  Lasting: 100ms
	 - RDD_43:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:24:53.070000 End: 2016-11-14 07:24:53.181000  Lasting: 111ms
	 - RDD_44:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:53.068000 End: 2016-11-14 07:25:06.981000  Lasting: 13913ms
	 - RDD_45:Generating PythonRDD(32)
		 Start:2016-11-14 07:24:54.475000 End: 2016-11-14 07:25:07.206000  Lasting: 12731ms
	 - RDD_46:Generating UnionRDD(64)
		 Start:2016-11-14 07:24:53.066000 End: 2016-11-14 07:25:06.982000  Lasting: 13916ms
	 - RDD_47:Generating PythonRDD(64)
		 Start:2016-11-14 07:24:53.059000 End: 2016-11-14 07:25:08.708000  Lasting: 15649ms
	 - RDD_48:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:24:53.059000 End: 2016-11-14 07:25:08.708000  Lasting: 15649ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:24:54.430000 End: 2016-11-14 07:24:55.021000  Lasting: 591ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:24:53.067000 End: 2016-11-14 07:24:53.156000  Lasting: 89ms


Stage_9(7):ShuffleMapTask9
	 - RDD_49:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:25:09.193000 End: 2016-11-14 07:25:09.292000  Lasting: 99ms
	 - RDD_50:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:25:09.189000 End: 2016-11-14 07:25:09.293000  Lasting: 104ms
	 - RDD_51:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:09.192000 End: 2016-11-14 07:25:22.953000  Lasting: 13761ms
	 - RDD_52:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:09.178000 End: 2016-11-14 07:25:21.065000  Lasting: 11887ms
	 - RDD_53:Generating UnionRDD(64)
		 Start:2016-11-14 07:25:09.189000 End: 2016-11-14 07:25:22.953000  Lasting: 13764ms
	 - RDD_54:Generating PythonRDD(64)
		 Start:2016-11-14 07:25:09.185000 End: 2016-11-14 07:25:24.897000  Lasting: 15712ms
	 - RDD_55:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:25:09.182000 End: 2016-11-14 07:25:24.897000  Lasting: 15715ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:25:13.840000 End: 2016-11-14 07:25:14.657000  Lasting: 817ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:25:09.202000 End: 2016-11-14 07:25:09.295000  Lasting: 93ms


Stage_10(7):ShuffleMapTask10
	 - RDD_56:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:25:25.432000 End: 2016-11-14 07:25:25.502000  Lasting: 70ms
	 - RDD_57:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:25:25.425000 End: 2016-11-14 07:25:25.503000  Lasting: 78ms
	 - RDD_58:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:25.392000 End: 2016-11-14 07:25:38.640000  Lasting: 13248ms
	 - RDD_59:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:25.379000 End: 2016-11-14 07:25:36.819000  Lasting: 11440ms
	 - RDD_60:Generating UnionRDD(64)
		 Start:2016-11-14 07:25:25.388000 End: 2016-11-14 07:25:38.640000  Lasting: 13252ms
	 - RDD_61:Generating PythonRDD(64)
		 Start:2016-11-14 07:25:25.380000 End: 2016-11-14 07:25:40.545000  Lasting: 15165ms
	 - RDD_62:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:25:25.380000 End: 2016-11-14 07:25:40.545000  Lasting: 15165ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:25:29.900000 End: 2016-11-14 07:25:30.436000  Lasting: 536ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:25:25.439000 End: 2016-11-14 07:25:25.503000  Lasting: 64ms


Stage_11(7):ShuffleMapTask11
	 - RDD_64:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:25:41.025000 End: 2016-11-14 07:25:41.131000  Lasting: 106ms
	 - RDD_65:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:41.094000 End: 2016-11-14 07:25:54.188000  Lasting: 13094ms
	 - RDD_66:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:41.029000 End: 2016-11-14 07:25:52.604000  Lasting: 11575ms
	 - RDD_67:Generating UnionRDD(64)
		 Start:2016-11-14 07:25:41.049000 End: 2016-11-14 07:25:54.188000  Lasting: 13139ms
	 - RDD_68:Generating PythonRDD(64)
		 Start:2016-11-14 07:25:41.025000 End: 2016-11-14 07:25:56.420000  Lasting: 15395ms
	 - RDD_69:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:25:41.024000 End: 2016-11-14 07:25:56.420000  Lasting: 15396ms
	 - RDD_63:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:25:41.027000 End: 2016-11-14 07:25:41.130000  Lasting: 103ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:25:47.585000 End: 2016-11-14 07:25:48.860000  Lasting: 1275ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:25:41.024000 End: 2016-11-14 07:25:41.122000  Lasting: 98ms


Stage_12(7):ShuffleMapTask12
	 - RDD_70:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:25:56.967000 End: 2016-11-14 07:25:57.062000  Lasting: 95ms
	 - RDD_71:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:25:56.967000 End: 2016-11-14 07:25:57.063000  Lasting: 96ms
	 - RDD_72:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:56.959000 End: 2016-11-14 07:26:09.306000  Lasting: 12347ms
	 - RDD_73:Generating PythonRDD(32)
		 Start:2016-11-14 07:25:56.951000 End: 2016-11-14 07:26:08.449000  Lasting: 11498ms
	 - RDD_74:Generating UnionRDD(64)
		 Start:2016-11-14 07:25:56.955000 End: 2016-11-14 07:26:09.307000  Lasting: 12352ms
	 - RDD_75:Generating PythonRDD(64)
		 Start:2016-11-14 07:25:56.952000 End: 2016-11-14 07:26:11.042000  Lasting: 14090ms
	 - RDD_76:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:25:56.950000 End: 2016-11-14 07:26:11.042000  Lasting: 14092ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:26:03.693000 End: 2016-11-14 07:26:04.347000  Lasting: 654ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:25:56.968000 End: 2016-11-14 07:25:57.062000  Lasting: 94ms


Stage_13(7):ShuffleMapTask13
	 - RDD_77:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:26:11.542000 End: 2016-11-14 07:26:11.589000  Lasting: 47ms
	 - RDD_78:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:26:11.539000 End: 2016-11-14 07:26:11.592000  Lasting: 53ms
	 - RDD_79:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:11.545000 End: 2016-11-14 07:26:25.312000  Lasting: 13767ms
	 - RDD_80:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:11.535000 End: 2016-11-14 07:26:24.107000  Lasting: 12572ms
	 - RDD_81:Generating UnionRDD(64)
		 Start:2016-11-14 07:26:11.545000 End: 2016-11-14 07:26:25.313000  Lasting: 13768ms
	 - RDD_82:Generating PythonRDD(64)
		 Start:2016-11-14 07:26:11.537000 End: 2016-11-14 07:26:27.159000  Lasting: 15622ms
	 - RDD_83:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:26:11.537000 End: 2016-11-14 07:26:27.159000  Lasting: 15622ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:26:16.865000 End: 2016-11-14 07:26:17.413000  Lasting: 548ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:26:11.544000 End: 2016-11-14 07:26:11.589000  Lasting: 45ms


Stage_14(7):ShuffleMapTask14
	 - RDD_84:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:26:27.621000 End: 2016-11-14 07:26:27.704000  Lasting: 83ms
	 - RDD_85:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:26:27.621000 End: 2016-11-14 07:26:27.704000  Lasting: 83ms
	 - RDD_86:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:27.592000 End: 2016-11-14 07:26:40.665000  Lasting: 13073ms
	 - RDD_87:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:27.587000 End: 2016-11-14 07:26:39.180000  Lasting: 11593ms
	 - RDD_88:Generating UnionRDD(64)
		 Start:2016-11-14 07:26:27.590000 End: 2016-11-14 07:26:40.665000  Lasting: 13075ms
	 - RDD_89:Generating PythonRDD(64)
		 Start:2016-11-14 07:26:27.588000 End: 2016-11-14 07:26:42.588000  Lasting: 15000ms
	 - RDD_90:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:26:27.587000 End: 2016-11-14 07:26:42.588000  Lasting: 15001ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:26:33.166000 End: 2016-11-14 07:26:34.038000  Lasting: 872ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:26:27.609000 End: 2016-11-14 07:26:27.658000  Lasting: 49ms


Stage_15(7):ShuffleMapTask15
	 - RDD_96:Generating PythonRDD(64)
		 Start:2016-11-14 07:26:43.034000 End: 2016-11-14 07:26:58.197000  Lasting: 15163ms
	 - RDD_97:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:26:43.034000 End: 2016-11-14 07:26:58.197000  Lasting: 15163ms
	 - RDD_91:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:26:43.041000 End: 2016-11-14 07:26:43.086000  Lasting: 45ms
	 - RDD_92:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:26:43.042000 End: 2016-11-14 07:26:43.088000  Lasting: 46ms
	 - RDD_93:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:43.040000 End: 2016-11-14 07:26:56.405000  Lasting: 13365ms
	 - RDD_94:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:43.037000 End: 2016-11-14 07:26:55.008000  Lasting: 11971ms
	 - RDD_95:Generating UnionRDD(64)
		 Start:2016-11-14 07:26:43.038000 End: 2016-11-14 07:26:56.405000  Lasting: 13367ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:26:48.793000 End: 2016-11-14 07:26:50.039000  Lasting: 1246ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:26:43.043000 End: 2016-11-14 07:26:43.082000  Lasting: 39ms


Stage_16(7):ShuffleMapTask16
	 - RDD_98:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:26:58.661000 End: 2016-11-14 07:26:58.757000  Lasting: 96ms
	 - RDD_99:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:26:58.661000 End: 2016-11-14 07:26:58.758000  Lasting: 97ms
	 - RDD_100:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:58.656000 End: 2016-11-14 07:27:12.016000  Lasting: 13360ms
	 - RDD_101:Generating PythonRDD(32)
		 Start:2016-11-14 07:26:58.650000 End: 2016-11-14 07:27:11.180000  Lasting: 12530ms
	 - RDD_102:Generating UnionRDD(64)
		 Start:2016-11-14 07:26:58.656000 End: 2016-11-14 07:27:12.016000  Lasting: 13360ms
	 - RDD_103:Generating PythonRDD(64)
		 Start:2016-11-14 07:26:58.655000 End: 2016-11-14 07:27:13.759000  Lasting: 15104ms
	 - RDD_104:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:26:58.655000 End: 2016-11-14 07:27:13.759000  Lasting: 15104ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:27:03.415000 End: 2016-11-14 07:27:04.092000  Lasting: 677ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:26:58.669000 End: 2016-11-14 07:26:58.758000  Lasting: 89ms


Stage_17(7):ShuffleMapTask17
	 - RDD_105:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:27:15.691000 End: 2016-11-14 07:27:15.789000  Lasting: 98ms
	 - RDD_106:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:27:15.691000 End: 2016-11-14 07:27:15.793000  Lasting: 102ms
	 - RDD_107:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:14.202000 End: 2016-11-14 07:27:27.449000  Lasting: 13247ms
	 - RDD_108:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:14.183000 End: 2016-11-14 07:27:26.595000  Lasting: 12412ms
	 - RDD_109:Generating UnionRDD(64)
		 Start:2016-11-14 07:27:14.188000 End: 2016-11-14 07:27:27.450000  Lasting: 13262ms
	 - RDD_110:Generating PythonRDD(64)
		 Start:2016-11-14 07:27:14.182000 End: 2016-11-14 07:27:29.388000  Lasting: 15206ms
	 - RDD_111:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:27:14.180000 End: 2016-11-14 07:27:29.388000  Lasting: 15208ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:27:19.431000 End: 2016-11-14 07:27:19.894000  Lasting: 463ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:27:15.736000 End: 2016-11-14 07:27:15.800000  Lasting: 64ms


Stage_18(7):ShuffleMapTask18
	 - RDD_112:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:27:29.873000 End: 2016-11-14 07:27:30.017000  Lasting: 144ms
	 - RDD_113:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:27:29.870000 End: 2016-11-14 07:27:30.018000  Lasting: 148ms
	 - RDD_114:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:29.866000 End: 2016-11-14 07:27:42.930000  Lasting: 13064ms
	 - RDD_115:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:29.864000 End: 2016-11-14 07:27:41.456000  Lasting: 11592ms
	 - RDD_116:Generating UnionRDD(64)
		 Start:2016-11-14 07:27:29.863000 End: 2016-11-14 07:27:42.931000  Lasting: 13068ms
	 - RDD_117:Generating PythonRDD(64)
		 Start:2016-11-14 07:27:29.859000 End: 2016-11-14 07:27:44.690000  Lasting: 14831ms
	 - RDD_118:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:27:29.859000 End: 2016-11-14 07:27:44.690000  Lasting: 14831ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:27:35.289000 End: 2016-11-14 07:27:35.978000  Lasting: 689ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:27:29.874000 End: 2016-11-14 07:27:29.997000  Lasting: 123ms


Stage_19(7):ShuffleMapTask19
	 - RDD_119:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:27:45.187000 End: 2016-11-14 07:27:45.276000  Lasting: 89ms
	 - RDD_120:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:27:45.185000 End: 2016-11-14 07:27:45.276000  Lasting: 91ms
	 - RDD_121:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:45.181000 End: 2016-11-14 07:27:58.759000  Lasting: 13578ms
	 - RDD_122:Generating PythonRDD(32)
		 Start:2016-11-14 07:27:45.185000 End: 2016-11-14 07:27:57.254000  Lasting: 12069ms
	 - RDD_123:Generating UnionRDD(64)
		 Start:2016-11-14 07:27:45.181000 End: 2016-11-14 07:27:58.759000  Lasting: 13578ms
	 - RDD_124:Generating PythonRDD(64)
		 Start:2016-11-14 07:27:45.180000 End: 2016-11-14 07:28:00.533000  Lasting: 15353ms
	 - RDD_125:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:27:45.180000 End: 2016-11-14 07:28:00.533000  Lasting: 15353ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:27:50.187000 End: 2016-11-14 07:27:50.705000  Lasting: 518ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:27:45.188000 End: 2016-11-14 07:27:45.275000  Lasting: 87ms


Stage_20(7):ShuffleMapTask20
	 - RDD_128:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:00.985000 End: 2016-11-14 07:28:16.052000  Lasting: 15067ms
	 - RDD_129:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:02.248000 End: 2016-11-14 07:28:15.756000  Lasting: 13508ms
	 - RDD_130:Generating UnionRDD(64)
		 Start:2016-11-14 07:28:00.982000 End: 2016-11-14 07:28:16.052000  Lasting: 15070ms
	 - RDD_131:Generating PythonRDD(64)
		 Start:2016-11-14 07:28:00.972000 End: 2016-11-14 07:28:17.931000  Lasting: 16959ms
	 - RDD_132:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:28:00.972000 End: 2016-11-14 07:28:17.931000  Lasting: 16959ms
	 - RDD_126:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:28:00.983000 End: 2016-11-14 07:28:01.057000  Lasting: 74ms
	 - RDD_127:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:28:00.982000 End: 2016-11-14 07:28:01.076000  Lasting: 94ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:28:06.198000 End: 2016-11-14 07:28:07.041000  Lasting: 843ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:28:01.012000 End: 2016-11-14 07:28:01.076000  Lasting: 64ms


Stage_21(7):ShuffleMapTask21
	 - RDD_133:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:28:18.461000 End: 2016-11-14 07:28:18.531000  Lasting: 70ms
	 - RDD_134:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:28:18.452000 End: 2016-11-14 07:28:18.531000  Lasting: 79ms
	 - RDD_135:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:18.441000 End: 2016-11-14 07:28:32.600000  Lasting: 14159ms
	 - RDD_136:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:18.432000 End: 2016-11-14 07:28:31.293000  Lasting: 12861ms
	 - RDD_137:Generating UnionRDD(64)
		 Start:2016-11-14 07:28:18.441000 End: 2016-11-14 07:28:32.600000  Lasting: 14159ms
	 - RDD_138:Generating PythonRDD(64)
		 Start:2016-11-14 07:28:18.437000 End: 2016-11-14 07:28:34.477000  Lasting: 16040ms
	 - RDD_139:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:28:18.437000 End: 2016-11-14 07:28:34.477000  Lasting: 16040ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:28:23.540000 End: 2016-11-14 07:28:24.006000  Lasting: 466ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:28:18.466000 End: 2016-11-14 07:28:18.531000  Lasting: 65ms


Stage_22(7):ShuffleMapTask22
	 - RDD_140:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:28:34.934000 End: 2016-11-14 07:28:34.998000  Lasting: 64ms
	 - RDD_141:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:28:34.927000 End: 2016-11-14 07:28:34.998000  Lasting: 71ms
	 - RDD_142:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:34.901000 End: 2016-11-14 07:28:49.425000  Lasting: 14524ms
	 - RDD_143:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:34.895000 End: 2016-11-14 07:28:47.960000  Lasting: 13065ms
	 - RDD_144:Generating UnionRDD(64)
		 Start:2016-11-14 07:28:34.900000 End: 2016-11-14 07:28:49.425000  Lasting: 14525ms
	 - RDD_145:Generating PythonRDD(64)
		 Start:2016-11-14 07:28:34.898000 End: 2016-11-14 07:28:51.288000  Lasting: 16390ms
	 - RDD_146:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:28:34.898000 End: 2016-11-14 07:28:51.288000  Lasting: 16390ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:28:40.262000 End: 2016-11-14 07:28:40.788000  Lasting: 526ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:28:34.949000 End: 2016-11-14 07:28:34.998000  Lasting: 49ms


Stage_23(7):ShuffleMapTask23
	 - RDD_147:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:28:51.755000 End: 2016-11-14 07:28:51.817000  Lasting: 62ms
	 - RDD_148:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:28:51.754000 End: 2016-11-14 07:28:51.817000  Lasting: 63ms
	 - RDD_149:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:51.715000 End: 2016-11-14 07:29:05.548000  Lasting: 13833ms
	 - RDD_150:Generating PythonRDD(32)
		 Start:2016-11-14 07:28:51.706000 End: 2016-11-14 07:29:03.831000  Lasting: 12125ms
	 - RDD_151:Generating UnionRDD(64)
		 Start:2016-11-14 07:28:51.713000 End: 2016-11-14 07:29:05.548000  Lasting: 13835ms
	 - RDD_152:Generating PythonRDD(64)
		 Start:2016-11-14 07:28:51.709000 End: 2016-11-14 07:29:07.306000  Lasting: 15597ms
	 - RDD_153:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:28:51.708000 End: 2016-11-14 07:29:07.306000  Lasting: 15598ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:28:56.403000 End: 2016-11-14 07:28:56.950000  Lasting: 547ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:28:51.755000 End: 2016-11-14 07:28:51.816000  Lasting: 61ms


Stage_24(7):ShuffleMapTask24
	 - RDD_160:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:29:07.729000 End: 2016-11-14 07:29:22.717000  Lasting: 14988ms
	 - RDD_154:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:29:07.719000 End: 2016-11-14 07:29:07.973000  Lasting: 254ms
	 - RDD_155:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:29:07.718000 End: 2016-11-14 07:29:07.974000  Lasting: 256ms
	 - RDD_156:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:07.755000 End: 2016-11-14 07:29:20.925000  Lasting: 13170ms
	 - RDD_157:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:07.725000 End: 2016-11-14 07:29:19.581000  Lasting: 11856ms
	 - RDD_158:Generating UnionRDD(64)
		 Start:2016-11-14 07:29:07.742000 End: 2016-11-14 07:29:20.926000  Lasting: 13184ms
	 - RDD_159:Generating PythonRDD(64)
		 Start:2016-11-14 07:29:07.731000 End: 2016-11-14 07:29:22.717000  Lasting: 14986ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:29:12.390000 End: 2016-11-14 07:29:12.952000  Lasting: 562ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:29:07.723000 End: 2016-11-14 07:29:07.965000  Lasting: 242ms


Stage_25(7):ShuffleMapTask25
	 - RDD_161:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:29:23.239000 End: 2016-11-14 07:29:23.311000  Lasting: 72ms
	 - RDD_162:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:29:23.232000 End: 2016-11-14 07:29:23.312000  Lasting: 80ms
	 - RDD_163:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:23.199000 End: 2016-11-14 07:29:36.337000  Lasting: 13138ms
	 - RDD_164:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:23.192000 End: 2016-11-14 07:29:35.075000  Lasting: 11883ms
	 - RDD_165:Generating UnionRDD(64)
		 Start:2016-11-14 07:29:23.199000 End: 2016-11-14 07:29:36.338000  Lasting: 13139ms
	 - RDD_166:Generating PythonRDD(64)
		 Start:2016-11-14 07:29:23.191000 End: 2016-11-14 07:29:38.148000  Lasting: 14957ms
	 - RDD_167:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:29:23.188000 End: 2016-11-14 07:29:38.148000  Lasting: 14960ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:29:28.056000 End: 2016-11-14 07:29:28.572000  Lasting: 516ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:29:23.240000 End: 2016-11-14 07:29:23.310000  Lasting: 70ms


Stage_26(7):ShuffleMapTask26
	 - RDD_168:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:29:38.599000 End: 2016-11-14 07:29:38.661000  Lasting: 62ms
	 - RDD_169:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:29:38.595000 End: 2016-11-14 07:29:38.658000  Lasting: 63ms
	 - RDD_170:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:38.588000 End: 2016-11-14 07:29:51.593000  Lasting: 13005ms
	 - RDD_171:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:38.590000 End: 2016-11-14 07:29:50.220000  Lasting: 11630ms
	 - RDD_172:Generating UnionRDD(64)
		 Start:2016-11-14 07:29:38.586000 End: 2016-11-14 07:29:51.593000  Lasting: 13007ms
	 - RDD_173:Generating PythonRDD(64)
		 Start:2016-11-14 07:29:38.583000 End: 2016-11-14 07:29:53.480000  Lasting: 14897ms
	 - RDD_174:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:29:38.583000 End: 2016-11-14 07:29:53.480000  Lasting: 14897ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:29:43.284000 End: 2016-11-14 07:29:44.265000  Lasting: 981ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:29:38.596000 End: 2016-11-14 07:29:38.658000  Lasting: 62ms


Stage_27(7):ShuffleMapTask27
	 - RDD_175:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:29:55.231000 End: 2016-11-14 07:29:55.318000  Lasting: 87ms
	 - RDD_176:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:29:55.231000 End: 2016-11-14 07:29:55.318000  Lasting: 87ms
	 - RDD_177:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:53.922000 End: 2016-11-14 07:30:06.588000  Lasting: 12666ms
	 - RDD_178:Generating PythonRDD(32)
		 Start:2016-11-14 07:29:53.913000 End: 2016-11-14 07:30:05.760000  Lasting: 11847ms
	 - RDD_179:Generating UnionRDD(64)
		 Start:2016-11-14 07:29:53.922000 End: 2016-11-14 07:30:06.588000  Lasting: 12666ms
	 - RDD_180:Generating PythonRDD(64)
		 Start:2016-11-14 07:29:53.911000 End: 2016-11-14 07:30:08.625000  Lasting: 14714ms
	 - RDD_181:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:29:53.911000 End: 2016-11-14 07:30:08.625000  Lasting: 14714ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:29:59.588000 End: 2016-11-14 07:30:00.293000  Lasting: 705ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:29:55.231000 End: 2016-11-14 07:29:55.317000  Lasting: 86ms


Stage_28(7):ShuffleMapTask28
	 - RDD_182:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:30:09.058000 End: 2016-11-14 07:30:09.136000  Lasting: 78ms
	 - RDD_183:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:30:09.057000 End: 2016-11-14 07:30:09.136000  Lasting: 79ms
	 - RDD_184:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:09.048000 End: 2016-11-14 07:30:22.194000  Lasting: 13146ms
	 - RDD_185:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:09.047000 End: 2016-11-14 07:30:21.098000  Lasting: 12051ms
	 - RDD_186:Generating UnionRDD(64)
		 Start:2016-11-14 07:30:09.046000 End: 2016-11-14 07:30:22.195000  Lasting: 13149ms
	 - RDD_187:Generating PythonRDD(64)
		 Start:2016-11-14 07:30:09.046000 End: 2016-11-14 07:30:24.152000  Lasting: 15106ms
	 - RDD_188:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:30:09.044000 End: 2016-11-14 07:30:24.152000  Lasting: 15108ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:30:14.753000 End: 2016-11-14 07:30:15.500000  Lasting: 747ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:30:09.051000 End: 2016-11-14 07:30:09.111000  Lasting: 60ms


Stage_29(7):ShuffleMapTask29
	 - RDD_192:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:24.568000 End: 2016-11-14 07:30:35.862000  Lasting: 11294ms
	 - RDD_193:Generating UnionRDD(64)
		 Start:2016-11-14 07:30:24.575000 End: 2016-11-14 07:30:36.953000  Lasting: 12378ms
	 - RDD_194:Generating PythonRDD(64)
		 Start:2016-11-14 07:30:24.574000 End: 2016-11-14 07:30:38.670000  Lasting: 14096ms
	 - RDD_195:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:30:24.573000 End: 2016-11-14 07:30:38.671000  Lasting: 14098ms
	 - RDD_189:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:30:24.578000 End: 2016-11-14 07:30:24.652000  Lasting: 74ms
	 - RDD_190:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:30:24.578000 End: 2016-11-14 07:30:24.669000  Lasting: 91ms
	 - RDD_191:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:24.575000 End: 2016-11-14 07:30:36.953000  Lasting: 12378ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:30:31.268000 End: 2016-11-14 07:30:31.856000  Lasting: 588ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:30:24.578000 End: 2016-11-14 07:30:24.652000  Lasting: 74ms


Stage_30(7):ShuffleMapTask30
	 - RDD_196:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:30:39.075000 End: 2016-11-14 07:30:39.147000  Lasting: 72ms
	 - RDD_197:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:30:39.075000 End: 2016-11-14 07:30:39.148000  Lasting: 73ms
	 - RDD_198:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:39.093000 End: 2016-11-14 07:30:51.708000  Lasting: 12615ms
	 - RDD_199:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:39.098000 End: 2016-11-14 07:30:50.268000  Lasting: 11170ms
	 - RDD_200:Generating UnionRDD(64)
		 Start:2016-11-14 07:30:39.093000 End: 2016-11-14 07:30:51.708000  Lasting: 12615ms
	 - RDD_201:Generating PythonRDD(64)
		 Start:2016-11-14 07:30:39.092000 End: 2016-11-14 07:30:53.579000  Lasting: 14487ms
	 - RDD_202:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:30:39.092000 End: 2016-11-14 07:30:53.579000  Lasting: 14487ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:30:43.673000 End: 2016-11-14 07:30:44.321000  Lasting: 648ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:30:39.097000 End: 2016-11-14 07:30:39.135000  Lasting: 38ms


Stage_31(7):ShuffleMapTask31
	 - RDD_203:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:30:54.012000 End: 2016-11-14 07:30:54.097000  Lasting: 85ms
	 - RDD_204:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:30:54.010000 End: 2016-11-14 07:30:54.098000  Lasting: 88ms
	 - RDD_205:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:54.014000 End: 2016-11-14 07:31:07.495000  Lasting: 13481ms
	 - RDD_206:Generating PythonRDD(32)
		 Start:2016-11-14 07:30:54.011000 End: 2016-11-14 07:31:05.795000  Lasting: 11784ms
	 - RDD_207:Generating UnionRDD(64)
		 Start:2016-11-14 07:30:54.013000 End: 2016-11-14 07:31:07.495000  Lasting: 13482ms
	 - RDD_208:Generating PythonRDD(64)
		 Start:2016-11-14 07:30:54.010000 End: 2016-11-14 07:31:09.321000  Lasting: 15311ms
	 - RDD_209:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:30:54.010000 End: 2016-11-14 07:31:09.322000  Lasting: 15312ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:31:00.346000 End: 2016-11-14 07:31:00.849000  Lasting: 503ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:30:54.013000 End: 2016-11-14 07:30:54.097000  Lasting: 84ms


Stage_32(7):ShuffleMapTask32
	 - RDD_210:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:31:09.737000 End: 2016-11-14 07:31:09.814000  Lasting: 77ms
	 - RDD_211:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:31:09.735000 End: 2016-11-14 07:31:09.814000  Lasting: 79ms
	 - RDD_212:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:09.730000 End: 2016-11-14 07:31:23.173000  Lasting: 13443ms
	 - RDD_213:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:09.725000 End: 2016-11-14 07:31:21.630000  Lasting: 11905ms
	 - RDD_214:Generating UnionRDD(64)
		 Start:2016-11-14 07:31:09.729000 End: 2016-11-14 07:31:23.173000  Lasting: 13444ms
	 - RDD_215:Generating PythonRDD(64)
		 Start:2016-11-14 07:31:09.727000 End: 2016-11-14 07:31:25.082000  Lasting: 15355ms
	 - RDD_216:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:31:09.726000 End: 2016-11-14 07:31:25.082000  Lasting: 15356ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:31:14.966000 End: 2016-11-14 07:31:15.400000  Lasting: 434ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:31:09.759000 End: 2016-11-14 07:31:09.815000  Lasting: 56ms


Stage_33(7):ShuffleMapTask33
	 - RDD_217:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:31:25.527000 End: 2016-11-14 07:31:25.622000  Lasting: 95ms
	 - RDD_218:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:31:25.526000 End: 2016-11-14 07:31:25.622000  Lasting: 96ms
	 - RDD_219:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:25.532000 End: 2016-11-14 07:31:38.332000  Lasting: 12800ms
	 - RDD_220:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:25.529000 End: 2016-11-14 07:31:37.020000  Lasting: 11491ms
	 - RDD_221:Generating UnionRDD(64)
		 Start:2016-11-14 07:31:25.531000 End: 2016-11-14 07:31:38.332000  Lasting: 12801ms
	 - RDD_222:Generating PythonRDD(64)
		 Start:2016-11-14 07:31:25.531000 End: 2016-11-14 07:31:40.128000  Lasting: 14597ms
	 - RDD_223:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:31:25.529000 End: 2016-11-14 07:31:40.128000  Lasting: 14599ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:31:30.316000 End: 2016-11-14 07:31:31.041000  Lasting: 725ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:31:25.527000 End: 2016-11-14 07:31:25.610000  Lasting: 83ms


Stage_34(7):ShuffleMapTask34
	 - RDD_224:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:31:40.556000 End: 2016-11-14 07:31:40.774000  Lasting: 218ms
	 - RDD_225:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:31:40.557000 End: 2016-11-14 07:31:40.777000  Lasting: 220ms
	 - RDD_226:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:40.557000 End: 2016-11-14 07:31:53.881000  Lasting: 13324ms
	 - RDD_227:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:40.557000 End: 2016-11-14 07:31:52.498000  Lasting: 11941ms
	 - RDD_228:Generating UnionRDD(64)
		 Start:2016-11-14 07:31:40.552000 End: 2016-11-14 07:31:53.881000  Lasting: 13329ms
	 - RDD_229:Generating PythonRDD(64)
		 Start:2016-11-14 07:31:40.548000 End: 2016-11-14 07:31:55.920000  Lasting: 15372ms
	 - RDD_230:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:31:40.548000 End: 2016-11-14 07:31:55.920000  Lasting: 15372ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:31:45.196000 End: 2016-11-14 07:31:45.617000  Lasting: 421ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:31:40.558000 End: 2016-11-14 07:31:40.767000  Lasting: 209ms


Stage_35(7):ShuffleMapTask35
	 - RDD_231:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:31:56.345000 End: 2016-11-14 07:31:56.449000  Lasting: 104ms
	 - RDD_232:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:31:56.334000 End: 2016-11-14 07:31:56.443000  Lasting: 109ms
	 - RDD_233:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:56.336000 End: 2016-11-14 07:32:10.935000  Lasting: 14599ms
	 - RDD_234:Generating PythonRDD(32)
		 Start:2016-11-14 07:31:56.335000 End: 2016-11-14 07:32:09.353000  Lasting: 13018ms
	 - RDD_235:Generating UnionRDD(64)
		 Start:2016-11-14 07:31:56.336000 End: 2016-11-14 07:32:10.935000  Lasting: 14599ms
	 - RDD_236:Generating PythonRDD(64)
		 Start:2016-11-14 07:31:56.334000 End: 2016-11-14 07:32:12.752000  Lasting: 16418ms
	 - RDD_237:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:31:56.331000 End: 2016-11-14 07:32:12.752000  Lasting: 16421ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:32:00.881000 End: 2016-11-14 07:32:01.738000  Lasting: 857ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:31:56.349000 End: 2016-11-14 07:31:56.449000  Lasting: 100ms


Stage_36(7):ShuffleMapTask36
	 - RDD_238:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:32:13.164000 End: 2016-11-14 07:32:13.244000  Lasting: 80ms
	 - RDD_239:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:32:13.161000 End: 2016-11-14 07:32:13.245000  Lasting: 84ms
	 - RDD_240:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:13.153000 End: 2016-11-14 07:32:27.585000  Lasting: 14432ms
	 - RDD_241:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:13.153000 End: 2016-11-14 07:32:25.487000  Lasting: 12334ms
	 - RDD_242:Generating UnionRDD(64)
		 Start:2016-11-14 07:32:13.151000 End: 2016-11-14 07:32:27.585000  Lasting: 14434ms
	 - RDD_243:Generating PythonRDD(64)
		 Start:2016-11-14 07:32:13.151000 End: 2016-11-14 07:32:29.460000  Lasting: 16309ms
	 - RDD_244:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:32:13.150000 End: 2016-11-14 07:32:29.460000  Lasting: 16310ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:32:17.854000 End: 2016-11-14 07:32:18.273000  Lasting: 419ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:32:13.165000 End: 2016-11-14 07:32:13.244000  Lasting: 79ms


Stage_37(3):ResultTask37
	 - RDD_245:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:32:29.829000 End: 2016-11-14 07:32:29.853000  Lasting: 24ms
	 - RDD_246:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:32:29.834000 End: 2016-11-14 07:32:29.861000  Lasting: 27ms
	 - RDD_247:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:29.839000 End: 2016-11-14 07:32:33.089000  Lasting: 3250ms


Stage_1080(7):ShuffleMapTask1080
	 - RDD_238:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:41:48.981000 End: 2016-11-14 07:41:49.054000  Lasting: 73ms
	 - RDD_239:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:41:48.980000 End: 2016-11-14 07:41:49.054000  Lasting: 74ms
	 - RDD_472:Generating PythonRDD(32)
		 Start:2016-11-14 07:41:48.965000 End: 2016-11-14 07:42:02.780000  Lasting: 13815ms
	 - RDD_473:Generating PythonRDD(32)
		 Start:2016-11-14 07:41:48.971000 End: 2016-11-14 07:42:01.793000  Lasting: 12822ms
	 - RDD_474:Generating UnionRDD(64)
		 Start:2016-11-14 07:41:48.965000 End: 2016-11-14 07:42:02.780000  Lasting: 13815ms
	 - RDD_475:Generating PythonRDD(64)
		 Start:2016-11-14 07:41:48.964000 End: 2016-11-14 07:42:04.839000  Lasting: 15875ms
	 - RDD_476:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:41:48.963000 End: 2016-11-14 07:42:04.839000  Lasting: 15876ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:41:54.110000 End: 2016-11-14 07:41:54.728000  Lasting: 618ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:41:48.982000 End: 2016-11-14 07:41:49.054000  Lasting: 72ms


Stage_1081(3):ResultTask1081
	 - RDD_477:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:42:05.189000 End: 2016-11-14 07:42:05.234000  Lasting: 45ms
	 - RDD_478:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:42:05.189000 End: 2016-11-14 07:42:05.234000  Lasting: 45ms
	 - RDD_479:Generating PythonRDD(32)
		 Start:2016-11-14 07:42:05.196000 End: 2016-11-14 07:42:08.247000  Lasting: 3051ms


Stage_576(7):ShuffleMapTask576
	 - RDD_360:Generating PythonRDD(32)
		 Start:2016-11-14 07:37:13.296000 End: 2016-11-14 07:37:27.484000  Lasting: 14188ms
	 - RDD_361:Generating PythonRDD(32)
		 Start:2016-11-14 07:37:13.296000 End: 2016-11-14 07:37:26.120000  Lasting: 12824ms
	 - RDD_362:Generating UnionRDD(64)
		 Start:2016-11-14 07:37:13.295000 End: 2016-11-14 07:37:27.484000  Lasting: 14189ms
	 - RDD_363:Generating PythonRDD(64)
		 Start:2016-11-14 07:37:13.293000 End: 2016-11-14 07:37:29.529000  Lasting: 16236ms
	 - RDD_364:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:37:13.293000 End: 2016-11-14 07:37:29.530000  Lasting: 16237ms
	 - RDD_238:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:37:13.300000 End: 2016-11-14 07:37:13.334000  Lasting: 34ms
	 - RDD_239:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:37:13.294000 End: 2016-11-14 07:37:13.346000  Lasting: 52ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:37:14.467000 End: 2016-11-14 07:37:14.904000  Lasting: 437ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:37:13.298000 End: 2016-11-14 07:37:13.329000  Lasting: 31ms


Stage_577(3):ResultTask577
	 - RDD_365:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:37:29.894000 End: 2016-11-14 07:37:29.947000  Lasting: 53ms
	 - RDD_366:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:37:29.894000 End: 2016-11-14 07:37:29.947000  Lasting: 53ms
	 - RDD_367:Generating PythonRDD(32)
		 Start:2016-11-14 07:37:29.897000 End: 2016-11-14 07:37:33.321000  Lasting: 3424ms


Stage_72(7):ShuffleMapTask72
	 - RDD_238:Generating ShuffledRDD(64)
		 Start:2016-11-14 07:32:33.576000 End: 2016-11-14 07:32:33.667000  Lasting: 91ms
	 - RDD_239:Generating MapPartitionedRDD(64)
		 Start:2016-11-14 07:32:33.572000 End: 2016-11-14 07:32:33.671000  Lasting: 99ms
	 - RDD_248:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:33.545000 End: 2016-11-14 07:32:47.731000  Lasting: 14186ms
	 - RDD_249:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:33.542000 End: 2016-11-14 07:32:46.254000  Lasting: 12712ms
	 - RDD_250:Generating UnionRDD(64)
		 Start:2016-11-14 07:32:33.545000 End: 2016-11-14 07:32:47.731000  Lasting: 14186ms
	 - RDD_251:Generating PythonRDD(64)
		 Start:2016-11-14 07:32:33.544000 End: 2016-11-14 07:32:49.624000  Lasting: 16080ms
	 - RDD_252:Generating PairwiseRDD(64)
		 Start:2016-11-14 07:32:33.543000 End: 2016-11-14 07:32:49.624000  Lasting: 16081ms


			Shuffle Write Timing:[64]
		 Start:2016-11-14 07:32:38.446000 End: 2016-11-14 07:32:38.849000  Lasting: 403ms


			Shuffle Read Timing:[64]
		 Start:2016-11-14 07:32:33.582000 End: 2016-11-14 07:32:33.670000  Lasting: 88ms


Stage_73(3):ResultTask73
	 - RDD_253:Generating ShuffledRDD(32)
		 Start:2016-11-14 07:32:50.014000 End: 2016-11-14 07:32:50.066000  Lasting: 52ms
	 - RDD_254:Generating MapPartitionedRDD(32)
		 Start:2016-11-14 07:32:50.014000 End: 2016-11-14 07:32:50.066000  Lasting: 52ms
	 - RDD_255:Generating PythonRDD(32)
		 Start:2016-11-14 07:32:50.013000 End: 2016-11-14 07:32:53.224000  Lasting: 3211ms