- 博客(9)
- 收藏
- 关注
原创 [pyspark] pyspark使用记录
以下不定时记录一些pyspark使用过程中的心得、备忘、注意事项等。reduceByKey: 尽量使用reduceByKey来替代groupByKey, 用reduceByKey时先把数据整理成(key, value)对 (出于性能的考虑)coalesce: coalesce(1)之前,尤其是存下来的文件比较大时,最好先count()一下读入文件: 多个文件路径用逗号’,’隔开
2017-07-02 17:18:29 693
原创 [pyspark] 尽量用reduceByKey而不用groupByKey
最近工作的时候写了一段python操作spark的代码,![这里写图片描述](http://img.blog.csdn.net/20170605202125612?watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQvc2ZfemhhbmcyNg==/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70
2017-06-05 20:22:01 6159 2
原创 Round C APAC Test 2017 Problem B. Safe Squares (C++)
ProblemCodejamon trainers are actively looking for monsters, but if you are not a trainer, these monsters could be really dangerous for you. You might want to find safe places that do not have any mons
2017-02-21 18:52:51 396
原创 Round C APAC Test 2017 Problem A. Monster Path (C++)
ProblemCodejamon is a mobile game in which monster trainers walk around in the real world to catch monsters. You have an old smartphone with a short battery life, so you need to choose your path carefu
2017-02-21 15:20:55 303
原创 Round D APAC Test 2017 Problem A. Vote (C++)
ProblemA and B are the only two candidates competing in a certain election. We know from polls that exactly N voters support A, and exactly M voters support B. We also know that N is greater than M, so
2017-02-20 23:35:00 274
原创 Round E APAC Test 2017 Problem A. Diwali lightings (C++)
ProblemDiwali is the festival of lights. To celebrate it, people decorate their houses with multi-color lights and burst crackers. Everyone loves Diwali, and so does Pari. Pari is very fond of lights,
2017-02-19 20:55:23 350
原创 Round D APAC Test 2017 Problem D. Stretch Rope (C++)
ProblemMary likes playing with rubber bands. It’s her birthday today, and you have gone to the rubber band shop to buy her a gift.There are N rubber bands available in the shop. The i-th of these
2017-02-19 18:36:18 336
原创 Android设备上的简易备忘录(Memo) 具有闹钟功能
刚开始尝试学习android开发,完全是闲来无事。之前主要都是用C++,都没怎么碰过java,所以说还是在慢慢摸索的阶段吧。 在学习android的过程中,用的是android studio,因而主要看的两本书也是与基于android studio平台的,分别是《Android APP 开发入门》和《第一行代码(第二版)》,程序中的不少代码都是来自这两本书上的,确实对像我这样刚要入门的
2017-02-01 02:55:41 14581 12
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人