- 博客(9)
- 收藏
- 关注
RSS订阅原创 [pyspark] pyspark使用记录
以下不定时记录一些pyspark使用过程中的心得、备忘、注意事项等。reduceByKey： 尽量使用reduceByKey来替代groupByKey, 用reduceByKey时先把数据整理成(key, value)对 (出于性能的考虑)coalesce： coalesce(1)之前，尤其是存下来的文件比较大时，最好先count()一下读入文件： 多个文件路径用逗号’,’隔开
2017-07-02 17:18:29
689
原创 [pyspark] 尽量用reduceByKey而不用groupByKey
最近工作的时候写了一段python操作spark的代码，
2
原创 Round C APAC Test 2017 Problem B. Safe Squares (C++)
ProblemCodejamon trainers are actively looking for monsters, but if you are not a trainer, these monsters could be really dangerous for you. You might want to find safe places that do not have any mons
2017-02-21 18:52:51
382
原创 Round C APAC Test 2017 Problem A. Monster Path (C++)
ProblemCodejamon is a mobile game in which monster trainers walk around in the real world to catch monsters. You have an old smartphone with a short battery life, so you need to choose your path carefu
2017-02-21 15:20:55
301
原创 Round D APAC Test 2017 Problem A. Vote (C++)
ProblemA and B are the only two candidates competing in a certain election. We know from polls that exactly N voters support A, and exactly M voters support B. We also know that N is greater than M, so
2017-02-20 23:35:00
270
原创 Round E APAC Test 2017 Problem A. Diwali lightings (C++)
ProblemDiwali is the festival of lights. To celebrate it, people decorate their houses with multi-color lights and burst crackers. Everyone loves Diwali, and so does Pari. Pari is very fond of lights,
2017-02-19 20:55:23
348
原创 Round D APAC Test 2017 Problem D. Stretch Rope (C++)
ProblemMary likes playing with rubber bands. It’s her birthday today, and you have gone to the rubber band shop to buy her a gift.There are N rubber bands available in the shop. The i-th of these
2017-02-19 18:36:18
330
原创 Android设备上的简易备忘录(Memo) 具有闹钟功能
刚开始尝试学习android开发，完全是闲来无事。之前主要都是用C++，都没怎么碰过java，所以说还是在慢慢摸索的阶段吧。 在学习android的过程中，用的是android studio，因而主要看的两本书也是与基于android studio平台的，分别是《Android APP 开发入门》和《第一行代码(第二版)》，程序中的不少代码都是来自这两本书上的，确实对像我这样刚要入门的
2017-02-01 02:55:41
14553
12
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人