统计源码行数命令:

使用wc -l命令统计Spark-1.4.0核心模块core的源码行数,展示了各Scala文件的代码行数,包括RDD、存储、调度、MapReduce等关键组件的代码统计。
摘要由CSDN通过智能技术生成

wc -l find ./ -name "*.scala";find -name "*.h"

实战:统计spark-1.4.0核心代码行数:

xxx@master:~/spark_src/spark-1.4.0/core/src/main/scala/org/apache/spark$ wc -l find ./ -name "*.scala";find -name "*.h"
1178 ./rdd/PairRDDFunctions.scala
152 ./rdd/ZippedPartitionsRDD.scala
174 ./rdd/CheckpointRDD.scala
151 ./rdd/RDDCheckpointData.scala
70 ./rdd/PartitionwiseSampledRDD.scala
82 ./rdd/PartitionPruningRDD.scala
1695 ./rdd/RDD.scala
72 ./rdd/ZippedWithIndexRDD.scala
134 ./rdd/AsyncRDDActions.scala
97 ./rdd/UnionRDD.scala
189 ./rdd/PipedRDD.scala
275 ./rdd/NewHadoopRDD.scala
23 ./rdd/package.scala
208 ./rdd/CoGroupedRDD.scala
93 ./rdd/CartesianRDD.scala
113 ./rdd/PartitionerAwareUnionRDD.scala
155 ./rdd/RDDOperationScope.scala
98 ./rdd/ShuffledRDD.scala
92 ./rdd/BlockRDD.scala
137 ./rdd/SubtractedRDD.scala
34 ./rdd/EmptyRDD.scala
211 ./rdd/JdbcRDD.scala
71 ./rdd/SampledRDD.scala
240 ./rdd/DoubleRDDFunctions.scala
101 ./rdd/OrderedRDDFunctions.scala
117 ./rdd/SequenceFileRDDFunctions.scala
354 ./rdd/CoalescedRDD.scala
36 ./rdd/MapPartitionsRDD.scala
51 ./rdd/BinaryFileRDD.scala
162 ./rdd/ParallelCollectionRDD.scala
421 ./rdd/HadoopRDD.scala
156 ./mapred/SparkHadoopMapRedUtil.scala
591 ./storage/MemoryStore.scala
71 ./storage/BlockStore.scala
83 ./storage/BlockInfo.scala
60 ./storage/BlockManagerSource.scala
171 ./storage/DiskStore.scala
225 ./storage/BlockManagerMaster.scala
20 ./storage/BlockNotFoundException.scala
230 ./storage/StorageLevel.scala
22 ./storage/BlockException.scala
32 ./storage/PutResult.scala
30 ./storage/FileSegment.scala
175 ./storage/DiskBlockManager.scala
215 ./storage/TachyonBlockManager.scala
1279 ./storage/BlockManager.scala
121 ./storage/BlockManagerId.scala
102 ./storage/ExternalBlockManager.scala
357 ./storage/ShuffleBlockFetcherIterator.scala
61 ./storage/RDDInfo.scala
135 ./storage/BlockId.scala
181 ./storage/ExternalBlockStore.scala
275 ./storage/StorageUtils.scala
510 ./storage/BlockManagerMasterEndpoint.scala
111 ./storage/BlockManagerMessages.scala
94 ./storage/BlockManagerSlaveEndpoint.scala
94 ./storage/StorageStatusListener.scala
249 ./storage/BlockObjectWriter.scala
192 ./CacheManager.scala
118 ./deploy/PythonRunner.scala
66 ./deploy/SparkCuratorUtil.scala
116 ./deploy/mesos/MesosClusterDispatcher.scala
180 ./deploy/mesos/ui/DriverPage.scala
49 ./deploy/mesos/ui/MesosClusterUI.scala
117 ./deploy/mesos/ui/MesosClusterPage.scala
65 ./deploy/mesos/MesosDriverDescription.scala
101 ./deploy/mesos/MesosClusterDispatcherArguments.scala
92 ./deploy/RRunner.scala
102 ./deploy/JsonProtocol.scala
1002 ./deploy/SparkSubmit.scala
29 ./deploy/Command.scala
48 ./deploy/ApplicationDescription.scala
131 ./deploy/ClientArguments.scala
37 ./deploy/DriverDescription.scala
257 ./deploy/history/HistoryServer.scala
223 ./deploy/history/HistoryPage.scala
500 ./deploy/history/FsHistoryProvider.scala
90 ./deploy/history/HistoryServerArguments.scala
65 ./deploy/history/ApplicationHistoryProvider.scala
234 ./deploy/worker/DriverRunner.scala
67 ./deploy/worker/DriverWrapper.scala
51 ./deploy/worker/WorkerSource.scala
176 ./deploy/worker/WorkerArguments.scala
153 ./deploy/worker/ui/WorkerPage.scala
164 ./deploy/worker/ui/LogPage.scala
58 ./deploy/worker/ui/WorkerWebUI.scala
176 ./deploy/worker/ExecutorRunner.scala
583 ./deploy/worker/Worker.scala
79 ./deploy/worker/WorkerWatcher.scala
111 ./deploy/worker/CommandUtils.scala
528 ./deploy/Spa

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值