本文介绍了作者在阅读书籍后对Hadoop、Spark和Storm三种计算模型的理解。尽管在编程时感觉不到它们的区别，但作者强调理解这些系统的工作原理对于充分利用其计算能力至关重要。这些模型的基本步骤包括获取输入源、分析数据和持久化存储。作者认为，掌握其计算能力可以有效解决重复处理和需要多次迭代的问题，如机器学习和图计算。
Today ,i have read three computing model from books,they are map/reduce ,trident, spark.
i can't feel their difference when writing program.because when computing, they are all transparent. .maybe i should learn to understand how the system works again.
i like to analyse big distribute systems. i am good at analysing.
thess three models all have their own computing way, just three steps: no matter how ,the first thing is to get source for inputing, then start to analyse source data. the last step is to persist them in the database or hdfs.
when using we should thought how to use theri computing capacity , because they are a big cluster, they could be used to solve these problems like these
1.theres is a lot of something repeat and needed to be processed .
2,if there is something needed many times iterator,like machine learning and graph calculate
i hold the opinion if you could feel the computing capacity and have a clear concept about how they work in your mind,you would know how to use them.
508
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
