![](https://img-blog.csdnimg.cn/20201014180756925.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
雙重底
量化金融分析師
展开
-
The Google File System : part2 DESIGN OVERVIEW
2.DESIGN OVERVIEW2.1 AssumptionsIn designing a file system for our needs, we have been guided by assumptions that offer both challenges and opportunities. We alluded to some key observations ear原创 2017-09-03 23:01:41 · 532 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part10 Related Work
10 Related WorkThe Boxwood project [24] has components that overlap in some ways with Chubby, GFS, and Bigtable, since it provides for distributed agreement, locking, distributed chunk storage, and原创 2017-09-02 16:51:44 · 393 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part9 Lessons
9 LessonsIn the process of designing, implementing, maintaining,and supporting Bigtable, we gained useful experience and learned several interesting lessons.One lesson we learned is that large dis原创 2017-09-02 16:34:04 · 329 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part8 Real Applications
8 Real ApplicationsAs of August 2006, there are 388 non-test Bigtable clusters running in various Google machine clusters, with a combined total of about 24,500 tablet servers. Table 1 shows a原创 2017-09-02 14:34:06 · 351 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part5 Implementation
5 ImplementationThe Bigtable implementation has three major components: a library that is linked into every client, one master server, and many tablet servers. Tablet servers can be dynamically原创 2017-09-02 09:52:42 · 652 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part4 Building Blocks
4 Building BlocksBigtable is built on several other pieces of Google infrastructure. Bigtable uses the distributed Google File System (GFS) to store log and data files. A Bigtable cluster typica原创 2017-09-02 09:49:22 · 296 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part3 API
3 APIThe Bigtable API provides functions for creating and deleting tables and column families. It also provides functions for changing cluster, table, and column family metadata, such as access co原创 2017-09-01 23:14:13 · 453 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part2 Data Model (数据模型)
2 Data ModelA Bigtable is a sparse, distributed, persistent multidimensional sorted map. The map is indexed by a row key, column key, and a timestamp; each value in the map is an uninterpreted a原创 2017-09-01 22:15:55 · 1006 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part1 Abstract and Introduction
AbstractBigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects原创 2017-09-01 20:56:12 · 413 阅读 · 0 评论 -
Google六驾马车:MapReduce/Bigtable/GFS和Caffeine/Dremel/Pregel
近来公司的需要,先阅读Google的新旧三驾马车,共六驾马车。这六篇Google论文真是考验英语水平啊,希望慢慢能啃完。原创 2017-09-01 20:50:30 · 614 阅读 · 0 评论 -
The Google File System : part1 ABSTRACT and INTRODUCTION
ABSTRACTWe have designed and implemented the Google File System, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on原创 2017-09-02 17:44:43 · 441 阅读 · 0 评论 -
The Google File System : part8 RELATED WORK and CONCLUSIONS and ACKNOWLEDGMENTS
8.RELATED WORKLike other large distributed file systems such as AFS,GFS provides a location independent namespace which enables data to be moved transparently for load balance or fault tolerance.原创 2017-09-04 20:41:12 · 708 阅读 · 0 评论 -
The Google File System : part7 EXPERIENCES
7. EXPERIENCESIn the process of building and deploying GFS, we have experienced a variety of issues, some operational and some technical.Initially, GFS was conceived as the backend file system f原创 2017-09-04 20:39:12 · 397 阅读 · 0 评论 -
The Google File System : part6 MEASUREMENTS
6. MEASUREMENTSIn this section we present a few micro-benchmarks to illustrate the bottlenecks inherent in the GFS architecture and implementation, and also some numbers from real clusters in use at原创 2017-09-04 19:53:27 · 490 阅读 · 0 评论 -
The Google File System : part5 FAULT TOLERANCE AND DIAGNOSIS
5.FAULT TOLERANCE AND DIAGNOSISOne of our greatest challenges in designing the system is dealing with frequent component failures. The quality and quantity of components together make these proble原创 2017-09-04 19:00:15 · 379 阅读 · 0 评论 -
The Google File System : part4 MASTER OPERATION
4. MASTER OPERATIONThe master executes all namespace operations. In addition, it manages chunk replicas throughout the system: it makes placement decisions, creates new chunks and hence replicas原创 2017-09-04 18:43:09 · 350 阅读 · 0 评论 -
The Google File System : part3 SYSTEM INTERACTIONS
3. SYSTEM INTERACTIONSWe designed the system to minimize the master’s involvement in all operations. With that background, we now describe how the client, master, and chunkservers interact to impl原创 2017-09-03 23:53:51 · 514 阅读 · 0 评论 -
Bigtable: A Distributed Storage System for Structured Data : part11 Conclusions and Acknowledgements
11 ConclusionsWe have described Bigtable, a distributed system for storing structured data at Google. Bigtable clusters have been in production use since April 2005, and we spent roughly seven per原创 2017-09-02 17:04:12 · 327 阅读 · 0 评论