原贴:http://www.dbanotes.net/arch/ebay_storage.html
Generator | Trampoline
<script type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/pagead/show_ads.js" type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/cpa/ads?client=ca-pub-2198040673582211&cpa_choice=CAAQhaT2_gEaCI52gVKP95-sKLGsuIEBMAA&oe=UTF-8&dt=1204393513795&lmt=1204369259&format=ref_text&output=textlink&correlator=1204393513795&url=http%3A%2F%2Fwww.dbanotes.net%2Farch%2Febay_storage.html®ion=_google_cpa_region_&ref=http%3A%2F%2Fwww.dbanotes.net%2F&frm=0&cc=100&ga_vid=339065900.1204393514&ga_sid=1204393514&ga_hid=539477684&flash=9.0.64&u_h=800&u_w=1280&u_ah=772&u_aw=1280&u_cd=24&u_tz=480&u_his=1&u_nplug=3&u_nmime=4" language="JavaScript1.1" type="text/javascript"></script> Get Firefox with Google Toolbar for better browsing
<script type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/pagead/show_ads.js" type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/cpa/ads?client=ca-pub-2198040673582211&cpa_choice=CAAQidTQgAIaCEapPfRcsfp6KN2uuIEBMAA&oe=UTF-8&dt=1204393514210&lmt=1204369259&prev_fmts=ref_text&format=ref_text&output=textlink&correlator=1204393513795&url=http%3A%2F%2Fwww.dbanotes.net%2Farch%2Febay_storage.html®ion=_google_cpa_region_&ref=http%3A%2F%2Fwww.dbanotes.net%2F&frm=0&cc=100&ga_vid=339065900.1204393514&ga_sid=1204393514&ga_hid=539477684&flash=9.0.64&u_h=800&u_w=1280&u_ah=772&u_aw=1280&u_cd=24&u_tz=480&u_his=1&u_nplug=3&u_nmime=4" language="JavaScript1.1" type="text/javascript"></script> Generate revenue from your website. Google AdSense.
前年在帖子里介绍过 eBay 数据量超过 2PB,这么大的数据量管理和规划是需要一些艺术的,可惜网络上能得到的信息太少。最近又找到一篇关于 eBay 存储的介绍,这篇文章通过访问 William Crosby-Lundin (这位老兄现在已经跳槽到 SalesForge了)披露了一些数据,虽然该文距离现在有一年了,还是对我有不少参考价值。
eBay 存储团队当时 12 个人,管理 13 套存储,总容量 2PB 左右,8000 个左右光纤口,可用性 99.94%,工作量肯定不小。每周要起用 10TB 存储,这些存储有 75 个 LUN(也就说平均每个 LUN 135GB 左右,这个数据有些怪异)。连接到 SAN 环境的主机大约有 1000 台,数据库集群有 600 个左右,据我所知,这里的集群应该只是指 Data Guard。
这么多的数据库,I/O 开销肯定不小,如何消除存储热点呢? 该文只是笼统的说通过存储层与主机层的数据分片达到的。如果应用上 I/O 均衡做的好一些,可能存储热点问题不会成为瓶颈。
这个存储环境的部署应该有好几年了。所以最近一两年比较火爆的存储虚拟化与 Provisioning 技术都没有大规模起用。个人觉得 eBay 这么大的数据量, Provisioning 技术对于 eBay 的环境会是比较适合的。
有的时候,盲人摸象也是一种乐趣呀。
--EOF--
Generator | Trampoline
<script type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/pagead/show_ads.js" type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/cpa/ads?client=ca-pub-2198040673582211&cpa_choice=CAAQhaT2_gEaCI52gVKP95-sKLGsuIEBMAA&oe=UTF-8&dt=1204393513795&lmt=1204369259&format=ref_text&output=textlink&correlator=1204393513795&url=http%3A%2F%2Fwww.dbanotes.net%2Farch%2Febay_storage.html®ion=_google_cpa_region_&ref=http%3A%2F%2Fwww.dbanotes.net%2F&frm=0&cc=100&ga_vid=339065900.1204393514&ga_sid=1204393514&ga_hid=539477684&flash=9.0.64&u_h=800&u_w=1280&u_ah=772&u_aw=1280&u_cd=24&u_tz=480&u_his=1&u_nplug=3&u_nmime=4" language="JavaScript1.1" type="text/javascript"></script> Get Firefox with Google Toolbar for better browsing
<script type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/pagead/show_ads.js" type="text/javascript"> </script> <script src="http://pagead2.googlesyndication.com/cpa/ads?client=ca-pub-2198040673582211&cpa_choice=CAAQidTQgAIaCEapPfRcsfp6KN2uuIEBMAA&oe=UTF-8&dt=1204393514210&lmt=1204369259&prev_fmts=ref_text&format=ref_text&output=textlink&correlator=1204393513795&url=http%3A%2F%2Fwww.dbanotes.net%2Farch%2Febay_storage.html®ion=_google_cpa_region_&ref=http%3A%2F%2Fwww.dbanotes.net%2F&frm=0&cc=100&ga_vid=339065900.1204393514&ga_sid=1204393514&ga_hid=539477684&flash=9.0.64&u_h=800&u_w=1280&u_ah=772&u_aw=1280&u_cd=24&u_tz=480&u_his=1&u_nplug=3&u_nmime=4" language="JavaScript1.1" type="text/javascript"></script> Generate revenue from your website. Google AdSense.
自定义搜索
他以前是SAN的头,work for fun,跑了
好文,收藏至20ju.com