Zhe Zhang Software Engineer, LinkedIn

Zhe Zhang 

---

Software Engineer, LinkedIn

网站 | @oldcap

Zhe Zhang is an Engineering Manager at LinkedIn where he leads the Core Big Data Services team. The team leverages open source technologies including Hadoop, Spark, TensorFlow, and beyond, to form the storage-compute engine of LinkedIn’s big data platform. Zhe is also a PMC member of Apache Hadoop, and author of HDFS erasure coding, a major feature for Hadoop 3.0. Before LinkedIn, Zhe worked at Cloudera and IBM’s T. J. Watson Research Center. Zhe has over 20 research publications and 5 US patents. While at IBM, he received the Research Accomplishment Award and the Outstanding Technology Achievement Award.

议题

---

• 领英大数据平台--超过1万节点，每天15万个作业，智能连接4.7亿职场用户

领英是全球最早应用大数据技术的公司之一。在过去9年的时间里，领英的大数据平台扩展了将近500倍，从20台节点支持10个用户运行MapReduce，到现在超过1万台节点支持几千名工程师和科学家运行从交互式Presto查询到TensorFlow深度学习的各种大规模数据分析。这个报告会分享领英的大数据平台团队怎样解决大规模和高速增长带来的各种挑战。 了解更多信息.

• 成长的烦恼--领英大数据平台500倍扩展中应对的挑战 

领英是全球最早应用大数据技术的公司之一。在过去9年的时间里，领英的大数据平台扩展了将近500倍，从20台节点支持10个用户运行MapReduce，到现在超过1万台节点支持几千名工程师和科学家运行从交互式Presto查询到TensorFlow深度学习的各种大规模数据分析。这个报告会分享领英的大数据平台团队怎样解决大规模和高速增长带来的各种挑战。