重磅干货免费下载！阿里云RDS团队论文被数据库顶会SIGMOD 2018收录

最新推荐文章于 2024-04-25 23:41:35 发布
最新推荐文章于 2024-04-25 23:41:35 发布
阅读量155 收藏
点赞数
文章标签： 大数据
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/maoreyou/article/details/80597549
版权

摘要： 来自阿里云RDS团队的论文“**TcpRT: Instrument and Diagnostic Analysis System for Service Quality of Cloud Databases at Massive Scale in Real-time” （TcpRT：面向大规模海量云数据库的服务质量实时采集与诊断系统）**被数据库顶会SIGMOD 2018收录。

ACM SIGMOD数据管理国际会议是由美国计算机协会(ACM) 数据管理专业委员会(SIGMOD)发起、在数据库领域具有最高学术地位的国际性学术会议。

SIGMOD和另外两大数据库会议VLDB、ICDE构成了数据库领域的三个顶级会议。相对而言，SIGMOD比另外两个会议的含金量更高，被录取的难度更大。ACM SIGMOD的论文录取率是很低的，平均录取率大约仅为15%-17%。

来自阿里云RDS团队的论文“TcpRT: Instrument and Diagnostic Analysis System for Service Quality of Cloud Databases at Massive Scale in Real-time” （TcpRT：面向大规模海量云数据库的服务质量实时采集与诊断系统）被数据库顶会SIGMOD 2018收录。

TcpRT论文介绍了RDS天象系统在云数据库SLA数据采集、服务质量指标计算、异常检测、故障根因分析领域的创新工作，以及在各类云平台上大规模部署自动化服务的客户实践经验。

评委评价

I have plenty of experience with manual anomaly detection. That has wasted much time for me at work, so I liked what you described.

以下为SIGMOD 2018阿里云入选论文。

下载中文版：http://click.aliyun.com/m/1000000351/
下载英文版：http://click.aliyun.com/m/1000000352/


简介

随着企业上云趋势的日益热化，作为产业核心组件的数据库，已成为各大云计算公司增长最快的在线服务业务。作为中国第一大云数据库厂商，我们RDS团队致力于为用户提供稳定的云数据库服务。从本质上看，RDS是一个多租户DBaaS平台，利用轻量级KVM、Docker镜像等资源隔离技术将用户所购买的数据库实例部署在物理机上，按需分配资源并进行自动升降级，实现一套完全自动化的智能运维管理。

云数据库对客户业务的稳定性至关重要，因此快速发现云数据库性能出现异常，及时定位异常原因是云数据库厂商的一个挑战。TcpRT是阿里云数据库用来监控和诊断数据库服务质量的一个基础设施。TcpRT从主机TCP/IP协议栈的壅塞控制采集trace数据，计算数据库延迟和网络异常，在后台流式计算平台进行大规模实时数据分析和聚合，通过统计指标历史数据的柯西分布发现异常点，并通过同一台主机、交换机、proxy下所有实例一致性趋势的比例来计算不同组件发生异常的概率。

到目前为止，TcpRT以每秒采集2千万条原始trace数据、每天后台处理百亿吞吐数据、秒级检测异常的卓越性能在阿里云持续稳定运行三年。

本文贡献

  • 提出了一种新的对数据库服务质量进行采集的方法，基于内核壅塞模块实现，可以非侵入性、低代价的采集基于停等协议的关系数据库的per connection的延迟、带宽，分析用户使用数据库的模型（短连接和长连接），并且可以端到端的记录和量化基础网络服务质量对数据库服务质量的影响，包括丢包率、重传率。
  • 我们开发了一套对采集的原始数据进行数据清洗、过滤、聚合、分析的流式计算系统，系统可以做到水平扩展、容错性、实时性、Exactly Once，具有和其他大数据平台例如EMR、MaxCompute进行数据交换的能力
  • 我们提出了一个新的算法对TcpRT数据进行分析，来发现数据库的服务质量有无异常，并且对异常事件的根因进行定位


会议将于6月10日在美国休斯敦召开，论文也会公开发表，以下是相关信息。
Title：SIGMOD/PODS '18 International Conference on Management of Data
Houston, TX, USA — June 10 - 15, 2018
Pages：1846
Sponsor： SIGMOD ACM Special Interest Group on Management of Data
Publisher：ACM New York, NY, USA
ISBN：978-1-4503-4703-7
Conference：MODInternational Conference on Management of Data

原文链接

maoreyou
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
重磅干货下载TcpRT阿里云RDS智能诊断系统云上大规模部署自动化服务的客户实践经验发表于SIGMOD2018.pdf
08-28
来自阿里云RDS团队的论文“TcpRT: Instrument and Diagnostic Analysis System for Service Quality of Cloud Databases at Massive Scale in Real-time” （TcpRT：面向大规模海量云数据库的服务质量实时采集与诊断...
Python 批量下载SIGMOD,VLDB的论文 Mac OS
MustImproved的博客
09-26 1080
这里写自定义目录标题Python 批量下载SIGMOD,VLDB的论文 Mac OS实现爬取网站下载单篇论文获得所有论文的链接完整代码 Python 批量下载SIGMOD,VLDB的论文 Mac OS 因为一个个找带某一关键词的论文太累了，因此写了一个python脚本来下载论文，可以支持关键字寻找，批量下载。 目前只适合SIGMOD和VLDB。 需要下载bs4, requests模块。 实现 推荐一个网站https://dblp.org，收录了比较多的论文。 本python脚本就是爬取这个网站，获得某一年的
顶会｜关于数据库顶级会议 SIGMOD 2018，看这一篇就够了！
qswm_18301240090的博客
07-11 2494
小蚂蚁说：SIGMOD数据管理国际会议是数据库领域具有最高学术地位的国际性学术会议，位列数据库方向的三大顶级会议之首（其次是VLDB及ICDE）。OceanBase的核心团队成员有幸参与到了SIGMOD 2018会议中，本文由蚂蚁金服OceanBase研究员日照为大家带来最专业、最前沿的大会独家报道。接下来几天，蚂蚁金服OceanBase数据库官方微信号将为大家持续带来SIGMOD系列论文解读，以...
又一创新！阿里云 Serverless 调度论文被云计算顶会 ACM SoCC 收录
阿里巴巴中间件
01-11 203
阿里云 Serverless 函数计算不断突破：发布基于函数画像的调度算法论文，在提升资源利用率的同时达到性能高稳定性。
WEB网站应用连接阿里云RDS数据库实例（小白也能学会的通俗易懂版）.pdf
08-14
WEB网站应用连接阿里云RDS数据库实例（小白也能学会的通俗易懂版），为什么要发这个阿里云RDS数据库实例呢，有的同学可能买了阿里云RDS实例不太会用，看了阿里云配置步骤还是不会连接，所以就整理了一下，就一张PDF...
阿里云RDS数据库恢复到本地自建数据库中步骤详解.doc
12-04
阿里云RDS数据库恢复到本地自建数据库详解的步骤分析与操作，网上很多都是无法恢复的，只要按步骤执行，保证可用。很不错的资源。
阿里云RDS数据库恢复到本地自建数据库
03-15
阿里云RDS数据库恢复到本地自建数据库，网上很多都是无法恢复的，此文档是本人经常一个上午的恢复总结写出来的。只要按步骤执行，保证可用。
SIGMOD 2009 全部论文（2。后12篇）
03-12
14 Continuous obstructed nearest neighbor queries in spatial databases Yunjun Gao, Baihua Zheng Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data In this paper, we study a novel form of continuous nearest neighbor queries in the presence of obstacles, namely continuous obstructed nearest neighbor (CONN) search. It considers the impact of obstacles on the distance between objects, ... 15 Optimizing complex extraction programs over evolving text data Fei Chen, Byron J. Gao, AnHai Doan, Jun Yang, Raghu Ramakrishnan Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Most information extraction (IE) approaches have considered only static text corpora, over which we apply IE only once. Many real-world text corpora however are dynamic. They evolve over time, and so to keep extracted information up to date we ... 16 Privacy preservation of aggregates in hidden databases: why and how? Arjun Dasgupta, Nan Zhang, Gautam Das, Surajit Chaudhuri Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Many websites provide form-like interfaces which allow users to execute search queries on the underlying hidden databases. In this paper, we explain the importance of protecting sensitive aggregate information of hidden databases from being ... 17 Efficient approximate entity extraction with edit distance constraints Wei Wang, Chuan Xiao, Xuemin Lin, Chengqi Zhang Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Named entity recognition aims at extracting named entities from unstructured text. A recent trend of named entity recognition is finding approximate matches in the text with respect to a large dictionary of known entities, as the domain ... 18 Large-scale uncertainty management systems: learning and exploiting your data Shivnath Babu, Sudipto Guha, Kamesh Munagala Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data The database community has made rapid strides in capturing, representing, and querying uncertain data. Probabilistic databases capture the inherent uncertainty in derived tuples as probability estimates. Data acquisition and stream systems can ... 19 Data warehouse technology by infobright Dominik Slezak, Victoria Eastwood Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data We discuss Infobright technology with respect to its main features and architectural differentiators. We introduce the upcoming research and development projects that may be of special interest to the academic and industry communities. ... 20 Detecting and resolving unsound workflow views for correct provenance analysis Peng Sun, Ziyang Liu, Susan B. Davidson, Yi Chen Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Workflow views abstract groups of tasks in a workflow into high level composite tasks, in order to reuse sub-workflows and facilitate provenance analysis. However, unless a view is carefully designed, it may not preserve the dataflow ... 21 Indexing correlated probabilistic databases Bhargav Kanagal, Amol Deshpande Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data With large amounts of correlated probabilistic data being generated in a wide range of application domains including sensor networks, information extraction, event detection etc., effectively managing and querying them has become an important ... 22 Cross-tier, label-based security enforcement for web applications Brian J. Corcoran, Nikhil Swamy, Michael Hicks Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data This paper presents SELinks, a programming language focused on building secure multi-tier web applications. SELinks provides a uniform programming model, in the style of LINQ and Ruby on Rails, with language syntax for accessing objects ... 23 Exploiting context analysis for combining multiple entity resolution systems Zhaoqi Chen, Dmitri V. Kalashnikov, Sharad Mehrotra Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Entity Resolution (ER) is an important real world problem that has attracted significant research interest over the past few years. It deals with determining which object descriptions co-refer in a dataset. Due to its practical significance for ... 24 Kernel-based skyline cardinality estimation Zhenjie Zhang, Yin Yang, Ruichu Cai, Dimitris Papadias, Anthony Tung Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data The skyline of a d-dimensional dataset consists of all points not dominated by others. The incorporation of the skyline operator into practical database systems necessitates an efficient and effective cardinality estimation module. ... 25 Scalable skyline computation using object-based space partitioning Shiming Zhang, Nikos Mamoulis, David W. Cheung Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data The skyline operator returns from a set of multi-dimensional objects a subset of superior objects that are not dominated by others. This operation is considered very important in multi-objective analysis of large datasets. Although a large ...
sigmod 2012 全部论文
06-09
数据库方面的顶级会议论文集，2012年5月于美国举办，2013年将于6月22日举行
SIGMOD 2009 全部论文（1）
03-11
这是前面的13篇论文 1 Keyword search on structured and semi-structured data Yi Chen, Wei Wang, Ziyang Liu, Xuemin Lin Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data 2 Efficient type-ahead search on relational data: a TASTIER approach Guoliang Li, Shengyue Ji, Chen Li, Jianhua Feng 3 FlashLogging: exploiting flash devices for synchronous logging performance Shimin Chen 4 Query processing techniques for solid state drives Dimitris Tsirogiannis, Stavros Harizopoulos, Mehul A. Shah, Janet L. Wiener, Goetz Graefe 5 A revised r*-tree in comparison with related index structures Norbert Beckmann, Bernhard Seeger 6 ZStream: a cost-based query processor for adaptively detecting composite events Yuan Mei, Samuel Madden Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Composite (or Complex) event processing (CEP) systems search sequences of incoming events for occurrences of user-specified event patterns. Recently, they have gained more attention in a variety of areas due to their powerful and expressive ... 7 A comparison of flexible schemas for software as a service Stefan Aulbach, Dean Jacobs, Alfons Kemper, Michael Seibold Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data A multi-tenant database system for Software as a Service (SaaS) should offer schemas that are flexible in that they can be extended different versions of the application and dynamically modified while the system is on-line. This ... 8 Query optimizers: time to rethink the contract? Surajit Chaudhuri Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Query Optimization is expected to produce good execution plans for complex queries while taking relatively small optimization time. Moreover, it is expected to pick the execution plans with rather limited knowledge of data and without any ... 9 Keyword search in databases: the power of RDBMS Lu Qin, Jeffrey Xu Yu, Lijun Chang Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Keyword search in relational databases (RDBs) has been extensively studied recently. A keyword search (or a keyword query) in RDBs is specified by a set of keywords to explore the interconnected tuple structures in an RDB ... 10 ROX: run-time optimization of XQueries Riham Abdel Kader, Peter Boncz, Stefan Manegold, Maurice van Keulen Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Optimization of complex XQueries combining many XPath steps and joins is currently hindered by the absence of good cardinality estimation and cost models for XQuery. Additionally, the state-of-the-art of even relational query optimization still ... 11 Query by output Quoc Trung Tran, Chee-Yong Chan, Srinivasan Parthasarathy Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data It has recently been asserted that the usability of a database is as important as its capability. Understanding the database schema, the hidden relationships among attributes in the data all play an important role in this context. Subscribing ... 12 Ranking distributed probabilistic data Feifei Li, Ke Yi, Jeffrey Jestes Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Ranking queries are essential tools to process large amounts of probabilistic data that encode exponentially many possible deterministic instances. In many applications where uncertainty and fuzzy information arise, data are collected from ... 13 Authenticated join processing in outsourced databases Yin Yang, Dimitris Papadias, Stavros Papadopoulos, Panos Kalnis Jun. 2009 Proceedings of the 35th SIGMOD international conference on Management of data Database outsourcing requires that a query server constructs a proof of result correctness, which can be verified by the client using the data owner's signature. Previous authentication techniques deal with range queries on a single relation ...
从没想到监控可以这么做！阿里云RDS智能诊断系统首次公开
阿里技术
05-21 998

 
 
 
 
 
 
 阿里妹导读：来自阿里云RDS团队的论文“TcpRT: Instrument and Diagnost...
Amazon Aurora(SIGMOD 2018)云数据库关键技术解读
weixin_43827934的博客
09-26 2063
说在前面 本文主要介绍 《Amazon Aurora: On Avoiding Distributed Consensus for I/Os, Commits, and Membership Changes 》（SIGMOD 2018）这篇论文，这篇论文主要是关于Amazon Aurora分布式数据库中一些关键技术的实现思路。 若想直到更多关于Aurora基础架构的，可参考 《Amazon Aur...
SIGMOD 2017论文的摘要与看法
chunjing6629的博客
06-23 3650
SIGMOD2017 持续更新 3.1 Concurrency并发 ACIDRain: Concurrency-Related Attacks on Database-Backed Web Applications ACIDRain：对数据库支持的Web应用程序的并发性攻击 Cicada: Dependably Fast Multi-Core In-Memory Transact...
ElasticSearch复合查寻
最新发布
weixin_53676834的博客
04-25 223
如果子查询比较多，每一个都参与算分，是不是查询性能就会受到影响，而如果你在使用的时候，你用的是filter查询和must not查询，它们是不参与算分的。虽然BooleanQuery复合查询里面有这么四种组合关系，但是除了跟算分相关的，一般就是关键字：用户输入的个关键字，除了用户输入的个关键字以外，剩下的过滤条件都应该放在must_not 或者filter里边，尽可能的减少算分，提高查询的效率。·filter，从字面来看，它也是必须匹配，Must也是必须匹配，确实它俩都是必须匹配，都是”与”的意思。
武汉星起航：依托自营优势与资源积累，创新一站式卖家孵化服务
xqhang的博客
04-20 342
武汉星起航自成立以来，便深耕自营亚马逊跨境电商领域，通过精细化的运营和持续的创新，积累了丰富的店铺运营经验。武汉星起航电子商务有限公司作为跨境电商领域的佼佼者，始终秉持“走出去”战略，凭借自营店铺经验积累和跨境电商资源的积累，利用自身经验和资源优势，实现开店策划、运营教学、资源服务的一站式卖家孵化，为众多创业者提供了强大的支持和服务。未来，武汉星起航将继续秉承创新、进取的精神，不断提升服务质量与运营效率，为更多想要涉足跨境电商领域的人们提供优质的支持和服务。二、跨境电商资源积累，为卖家提供全方位支持。
matlab读取阿里云物联网平台数据并读写阿里云RDS数据库
06-10
这个问题涉及到两个方面的内容，一个是如何读取阿里云物联网平台数据，另一个是如何读写阿里云RDS数据库。下面我分别进行解答： 1. 如何读取阿里云物联网平台数据？ 阿里云物联网平台提供了多种接入方式，包括 ...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值