数据库内核工程师必读论文清单

腾讯云开发者

于 2024-07-05 08:45:41 发布

阅读量670

点赞数 19

文章标签：数据库

本文链接：https://blog.csdn.net/QcloudCommunity/article/details/140221617

版权

👉目录

1 Basics

2 System Design

3 SQL Engine

4 Storage Engine

5 Miscellaneous

论文列表基本涵盖了数据库系统的各个方面，包括必要的理论背景、经典的系统设计以及数据库内的多个模块。分为不同的类别和子类别，以便于导航。每篇论文都伴有标题、作者、出版年份，以及在可能的情况下提供全文链接。

01

Basics

1.1 Essentials

A relational model of data for large shared data banks (1970) - Codd, Edgar F.
（https://dl.acm.org/doi/pdf/10.1145/362384.362685）
SEQUEL: A structured English query language (1974) - Chamberlin, Donald D., and Raymond F. Boyce.
（https://dl.acm.org/doi/pdf/10.1145/800296.811515）
INGRES: a relational data base system (1975) - Held, G. D., M. R. Stonebraker, and Eugene Wong.
（https://dl.acm.org/doi/pdf/10.1145/1499949.1500029）
Extending the database relational model to capture more meaning (1979) - Codd, Edgar F.
（https://dl.acm.org/doi/pdf/10.1145/320107.320109）
A critique of the SQL database language (1984) - Date, C. J.
（https://dl.acm.org/doi/pdf/10.1145/984549.984551）

1.2 Consensus

The Part-Time Parliament (1998) - Lamport, Leslie.
（https://dl.acm.org/doi/pdf/10.1145/3335772.3335939）
Paxos Made Simple (2001) - Lamport, Leslie.
（https://www.microsoft.com/en-us/research/publication/2016/12/paxos-simple-Copy.pdf）
Consensus: Bridging theory and practice (2014) - Ongaro, Diego.
（https://web.stanford.edu/~ouster/cgi-bin/papers/OngaroPhD.pdf）
In search of an understandable consensus algorithm (extended version) (2014) - Ongaro, Diego, and John Ousterhout.
（https://www.repository.cam.ac.uk/bitstream/handle/1810/291682/thesis.pdf?sequence=1）
Distributed consensus revised (2019) - Howard, Heidi.
（https://www.repository.cam.ac.uk/bitstream/handle/1810/291682/thesis.pdf?sequence=1）
A Generalised Solution to Distributed Consensus (2019) - Howard, Heidi, and Richard Mortier.
（https://arxiv.org/pdf/1902.06776）
Paxos vs Raft: Have we reached consensus on distributed consensus? (2020) - Howard, Heidi, and Richard Mortier.
（https://dl.acm.org/doi/pdf/10.1145/3380787.3393681）

1.3 Consistency

Consistency Tradeoffs in Modern Distributed Database System Design (2012) - Abadi, Daniel.
（https://www.cs.umd.edu/~abadi/papers/abadi-pacelc.pdf）
Logical physical clocks and consistent snapshots in globally distributed databases (2014) - Kulkarni S S, Demirbas M, Madappa D, et al.
（https://cse.buffalo.edu/tech-reports/2014-04.pdf）
Ark: A Real-World Consensus Implementation (2014) - Kasheff, Zardosht, and Leif Walsh.
（https://arxiv.org/pdf/1407.4765）
PolarFS: an ultra-low latency and failure resilient distributed file system for shared storage cloud database (2018) - Cao, Wei, et al.
（https://dl.acm.org/doi/pdf/10.14778/3229863.3229872）
Anna: A kvs for any scale (2018) - Wu, Chenggang, et al.
（https://www2.eecs.berkeley.edu/Pubs/TechRpts/2019/EECS-2019-122.pdf）
Strong and efficient consistency with consistency-aware durability (2021) - Ganesan, Aishwarya, et al.
（https://dl.acm.org/doi/pdf/10.1145/3423138）

02

System Design

2.1 RDBMS

System R: Relational Approach to Database Management (1976) - Astrahan, Morton M., et al.
（https://dl.acm.org/doi/pdf/10.1145/320455.320457）
The design and implementation of INGRES (1976) - Stonebraker, Michael, et al.
（https://dl.acm.org/doi/10.1145/320473.320476）
The design of Postgres (1986) - Stonebraker, Michael, and Lawrence A. Rowe.
（https://dl.acm.org/doi/pdf/10.1145/16856.16888）
Query Processing in Main Memory Database Management Systems (1986) - Lehman, Tobin J., and Michael J. Carey.
（https://dl.acm.org/doi/pdf/10.1145/16894.16878）
Megastore: Providing Scalable, Highly Available Storage for Interactive Services (2011) - Baker J, Bond C, Corbett J C, et al.
（http://pages.cs.wisc.edu/~akella/CS838/F12/838-CloudPapers/Megastore.pdf）
Spanner: Google's globally distributed database (2013) - Corbett, James C., et al.
（https://dl.acm.org/doi/pdf/10.1145/2491245）
Online, Asynchronous Schema Change in F1 (2013) - Rae, Ian, et al.
（https://dl.acm.org/doi/pdf/10.14778/2536222.2536230）
Amazon aurora: Design considerations for high throughput cloud-native relational databases (2017) - Verbitski, Alexandre, et al.
（https://dl.acm.org/doi/pdf/10.1145/3035918.3056101）
Looking Back at Postgres (2019) - Hellerstein, Joseph M.
（https://arxiv.org/pdf/1901.01973）
CockroachDB: The Resilient Geo-Distributed SQL Database (2020) - Taft, Rebecca, et al.
（https://dl.acm.org/doi/pdf/10.1145/3318464.3386134）
F1 Lightning: HTAP as a Service (2020) - Yang, Jiacheng, et al.
（https://dl.acm.org/doi/pdf/10.14778/3415478.3415553）
TiDB: a Raft-based HTAP database (2020) - Huang, Dongxu, et al.
（https://dl.acm.org/doi/pdf/10.14778/3415478.3415535）
PolarDB Serverless: A Cloud Native Database for Disaggregated Data Centers (2021) - Cao, Wei, et al.
（https://dl.acm.org/doi/pdf/10.1145/3448016.3457560）

2.2 NoSQL

Bigtable: A Distributed Storage System for Structured Data (2006) - Chang, Fay, et al.
（https://dl.acm.org/doi/pdf/10.1145/1365815.1365816）
Dynamo: Amazon’s Highly Available Key-value Store (2007) - DeCandia, Giuseppe, et al.
（https://dl.acm.org/doi/pdf/10.1145/1323293.1294281）
PNUTS: Yahoo!’s Hosted Data Serving Platform (2008) - Cooper, Brian F., et al.
（https://dl.acm.org/doi/pdf/10.14778/1454159.1454167）
Cassandra - A Decentralized Structured Storage System (2010) - Lakshman, Avinash, and Prashant Malik.
（https://dl.acm.org/doi/pdf/10.1145/1773912.1773922）
Windows azure storage: a highly available cloud storage service with strong consistency (2011) - Calder, Brad, et al.
（https://dl.acm.org/doi/pdf/10.1145/2043556.2043571）
Azure data lake store: a hyperscale distributed file service for big data analytics (2017) - Ramakrishnan, Raghu, et al.
（https://dl.acm.org/doi/pdf/10.1145/3035918.3056100）
PNUTS to Sherpa: Lessons from Yahoo!’s Cloud Database (2019) - Cooper, Brian F., et al.
（https://dl.acm.org/doi/pdf/10.14778/3352063.3352146）

03

SQL Engine

3.1 Optimizer Framework

Access Path Selection in a Relational Database Management System (1979) - Selinger, P. Griffiths, et al.
（https://dl.acm.org/doi/pdf/10.1145/582095.582099）
Query Optimization by Simulated Annealing (1987) - Ioannidis, Yannis E., and Eugene Wong.
（https://dl.acm.org/doi/pdf/10.1145/38713.38722）
The EXODUS Optimizer Generator (1987) - Graefe, Goetz, and David J. DeWitt.
（https://dl.acm.org/doi/pdf/10.1145/38713.38734）
Extensible/Rule Based Query Rewrite Optimization in Starburst (1992) - Pirahesh, Hamid, Joseph M. Hellerstein, and Waqar Hasan.
（https://dl.acm.org/doi/pdf/10.1145/141484.130294）
The Volcano Optimizer Generator- Extensibility and Efficient Search (1993) - Graefe, Goetz, and William J. McKenna.
（https://www.cse.iitb.ac.in/infolab/Data/Courses/CS632/Papers/Volcano-graefe.pdf）
The Cascades Framework for Query Optimization (1995) - Graefe, Goetz.
（https://liuyehcf.github.io/resources/paper/The-Cascades-Framework-For-Query-Optimization.pdf）
An Overview of Query Optimization in Relational Systems (1998) - Chaudhuri, Surajit.
（https://dl.acm.org/doi/pdf/10.1145/1007568.1007642）
Robust Query Processing through Progressive Optimization (2004) - Markl, Volker, et al.
（https://dl.acm.org/doi/pdf/10.1145/1007568.1007642）
Orca: A Modular Query Optimizer Architecture for Big Data (2014) - Soliman, Mohamed A., et al.
（https://dl.acm.org/doi/pdf/10.1145/2588555.2595637）
Parallelizing Query Optimization on Shared-Nothing Architectures (2015) - Trummer, Immanuel, and Christoph Koch.
（https://arxiv.org/pdf/1511.01768）
The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database (2016) - Chen, Jack, et al.
（https://dl.acm.org/doi/pdf/10.14778/3007263.3007277）

3.2 Transformation

Processing queries with quantifiers a horticultural approach (1983) - Dayal, Umeshwar.
（https://dl.acm.org/doi/pdf/10.1145/588058.588075）
Translating SQL into relational algebra: Optimization, semantics, and equivalence of SQL queries (1985) - Ceri, Stefano, and Georg Gottlob.
（https://www.academia.edu/download/50687636/tse.1985.23222320161202-29901-8u86ef.pdf）
Grammar-like Functional Rules for Representing Query Optimization Alternatives, (1988) - Lohman, Guy M.
（https://dl.acm.org/doi/pdf/10.1145/971701.50204）
Query Optimization by Predicate Move-Around (1994) - Levy, Alon Y., Inderpal Singh Mumick, and Yehoshua Sagiv.
（https://www.researchgate.net/profile/Inderpal-Mumick/publication/2754592_Query_Optimization_by_Predicate_Move-Around/links/0f317534d437e49755000000/Query-Optimization-by-Predicate-Move-Around.pdf）
Eager Aggregation and Lazy Aggregation (1995) - Yan, Weipeng P., and Per-Bike Larson.
（https://www.researchgate.net/profile/Per-Ake-Larson/publication/2733082_Eager_Aggregation_and_Lazy_Aggregation/links/02bfe50ce6de3dad7c000000/Eager-Aggregation-and-Lazy-Aggregation.pdf）
Parameterized Queries and Nesting Equivalences (2000) - Galindo-Legaria, C. A.
（https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/tr-2000-31.pdf）
Cost-based query transformation in Oracle (2006) - Ahmed, Rafi, et al.
（https://www.researchgate.net/profile/Rafi-Ahmed-2/publication/221311318_Cost-Based_Query_Transformation_in_Oracle/links/572bbc5e08aef7c7e2c6b829/Cost-Based-Query-Transformation-in-Oracle.pdf）

3.3 Nested Query

Using semi-joins to solve relational queries (1981) - Bernstein, Philip A., and Dah-Ming W. Chiu.
（https://dl.acm.org/doi/pdf/10.1145/322234.322238）
On optimizing an SQL-like nested query (1982) - Kim, Won.
（https://dl.acm.org/doi/pdf/10.1145/319732.319745）
Optimization of nested queries in a distributed relational database (1984) - L&man, Guy M., et al.
（https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=12fd1fe22687f5944613832de4e64ef902043aec）
SQL-like and Quel-like correlation queries with aggregates revisited (1984) - Kiessling, Werner.
（http://www2.eecs.berkeley.edu/Pubs/TechRpts/1984/ERL-m-84-75.pdf）
Translating SQL into relational algebra: Optimization, semantics, and equivalence of SQL queries (1985) - Ceri, Stefano, and Georg Gottlob.
（https://www.academia.edu/download/50687636/tse.1985.23222320161202-29901-8u86ef.pdf）
Optimization of nested SQL queries revisited (1987) - Ganski, Richard A., and Harry KT Wong.
（https://dl.acm.org/doi/pdf/10.1145/38714.38723）
A Unitied Approach to Processing Queries That Contain Nested Subqueries, Aggregates, and Quantifiers (1987) - Dayal, Umeshwar.
（https://vldb.org/conf/1987/P197.PDF）
Optimization of correlated SQL queries in a relational database management system (1998) - Jou, Michelle M., Ting Yu Leung, and Mir Hamid Pirahesh.
（https://patentimages.storage.googleapis.com/3b/24/39/a947424a6eb0ea/US5822750.pdf）
Orthogonal Optimization of Subqueries and Aggregation (2001) - Galindo-Legaria, César, and Milind Joshi.
（https://dl.acm.org/doi/pdf/10.1145/376284.375748）
WinMagic : Subquery Elimination Using Window Aggregation (2003) - Zuzarte, Calisto, et al.
（https://dl.acm.org/doi/pdf/10.1145/872757.872840）
Execution strategies for SQL subqueries (2007) - Elhemali, Mostafa, et al.
（https://dl.acm.org/doi/pdf/10.1145/1247480.1247598）
Enhanced subquery optimizations in Oracle (2009) - Bellamkonda, Srikanth, et al.
（https://dl.acm.org/doi/pdf/10.14778/1687553.1687563）
Unnesting Arbitrary Queries) (2015) - Neumann, Thomas, and Alfons Kemper.
（https://dl.gi.de/bitstream/handle/20.500.12116/2418/383.pdf?sequence=1）

3.4 Functional Dependencies

Fundamental Techniques for Order Optimization (1996) - Simmen, David, Eugene Shekita, and Timothy Malkemus.
（https://dl.acm.org/doi/pdf/10.1145/233269.233320）
[Thesis] Exploiting Functional Dependence in Query Optimization (2000) - Paulley, Glenn Norman.
（https://cs.uwaterloo.ca/research/tr/2000/11/CS-2000-11.thesis.pdf）
An Efficient Framework for Order Optimization (2004) - Neumann, Thomas, and Guido Moerkotte.
（https://madoc.bib.uni-mannheim.de/736/1/TR-03-011.pdf）
Incorporating Partitioning and Parallel Plans into the SCOPE Optimizer (2010) - Zhou, Jingren, Per-Ake Larson, and Ronnie Chaiken.
（http://www.cs.albany.edu/~jhh/courses/readings/zhou10.pdf）
Accelerating Queries with GroupBy and Join by Group join (2011) - Moerkotte, Guido, and Thomas Neumann.
（https://dl.acm.org/doi/pdf/10.14778/3402707.3402723）

3.5 Join Order

Access paths in the" Abe" statistical query facility (1982) - Klug, Anthony.
（https://dl.acm.org/doi/pdf/10.1145/582353.582382）
Extending the Algebraic Framework of Query Processing to Handle Outerjoins (1984) - RosenthaI, A., and D. Reiner.
（https://www.vldb.org/conf/1984/P334.PDF）
Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products (2006) - Moerkotte, Guido, and Thomas Neumann.
（https://www.researchgate.net/profile/Thomas_Neumann2/publication/47861835_Analysis_of_Two_Existing_and_One_New_Dynamic_Programming_Algorithm_for_the_Generation_of_Optimal_Bushy_Join_Trees_without_Cross_Products/links/0912f506d90ad19031000000.pdff）
Dynamic programming strikes back (2008) - Moerkotte, Guido, and Thomas Neumann.
（https://dl.acm.org/doi/pdf/10.1145/1376616.1376672）
On the Correct and Complete Enumeration of the Core Search Space (2013) - Moerkotte, Guido, Pit Fender, and Marius Eich.
（https://dl.acm.org/doi/pdf/10.1145/2463676.2465314）
How Good Are Query Optimizers, Really? (2015) - Leis, Viktor, et al.
（https://dl.acm.org/doi/pdf/10.14778/2850583.2850594）
The Complete Story of Joins (2017) - Neumann, Thomas, Viktor Leis, and Alfons Kemper.
（https://dl.gi.de/bitstreams/535a5d94-043d-4b1a-9062-fbaf8ed35468/download）
Improving Join Reorderability with Compensation Operators (2018) - Wang, TaiNing, and Chee-Yong Chan.
（https://dl.acm.org/doi/pdf/10.1145/3183713.3183731）
Adaptive Optimization of Very Large Join Queries (2018) - Neumann, Thomas, and Bernhard Radke.
（https://dl.acm.org/doi/pdf/10.1145/3183713.3183733）

3.6 Cost Model

Modelling Costs for a MM-DBMS (1996) - Listgarten, Sherry, and Marie-Anne Neimat.
（https://www.semanticscholar.org/paper/Modelling-Costs-for-a-MM-DBMS-Listgarten-Neimat/42b88445cfb28fbe4b6539c97674a8fa9815e635）
SEEKing the truth about ad hoc join costs (1997) - Haas, Laura M., et al.
（https://minds.wisconsin.edu/bitstream/handle/1793/59726/TR1148.pdf?sequence=11）
Approximation Schemes for Many-Objective Query Optimization (2014) - Trummer, Immanuel, and Christoph Koch.
（https://dl.acm.org/doi/pdf/10.1145/2588555.2610527）
Multi-Objective Parametric Query Optimization (2015) - Trummer, Immanuel, and Christoph Koch.
（https://dl.acm.org/doi/pdf/10.1145/3068612）

3.7 Statistics

Accurate Estimation of the Number of Tuples Satisfying a Condition (1984) - Piatetsky-Shapiro, Gregory, and Charles Connell.
（https://dl.acm.org/doi/pdf/10.1145/971697.602294）
Optimal Histograms for Limiting Worst-Case Error Propagation in the Size of Join Results (1993) - Ioannidis, Yannis E., and Stavros Christodoulakis.
（https://dl.acm.org/doi/pdf/10.1145/169725.169708）
Universality of Serial Histograms (1993) - Ioannidis, Yannis E.
（https://vldb.org/conf/1993/P256.PDF）
Balancing Histogram Optimality and Practicality for Query Result Size Estimation (1995) - Ioannidis, Yannis E., and Viswanath Poosala.
（https://dl.acm.org/doi/pdf/10.1145/568271.223841）
Improved Histograms for Selectivity Estimation of Range Predicates (1996) - Poosala, Viswanath, et al.
（https://dl.acm.org/doi/pdf/10.1145/235968.233342）
The History of Histograms (2003) - Ioannidis, Yannis.
（http://www.vldb.org/conf/2003/papers/S02P01.pdf）
Automated Statistics Collection in DB2 UDB (2004) - Aboulnaga, Ashraf, et al.
（http://www.vldb.org/conf/2004/IND5P3.PDF）
Adaptive Query Processing in the Looking Glass (2005) - Babu, Shivnath, and Pedro Bizarro.
（https://eden.dei.uc.pt/~bizarro/papers/cidr2005_aqp.pdf）
Optimizer plan change management: improved stability and performance in Oracle 11g (2008) - Ziauddin, Mohamed, et al.
（https://dl.acm.org/doi/pdf/10.14778/1454159.1454175）
Histograms Reloaded: The Merits of Bucket Diversity (2010) - Kanne, Carl-Christian, and Guido Moerkotte.
（https://dl.acm.org/doi/pdf/10.1145/1807167.1807239）
Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches (2011) - Cormode, Graham, et al.
（https://www.nowpublishers.com/article/DownloadSummary/DBS-004）
Exploiting Ordered Dictionaries to Efficiently Construct Histograms with Q-Error Guarantees in SAP HANA (2014) - Moerkotte, Guido, et al.Adaptive Statistics in Oracle 12c (2017) - Chakkappen, Sunil, et al.
（https://dl.acm.org/doi/pdf/10.1145/2588555.2595629）
Adaptive Statistics in Oracle 12c (2017) - Chakkappen, Sunil, et al.
（https://dl.acm.org/doi/pdf/10.14778/3137765.3137785）

3.8 Probabilistic Counting

Towards Estimation Error Guarantees for Distinct Values (2000) - Charikar, Moses, et al.
（https://dl.acm.org/doi/pdf/10.1145/335168.335230）
Distinct Sampling for Highly-Accurate Answers to Distinct Values Queries and Event Reports (2001) - Gibbons, Phillip B.
（http://www.vldb.org/conf/2001/P541.pdf）
LEO – DB2’s LEarning Optimizer (2001) - Stillger, Michael, et al.
（http://www.vldb.org/conf/2001/P019.pdf）
An Improved Data Stream Summary: The Count-Min Sketch and its Applications, Journal of Algorithms (2005) - Cormode, Graham, and Shan Muthukrishnan.
（http://twiki.di.uniroma1.it/pub/Ing_algo/WebHome/p14_Cormode_JAl_05.pdf）
New Estimation Algorithms for Streaming Data: Count-min Can Do More (2007) - Deng, Fan, and Davood Rafiei.
（https://www.academia.edu/download/31052190/cmm.pdf）
Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors (2009) - Moerkotte, Guido, Thomas Neumann, and Gabriele Steidl.
（https://dl.acm.org/doi/pdf/10.14778/1687627.1687738）
Pessimistic Cardinality Estimation: Tighter Upper Bounds for Intermediate Join Cardinalities (2019) - Cai, Walter, Magdalena Balazinska, and Dan Suciu.
（https://dl.acm.org/doi/pdf/10.1145/3299869.3319894）
Deep Unsupervised Cardinality Estimation (2019) - Yang, Zongheng, et al.
（https://arxiv.org/pdf/1905.04278）
NeuroCard: One Cardinality Estimator for All Tables (2020) - Yang, Zongheng, et al.
（https://arxiv.org/pdf/2006.08109）

3.9 Execution Engine

QueryEvaluationTechniquesfor LargeDatabas (1993) - Graefe G.
（https://dl.acm.org/doi/pdf/10.1145/152610.152611）
Volcano - An Extensible and Parallel Query Evaluation System (1994) - Graefe, Goetz.
（https://15721.courses.cs.cmu.edu/spring2016/papers/graefe-ieee1994.pdf）
MonetDB/X100: Hyper-Pipelining Query Execution (2005) - Boncz, Peter A., Marcin Zukowski, and Niels Nes.
（https://www.researchgate.net/profile/Niels-Nes/publication/45338800_MonetDBX100_Hyper-Pipelining_Query_Execution/links/0deec520cd1e8a3607000000/MonetDB-X100-Hyper-Pipelining-Query-Execution.pdf）
Efficiently Compiling Efficient Query Plans for Modern Hardware (2011) - Neumann, Thomas.
（https://dl.acm.org/doi/pdf/10.14778/2002938.2002940）
Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited (2013) - Balkesen, Cagri, et al.
（https://dl.acm.org/doi/pdf/10.14778/2732219.2732227）
Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age (2014) - Leis, Viktor, et al.
（https://dl.acm.org/doi/pdf/10.1145/2588555.2610507）
Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last (2017) - Menon, Prashanth, Todd C. Mowry, and Andrew Pavlo.
（https://dl.acm.org/doi/pdf/10.14778/3151113.3151114）
Looking Ahead Makes Query Plans Robust (2017) - Zhu, Jianqiao, et al.
（https://dl.acm.org/doi/pdf/10.14778/3090163.3090167）
Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask (2018) - Kersten, Timo, et al.
（https://dl.acm.org/doi/pdf/10.14778/3275366.3284966）
SuRF: Practical Range Query Filtering with Fast Succinct Tries (2018) - Zhang, Huanchen, et al.
（https://dl.acm.org/doi/pdf/10.1145/3183713.3196931）
Adaptive Execution of Compiled Queries (2018) - Kohn, André, Viktor Leis, and Thomas Neumann.
（https://15721.courses.cs.cmu.edu/spring2019/papers/19-compilation/kohn-icde2018.pdff）

3.10 MPP Optimizations

DB2 Parallel Edition (1995) - Baru, Chaitanya K., et al.
（https://grape.ics.uci.edu/wiki/asterix/raw-attachment/wiki/cs295-2009-fall/ParallelDB2.pdf）
Parallel SQL execution in Oracle 10g (2004) - Cruanes, Thierry, Benoit Dageville, and Bhaskar Ghosh.
（https://dl.acm.org/doi/pdf/10.1145/1007568.1007666）
Query Optimization in Microsoft SQL Server PDW (2012) - Shankar, Srinath, et al.
（https://dl.acm.org/doi/pdf/10.1145/2213836.2213953）
Adaptive and big data scale parallel execution in Oracle (2013) - Bellamkonda, Srikanth, et al.
（https://dl.acm.org/doi/pdf/10.14778/2536222.2536235）
Optimizing Queries over Partitioned Tables in MPP Systems (2014) - Antova, Lyublena, et al.
（https://dl.acm.org/doi/pdf/10.1145/2588555.2595640）

04

Storage Engine

4.1 Storage Structure

The Ubiquitous B-Tree (1979) - Comer, Douglas.
（https://dl.acm.org/doi/pdf/10.1145/356770.356776）
The 5 Minute Rule for Trading Memory for Disc Accesses and the 5 Byte Rule for Trading Memory for CPU Time (1987) - Gray, Jim, and Franco Putzolu.
（https://dl.acm.org/doi/pdf/10.1145/38713.38755）
The Log-Structured Merge-Tree (LSM-Tree) (1996) - O’Neil, Patrick, et al.
（https://www.inf.ufpr.br/eduardo/ensino/ci763/papers/lsmtree.pdf）
The five-minute rule ten years later, and other computer storage rules of thumb (1997) - Gray, Jim, and Goetz Graefe.
（https://dl.acm.org/doi/pdf/10.1145/271074.271094）
The Five Minute Rule 20 Years Later and How Flash Memory Changes the Rules (2008) - Graefe, Goetz.
（https://dl.acm.org/doi/pdf/10.1145/1363189.1363198）
A Comparison of Fractal Trees to Log-Structured Merge (LSM) Trees (2014) - Kuszmaul, Bradley C.
（http://www.pandademo.com/wp-content/uploads/2017/12/A-Comparison-of-Fractal-Trees-to-Log-Structured-Merge-LSM-Trees.pdf）
Design Tradeoffs of Data Access Methods (2016) - Athanassoulis, Manos, and Stratos Idreos.
（https://dl.acm.org/doi/pdf/10.1145/2882903.2912569）
Designing Access Methods: The RUM Conjecture (2016) - Athanassoulis, Manos, et al.
（https://stratos.seas.harvard.edu/sites/scholar.harvard.edu/files/stratos/files/rum.pdf）
The five minute rule thirty years later and its impact on the storage hierarchy (2017) - Appuswamy, Raja, et al.
（https://infoscience.epfl.ch/record/230398/files/adms-talk.pdf）
WiscKey: Separating Keys from Values in SSD-conscious Storage (2017) - Lu, Lanyue, et al.
（https://dl.acm.org/doi/pdf/10.1145/3033273）
Managing Non-Volatile Memory in Database Systems (2018) - van Renen, Alexander, et al.
（https://dl.acm.org/doi/pdf/10.1145/3183713.3196897）
LeanStore: In-Memory Data Management Beyond Main Memory (2018) - Leis, Viktor, et al.
（https://15721.courses.cs.cmu.edu/spring2020/papers/23-largethanmemory/leis-icde2018.pdf）
The Case for Learned Index Structures (2018) - Kraska, Tim, et al.
（https://dl.acm.org/doi/pdf/10.1145/3183713.3196909）
LSM-based Storage Techniques: A Survey (2019) - Luo, Chen, and Michael J. Carey.
（https://arxiv.org/pdf/1812.07527）
Learning Multi-dimensional Indexes (2019) - Nathan, Vikram, et al.
（https://dl.acm.org/doi/pdf/10.1145/3318464.3380579）
Umbra: A Disk-Based System with In-Memory Performance (2020) - Neumann, Thomas, and Michael J. Freitag.
（https://db.in.tum.de/~freitag/papers/p29-neumann-cidr20.pdf）
XIndex: A Scalable Learned Index for Multicore Data Storage (2020) - Tang, Chuzhe, et al.
（https://dl.acm.org/doi/pdf/10.1145/3332466.3374547）
The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds (2020) - Ferragina, Paolo, and Giorgio Vinciguerra.
（https://dl.acm.org/doi/pdf/10.14778/3389133.3389135）
From WiscKey to Bourbon: A Learned Index for Log-Structured Merge Trees (2020) - Dai, Yifan, et al.
（https://www.usenix.org/system/files/osdi20-dai_0.pdf）
CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure (2024) - Yu, Qiaolin et al.
（https://qiaolin-yu.github.io/pubs/V2mod124-yu.pdf）

4.2 Transaction

The Notions of Consistency and Predicate Locks in a Database System (1976) - Eswaran, Kapali P., et al.
（https://dl.acm.org/doi/pdf/10.1145/360363.360369）
Concurrency Control in Distributed Database Systems (1981) - Bernstein, Philip A., and Nathan Goodman.
（https://dl.acm.org/doi/pdf/10.1145/356842.356846）
On Optimistic Methods for Concurrency Control (1981) - Kung, Hsiang-Tsung, and John T. Robinson.
（https://dl.acm.org/doi/pdf/10.1145/319566.319567）
Principles of transaction-oriented database recovery (1983) - Haerder, Theo, and Andreas Reuter.
（https://dl.acm.org/doi/10.1145/289.291）
Multiversion Concurrency Control - Theory and Algorithms (1983) - Bernstein, Philip A., and Nathan Goodman.
（https://dl.acm.org/doi/pdf/10.1145/319996.319998）
ARIES: A transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging (1992) - Mohan C, Haderle D, Lindsay B, et al.
（https://dl.acm.org/doi/pdf/10.1145/128765.128770）
A Critique of ANSI SQL Isolation Levels (1995) - Berenson, Hal, et al.
（https://dl.acm.org/doi/pdf/10.1145/568271.223785）
Generalized Isolation Level Definitions (2000) - Adya, Atul, Barbara Liskov, and Patrick O'Neil.
（https://pmg.csail.mit.edu/papers/icde00.pdf）
Serializable Snapshot Isolation in PostgreSQL (2012) - Ports, Dan RK, and Kevin Grittner.
（https://arxiv.org/pdf/1208.4179.pdf,）
Calvin: Fast Distributed Transactions for Partitioned Database Systems (2012) - Thomson, Alexander, et al.
（https://dl.acm.org/doi/pdf/10.1145/2213836.2213838）
MaaT: effective and scalable coordination of distributed transactions in the cloud (2014) - Mahmoud, Hatem A., et al.
（https://dl.acm.org/doi/pdf/10.14778/2732269.2732270）
Staring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores (2014) - Yu, Xiangyao, et al.
（https://dspace.mit.edu/bitstream/handle/1721.1/100022/Devadas_Staring%20into.pdf?sequence=1&isAllowed=y）
An Evaluation of the Advantages and Disadvantages of Deterministic Database Systems (2014) - Ren, Kun, Alexander Thomson, and Daniel J. Abadi.
（https://dl.acm.org/doi/pdf/10.14778/2732951.2732955）
Fast Serializable Multi-Version Concurrency Control for Main-Memory Database Systems (2015) - Neumann, Thomas, Tobias Mühlbauer, and Alfons Kemper.
（https://dl.acm.org/doi/pdf/10.1145/2723372.2749436）
An Empirical Evaluation of In-Memory Multi-Version Concurrency Control (2017) - Wu, Yingjun, et al.
（https://dl.acm.org/doi/pdf/10.14778/3067421.3067427）
An Evaluation of Distributed Concurrency Control (2017) - Harding, Rachael, et al.
（https://dl.acm.org/doi/pdf/10.14778/3055540.3055548）
Scalable Garbage Collection for In-Memory MVCC Systems (2019) - Böttcher, Jan, et al.
（https://dl.acm.org/doi/pdf/10.14778/3364324.3364328）

4.3 Scheduling

Automated Demand-driven Resource Scaling in Relational Database-as-a-Service (2016) - Das, Sudipto, et al.
（https://dl.acm.org/doi/pdf/10.1145/2882903.2903733）
Autoscaling Tiered Cloud Storage in Anna (2019) - Wu, Chenggang, Vikram Sreekanti, and Joseph M. Hellerstein.
（https://dl.acm.org/doi/pdf/10.14778/3311880.3311881）
Adaptive HTAP through Elastic Resource Scheduling (2020) - Raza, Aunn, et al.
（https://dl.acm.org/doi/pdf/10.1145/3318464.3389783）
MorphoSys: Automatic Physical Design Metamorphosis for Distributed Database Systems (2020) - Abebe, Michael, Brad Glasbergen, and Khuzaima Daudjee.
（https://dl.acm.org/doi/pdf/10.14778/3424573.3424578）

05

Miscellaneous

5.1 Workload

TPC-H Analyzed: Hidden Messages and Lessons Learned from an Influential Benchmark (2013) - Boncz, Peter, Thomas Neumann, and Orri Erling.
（https://www.researchgate.net/profile/Peter-Boncz/publication/291257517_TPC-H_Analyzed_Hidden_Messages_and_Lessons_Learned_from_an_Influential_Benchmark/links/5852dbf708ae95fd8e1d749b/TPC-H-Analyzed-Hidden-Messages-and-Lessons-Learned-from-an-Influential-Benchmark.pdff）
Quantifying TPCH Choke Points and Their Optimizations (2020) - Dreseler, Markus, et al.
（https://dl.acm.org/doi/pdf/10.14778/3389133.3389138）

5.2 Network

The End of Slow Networks: It's Time for a Redesign (2015) - Binnig, Carsten, et al.
（https://arxiv.org/pdf/1504.01048）
Accelerating Relational Databases by Leveraging Remote Memory and RDMA (2016) - Li, Feng, et al.
（https://dl.acm.org/doi/pdf/10.1145/2882903.2882949）
Don't Hold My Data Hostage: A Case for Client Protocol Redesign (2017) - Raasveldt, Mark, and Hannes Mühleisen.
（https://dl.acm.org/doi/pdf/10.14778/3115404.3115408）

5.3 Quality

Testing the Accuracy of Query Optimizers (2012) - Gu, Zhongxian, Mohamed A. Soliman, and Florian M.
（https://dl.acm.org/doi/pdf/10.1145/2304510.2304525）

5.4 Diagnosis and Tuning

Automatic SQL Tuning in Oracle 10g (2004) - Dageville B, Das D, Dias K, et al.
（http://www.vldb.org/conf/2004/IND4P2.PDF）
Automatic Performance Diagnosis and Tuning in Oracle (2005) - Dias K, Ramacher M, Shaft U, et al.
（https://www.cidrdb.org/cidr2005/papers/P07.pdf）

彩蛋时刻

为了致敬中国数据库从业者一起走过的半个世纪，腾讯云 TVP《技术指针》与《明说三人行》策划了【中国数据库前世今生】系列记录片。此部纪录片共分为五期，时间跨度从上世纪八十年代至本世纪二十年代，涵盖五个十年。从 80 年代到 20 年代，每期将深入探讨该时代下的数据库演变历程，以及这些大趋势下鲜为人知的小故事。以下为 90 年代纪录片正片。

作者团队介绍

TDSQL 目前已经广泛用于国内金融核心场景，除了平常团队沉淀的必读论文清单，内部还有很多技术培训，欢迎对数据库有兴趣的技术大拿加入团队，和 TDSQL 一起成长，团队目前在招 2025 届实习生，想要提前锁定秋招的同学不可错过。

-End-

原创作者｜龙恒

你还有哪些适合数据库工程师学习的资料？欢迎评论分享。我们将选取1则评论，送出腾讯云开发者定制眼罩1个（见下图）。7月11日中午12点开奖。

📢📢欢迎加入腾讯云开发者社群，享前沿资讯、大咖干货，找兴趣搭子，交同城好友，更有鹅厂招聘机会、限量周边好礼等你来~

（长按图片立即扫码）

腾讯云开发者

关注

19
点赞
踩
17

收藏

觉得还不错? 一键收藏
1
评论
数据库内核工程师必读论文清单

????目录1Basics2System Design3SQL Engine4Storage Engine5Miscellaneous论文列表基本涵盖了数据库系统的各个方面，包括必要的理论背景、经典的系统设计以及数据库内的多个模块。分为不同的类别和子类别，以便于导航。每篇论文都伴有标题、作者、出版年份，以及在可能的情况下提供全文链接。01Basics1.1 EssentialsA rel...
复制链接

扫一扫