Database
文章平均质量分 71
PerpetualLearner
这个作者很懒,什么都没留下…
展开
-
理解分区策略及相关概念in DolphinDB
Overview分区是对数据库进行深入了解的关键入口。ddb是为OLAP设计的系统,主要是解决:海量结构化数据的快速存储和计算;通过内存数据库和流数据计算引擎实现高性能数据处理ddb不适合数据频繁更改的OLTP;什么是好的分区策略一个好的分区策略通过只读取查询所需的相关数据来减少要扫描的数据量。怎么叫所谓“不好”如果分区机制设计不合理,对数据库的查询、计算以及其它操作都可能受到“磁盘访问I/O”这个瓶颈的限制。磁盘访问I/O理解磁盘访问I/ODDB的架构..原创 2021-05-05 13:39:23 · 1386 阅读 · 0 评论 -
理解MPP(Massively Parallel Processing) in database
OverviewWhile storage and computing power have come long a way in the last several decades, the unfortunate reality is that they haven’t kept up with modern data storage and analysis needs.MPP databases solve this problem by allotting the required proc..原创 2021-05-05 13:38:13 · 1526 阅读 · 3 评论 -
理解磁盘访问I/O性能||IO Workload Profiles
Overview关于数据库的性能,对于column-oriented database,很多时候性能取决于计算机硬件的磁盘访问I/O性能。一、Workload ProfilesWorkload ProfilesIn the most generic sense, a workload profile describes the behavior of an application, or portion of an application with respect to how it p..原创 2021-05-05 13:37:12 · 1388 阅读 · 0 评论 -
理解iostat in Linux
iostatThe iostat is a part of the sysstat package, which is really just a file that is read by a certain set of tools. So to install iostat, issue the command:sudo apt install sysstat返回参数详解。iostat command generally generates two reports:CPU utiliz..原创 2021-05-05 13:36:11 · 983 阅读 · 0 评论 -
理解lexeme, syntax, semantic in Compiler
LexemeA lexeme is a unit of lexical meaning that underlies a set of words that are related through inflection.It is a basic abstract unit of meaning, a unit of morphological analysis in linguistics that roughly corresponds to a set of forms taken by a ..原创 2021-04-24 14:26:21 · 1491 阅读 · 0 评论 -
理解three-address code||Register allocation
OverviewFrom dragon book, three-address code consists of a sequence of asembly-like instructions with three operands per instruction.Each operand can act like a register.Three-address codeThree-address code (TAC, 3AC) is an intermedia code used by ..原创 2021-04-23 21:00:27 · 456 阅读 · 0 评论 -
《Compilers: Principles, Techniques, & Tools》读书笔记
CompilerProgramming languages are notations for describing computations to people and to machines.Before a program can be run, it first must be translated into a form in which it can be executed by a computer.The software systems that do this translat..原创 2021-04-23 20:50:42 · 762 阅读 · 0 评论 -
理解流表对偶性duality in database
OverviewFrom [1], DolphinDB天然具备流表对偶性,支持使用SQL语句进行数据注入和查询分析。Duality in MathematicsIn mathematics, a duality translates concepts, theorems or mathematical structures into other concepts, theorems or structures, in a one-to-one fashion, often (but not a..原创 2021-04-23 20:47:26 · 269 阅读 · 0 评论 -
理解auto-tuning in database
OverviewA variety of ongoing industrial research efforts attempt to improve the ablility of a DBMS to make tuning decisions.Database tuningDatabase tuning describes a group of activities used to optimize and homogenize the performance of a database...原创 2021-04-23 20:45:46 · 242 阅读 · 0 评论 -
《Database Internals: A Deep-Dive into How Distributed Data System Work》读书笔记
OverviewTerminology can sometimes be ambiguous and hard to understand without a complete context.Distinction among the DBMS in terms of :a storage medium:MemoryIn-memory DBMS (main memory DBMS) store data primarily in memory and use the disk for..原创 2021-04-12 11:28:53 · 701 阅读 · 0 评论 -
理解fanout in database
OverviewFanout is the maximum allowed number of children per node.Fan-outIn digital electronics, the fan-out is the number of gate inputs driven by the output of another single logic gate.The maximum fan-out of an output measures its load-driving c..原创 2021-04-12 11:26:41 · 635 阅读 · 0 评论 -
《The Design and Implementation of Modern Column-Oriented Database System》读书笔记
OverviewDatabase system performance is directly related to the efficiency of the system at storing data on primary storage (e.g., disk) and moving it into CPU registers for processing.Data transfer costs from storage are often the major performance bot..原创 2021-04-12 11:20:15 · 910 阅读 · 0 评论 -
理解Difference Disk VS. MainMemory & FTL
SectorThe smallest transfer unit of a spinning drive is a sector, so when some operation is performed, at least an entire sector can be read or written. Sector size typically range from 512 bytes to 4 Kb.FTLThe part of a flash memory controller resp..原创 2021-04-12 11:19:12 · 214 阅读 · 0 评论 -
理解VectorWise about column-oriented database
OverviewMany problems of MonetDB were addressed by a new system, developed in the same research group at CWI, called VectorWise.The main innocatio in VectorWise is its vectorized execution model which strikes a balance between full materialization of i..原创 2021-04-12 11:17:31 · 287 阅读 · 0 评论 -
理解MonetDB about column-oriented database
OverviewMonetDB is designed from scratch focusing on handling analytical workloads efficiently on modern hardware.Column-at-a-timeMonetDB stores data one column-at-a-time both in memory and on disk and exploits bulk processing and late materializati..原创 2021-04-12 11:16:32 · 278 阅读 · 1 评论 -
理解C-Store about column-oriented database
OverviewIn C-Store, the primary representation of data on disk is as a set of column files which is called “read optimized store (ROS)”.Each column-file contains data from one column, compressed using a column-specific compression mothod, and sorted ac..原创 2021-03-31 18:15:40 · 404 阅读 · 1 评论 -
理解projectivity in database
OverviewFrom [1], projectivity is percentage of a tuple that is read.ProjectivityFrom collins, it means the capacity for projection.projection:countable noun: a projection is an estimate of a future amountuncountable noun: The projection of a fi..原创 2021-03-31 18:13:40 · 225 阅读 · 0 评论 -
理解tuple in database
Overview关于database的文献汇中经常会提到tuple这个词。TupleIn the context of relational database, a tuple is one record (one row).The information in a database can be thought of as a spreadsheet, with columns (known as fields or attributes) representing different c..原创 2021-03-30 19:29:17 · 669 阅读 · 0 评论 -
理解transposed file in database system
Transponsed fileA transposed file is a collection of nonsequential files called subfiles.Each subfile contains selected attribute data for all records.It is shown that transposed file performance can be enhanced by using a proper strategy to process q..原创 2021-03-30 19:28:34 · 202 阅读 · 0 评论 -
理解semi-join in database
Overviewsemi-join是relational algebra的一种具体形式Relational AlgebraIn database theory, relational algebra is a theory that uses algebraic structures with a well-founded semantics for modeling data, and defining queries on it.The theory has been introduce..原创 2021-03-30 19:28:00 · 273 阅读 · 0 评论 -
理解Engine in Database
OverviewClickhouse,DolphinDB都对引擎做了专门介绍。那什么是引擎,引擎的作用原理又是什么?From Dr. Richard Hipp, the creator of SQLite, SQL is a peculiar programming language rather a query language, each SQL statement is a program, and SQL descibes what instead of how.An sql datab..原创 2021-03-30 19:25:29 · 318 阅读 · 0 评论 -
理解database cracking
Overview哈,完全不知道这个概念。database crackingMonetDB was one of the first database to introduce Database Cracking.Database Cracking is an incremental partial indexing and/or sorting of the data. It directly exploits the columnar nature of MonetDB.Cracking..原创 2021-03-30 19:24:57 · 398 阅读 · 0 评论 -
理解range-predicate&pivoted partitioning in Database
OverviewFrom [1], Predication estimation is used increasingly in the Rdb optimizer to determine the cost and productivity of various index scans.When a particular query is executed, the conditions in the row selection expression, the “where” clause of ..原创 2021-03-30 19:24:19 · 293 阅读 · 0 评论 -
理解amortize in database
Amortized analysisAmortized analysis is a method for analysing a given algorithm’s complexity, or how much a resource, especially time or memory, it takes to execute.The motivation for amortized analysis is that looking at the worst-case run time per o..原创 2021-03-30 19:22:36 · 197 阅读 · 0 评论 -
理解code specialization
OverviewCode specialization is a well-known technique used to produce more efficient code from a generic one.It works by substituting a formal input value by an effective value, and can be done either staticallyu or dynamically.Static specialization..原创 2021-03-30 19:21:58 · 453 阅读 · 0 评论