Dm8+jpa整合liquibase框架

最新推荐文章于 2022-10-17 16:46:58 发布
最新推荐文章于 2022-10-17 16:46:58 发布
阅读量1.4k 收藏 1
点赞数
分类专栏： 达梦数据库 文章标签： DM8 liquibase JPA
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_35349982/article/details/124316454
版权

一、liquibase是什么

LiquiBase是一个用于数据库重构和迁移的开源工具，通过日志文件的形式记录数据库的变更，然后执行日志文件中的修改，将数据库更新或回滚到一致的状态。它的目标是提供一种数据库类型无关的解决方案，通过执行schema类型的文件来达到迁移。
其有点主要有以下：

  • 支持几乎所有主流的数据库，如MySQL, PostgreSQL, Oracle, Sql Server, DB2等；
  • 支持多开发者的协作维护；
  • 日志文件支持多种格式，如XML, YAML, JSON, SQL等；
  • 支持多种运行方式，如命令行、Spring集成、Maven插件、Gradle插件等。

liquibase 官方文档地址：hhttps://www.liquibase.org/
liquibase 源码下载地址：https://github.com/liquibase/liquibase

版本说明

本次测试使用时DM8版本+liquibase的3.8.10版本。

二、整合liquibase报：dm.jdbc.driver.DMException: 数据类型不匹配

这是因为：整合liquibase会初始化两张表，因为框架不支持所以生成的sql不对，从而导致报错。
在这里插入图片描述

三、调整liquibase的源码

下载liquibase源码：https://gitee.com/mirrors_addons/liquibase/tree/v3.8.9/或者去https://github.com/liquibase/liquibase下载

核心思路

继承OracleDatabase实现类复写端口跟驱动包名的部分，以及mustQuoteObjectName方法，加入关键字过滤。（不采用网上的继承AbstractJdbcDatabase类模仿Oracle类的方法去写，因为代码的其他部分有很多对oracle的判断，多达三十多处左右）

1. 新建DM8Database

新建DM8Database类并集成OracleDatabase，并重写以下方法。

package liquibase.database.core;

import liquibase.CatalogAndSchema;
import liquibase.Scope;
import liquibase.database.AbstractJdbcDatabase;
import liquibase.database.DatabaseConnection;
import liquibase.database.OfflineConnection;
import liquibase.database.jvm.JdbcConnection;
import liquibase.exception.DatabaseException;
import liquibase.exception.UnexpectedLiquibaseException;
import liquibase.exception.ValidationErrors;
import liquibase.executor.ExecutorService;
import liquibase.logging.LogService;
import liquibase.logging.LogType;
import liquibase.statement.DatabaseFunction;
import liquibase.statement.SequenceCurrentValueFunction;
import liquibase.statement.SequenceNextValueFunction;
import liquibase.statement.core.RawCallStatement;
import liquibase.statement.core.RawSqlStatement;
import liquibase.structure.DatabaseObject;
import liquibase.structure.core.Catalog;
import liquibase.structure.core.Index;
import liquibase.structure.core.PrimaryKey;
import liquibase.structure.core.Schema;
import liquibase.util.JdbcUtils;
import liquibase.util.StringUtils;

import java.lang.reflect.Method;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.sql.Statement;
import java.util.*;
import java.util.regex.Matcher;
import java.util.regex.Pattern;

import static java.util.ResourceBundle.getBundle;


public class DM8Database extends OracleDatabase {
    private static final String PRODUCT_NAME = "DM DBMS";
    private static final String PRODUCT_SHORT_NAME = "DM DBMS";
    private static final String DRIVER_CONN_PERFIX = "jdbc:dm";
    private static final String DRIVER_STRING = "dm.jdbc.driver.DmDriver";
    private static final List QUOTE_KEYWORDS = Arrays.asList("ABORT", "ABSTRACT", "ACCESSED", "ACCOUNT", "ACROSS", "ACTION", "AFTER", "AGGREGATE", "ALLOW_DATETIME", "ALLOW_IP", "ANALYZE", "ARCHIVE", "ARCHIVEDIR", "ARCHIVELOG", "ARCHIVESTYLE", "ARRAYLEN", "ASENSITIVE", "ASYNCHRONOUS", "AT", "ATTACH", "AUTO", "AUTOEXTEND", "AUTONOMOUS_TRANSACTION", "AVG", "BACKED", "BACKUP", "BACKUPDIR", "BACKUPINFO", "BACKSET", "BADFILE", "BAKFILE", "BASE", "BEFORE", "BEGIN", "BIGINT", "BINARY", "BIT", "BITMAP", "BLOB", "BLOCK", "BOOLEAN", "BRANCH", "BTREE", "BUFFER ", "BUILD ", "BULK", "CACHE", "CALCULATE", "CASCADE", "CASCADED", "CATALOG", "CHAIN", "CHARACTER", "CHARACTERISTICS", "CIPHER", "CLOB", "CLOSE", "COLLATE", "COLLECT", "COLUMNS", "COMMITTED", "COMPILE", "COMPLETE", "COMPRESS", "COMPRESSED", "CONNECT_BY_IS_CYCLE", "CONNECT_BY_ISLEAF", "CONNECT_IDLE_TIME", "CONNECT_TIME", "CONSTANT", "CONSTRAINTS", "CONSTRUCTOR", "CONTEXT", "COPY", "CORRESPONDING", "COUNT", "COUNTER", "CPU_PER_CALL", "CPU_PER_SESSION", "CTLFILE", "CUMULATIVE", "CURRENT_SCHEMA", "CURRENT_USER", "CYCLE", "DANGLING", "DATA", "DATABASE", "DATAFILE", "DATE", "DATETIME", "DAY", "DBFILE", "DDL", "DDL_CLONE", "DEBUG", "DEC", "DEFERRABLE", "DEFERRED", "DEFINER", "DELETING", "DELIMITED", "DELTA", "DEMAND", "DENSE_RANK", "DEREF", "DETACH", "DETERMINISTIC", "DEVICE", "DIAGNOSTICS", "DICTIONARY", "DISCONNECT", "DOWN", "DUMP", "EACH", "ENCRYPT", "ENCRYPTION", " ERROR", "ERRORS", "ESCAPE", "EVENTINFO", "EVENTS", "EXCEPTION", "EXCEPTIONS", "EXCEPTION_INIT", "EXCLUDE", "EXCLUDING", "EXCLUSIVE", "EXTENDS", "EXTERNAL", "EXTERNALLY", "FAILED_LOGIN_ATTEMPS", "FAST", "FIELDS", "FILE", "FILEGROUP", "FILESIZE", "FILLFACTOR", "FINAL", "FOLLOWING", "FORALL", "FORCE", "FREQUENCE", "GLOBAL", "GLOBALLY", "HASH", "HEXTORAW", "HOLD", "HOUR", "HUGE", "IDENTIFIED", "IDENTITY_INSERT", "IMAGE", "IN", "INCLUDE", "INCLUDING", "INCREASE", "INCREMENT", "INDEXES", "INDICES", "INITIAL", "INITIALIZED", "INITIALLY", "INNERID", "INPUT", "INSENSITIVE", "INSERTING", "INSTANTIABLE", "INSTEAD", "INTEGER", "INTENT", "INVISIBLE", "ISOLATION", "JOB", "KEY", "LABEL", "LARGE", "LAST", "LESS", "LEVEL", "LEXER", "LIMIT", "LOB", "LOCAL", "LOCALLY", "LOCK", "LOCKED", "LOG", "LOGFILE", "LOGGING", "LOGIC", "LOGOFF", "LOGON", "LOGOUT", "LONG", "LONGVARBINARY", "LONGVARCHAR", "LSN", "MANUAL", "MAP", "MAPPED", "MATCH", "MATCHED", "MATERIALIZED", "MAX", "MAXPIECESIZE", "MAXSIZE", "MAXVALUE", "MEMORY", "MEM_SPACE", "MERGE", "MIN", "MINEXTENTS", "MINUTE", "MINVALUE", "MIRROR", "MOD", "MODE", "MODIFY", "MONEY", "MONITORING", "MONTH", "MOUNT", "MOVEMENT", "NATIONAL", "NCHAR", "NCHARACTER", "NEVER", "NO", "NOARCHIVELOG", "NOAUDIT", "NOBRANCH", "NOCACHE", "NOLOGGING", "NOMAXVALUE", "NOMINVALUE", "NOMONITORING", "NONE", "NOORDER", "NORMAL", "NOSORT", "NOT_ALLOW_DATETIME", "NOT_ALLOW_IP", "NOWAIT", "NULLS", "NUMBER", "NUMERIC", "OFF", "OFFLINE", "OFFSET", "OLD", "ONCE", "ONLINE", "ONLY", "OPEN", "OPTIMIZE", "OPTION", "OUTER", "OVERLAPS", "OVERRIDING", "PACKAGE", "PAD", "PAGE", "PARALLEL", "PARALLEL_ENABLE", "PARMS", "PARTIAL", "PARTITIONS", "PASSING", "PASSWORD_GRACE_TIME", "PASSWORD_LIFE_TIME", "PASSWORD_LOCK_TIME", "PASSWORD_POLICY", "PASSWORD_REUSE_MAX", "PASSWORD_REUSE_TIME", "PATH", "PIPE", "PIPELINED", "PIVOT", "PLACING", "PLS_INTEGER", "PRAGMA", "PRECEDING", "PRECISION", "PRESERVE", "PRIVILEGE", "PURGE", "QUERY_REWRITE_INTEGRITY", "RANGE", "RAWTOHEX", "READ", "READONLY", "READ_PER_CALL", "READ_PER_SESSION", "REAL", "REBUILD", "RECORD", "RECORDS", "REFRESH", "RELATED", "RENAME", "REPEATABLE", "REPLACE", "REPLAY", "RESIZE", "RESTORE", "RESTRICT", "RESULT", "RESULT_CACHE", "ROLE", "ROLLFILE", "ROOT", "ROWCOUNT", "ROWID", "RULE", "SALT", "SAMPLE", "SAVE", "SCOPE", "SCROLL", "SECOND", "SEED", "SELF", "SENSITIVE", "SEQUENCE", "SERERR", "SERIALIZABLE", "SERVER", "SESSION", "SESSION_PER_USER", "SHARE", "SHUTDOWN", "SIBLINGS", "SIMPLE", "SINCE", "SIZE", "SKIP", "SMALLINT", "SNAPSHOT", "SOUND", "SPACE", "SPATIAL", "SPFILE", "SPLIT", "SQL", "STANDBY", "STARTUP", "STAT", "STATEMENT", "STORAGE", "STORE", "STRING", "STYLE", "SUBPARTITION", "SUBPARTITIONS", "SUBSTRING", "SUBTYPE", "SUCCESSFUL", "SUM", "SUSPEND", "SYNC", "SYNCHRONOUS", "SYSTEM ", "SYS_CONNECT_BY_PATH", "TABLESPACE", "TASK", "TEMPLATE", "TEMPORARY", "TEXT", "THAN", "THEN", "THREAD", "TIES", "TIME", "TIMER", "TIMES", "TIMESTAMP", "TIME_ZONE", "TINYINT", "TRACE ", "TRANSACTION", "TRANSACTIONAL", "TRIGGERS", "TRUNCSIZE", "TRXID", "TYPE", "UNBOUNDED", "UNCOMMITTED", "UNDER", "UNLIMITED", "UNLOCK ", "UNPIVOT", "UNUSABLE ", "UP", "UPDATING", " USE_HASH ", "USE_MERGE ", "USE_NL ", "USE_NL_WITH_INDEX ", "VALUE", "VARBINARY", "VARCHAR", "VARCHAR2", "VARIANCE", "VARYING", "VERSIONS", "VERSIONS_STARTTIME", "VERSIONS_ENDTIME", "VERSIONS_STARTTRXID", "VERSIONS_ENDTRXID", "VERSIONS_OPERATION", "VERTICAL", "VISIBLE ", "VSIZE", "WAIT", "WEEK", "WITHOUT", "WORK", "WRAPPED", "WRITE", "XML", "XMLTABLE", "YEAR", "ZONE");
    private Integer databaseMajorVersion;
    private Integer databaseMinorVersion;
    
    public DM8Database() {
    }
    
    
    public int getDatabaseMajorVersion() throws DatabaseException {
        return super.getDatabaseMajorVersion();
    }
    public int getDatabaseMinorVersion() throws DatabaseException {
        return super.getDatabaseMinorVersion();
    }
    //加入关键字
    protected boolean mustQuoteObjectName(String objectName, Class<? extends DatabaseObject> objectType) {
        return QUOTE_KEYWORDS.contains(objectName.toUpperCase());
    }
    @Override
    public String getShortName() {
        return PRODUCT_SHORT_NAME;
    }
    
    @Override
    protected String getDefaultDatabaseProductName() {
        return getDatabaseProductName();
    }
    
    @Override
    public boolean isCorrectDatabaseImplementation(DatabaseConnection conn) throws DatabaseException {
        return PRODUCT_NAME.equalsIgnoreCase(conn.getDatabaseProductName());
    }
    
    
    @Override
    public String getDefaultDriver(String url) {
        
        return url.startsWith(DRIVER_CONN_PERFIX) ? DRIVER_STRING : null;
    }
    
    @Override
    public Integer getDefaultPort() {
        return 5236;
    }
    
    
}

在这里插入图片描述

2. 部分雾化试图不兼容重写fastFetchQuery

liquibase.snapshot.ResultSetCache.SingleResultSetExtractor#fastFetchQuery
一定要放到oracle判断之前
在这里插入图片描述

                if (database instanceof DM8Database) {
                        return queryDameng(catalogAndSchema, table);
                    }else if (database instanceof OracleDatabase) {
                        return queryOracle(catalogAndSchema, table);
                    } else if (database instanceof MSSQLDatabase) {
                        return queryMssql(catalogAndSchema, table);
                    } else if (database instanceof Db2zDatabase) {
                        return queryDb2Zos(catalogAndSchema, table);
                    }

3. 部分雾化试图不兼容重写bulkFetchQuery

liquibase.snapshot.ResultSetCache.SingleResultSetExtractor#bulkFetchQuery
instanceof类型比较的原因所以判断一定要放到oracle判断之前。
在这里插入图片描述

                    if(database instanceof DM8Database) {
                        return queryDameng(catalogAndSchema, null);
                    }else if (database instanceof OracleDatabase) {
                        return queryOracle(catalogAndSchema, null);
                    } else if (database instanceof MSSQLDatabase) {
                        return queryMssql(catalogAndSchema, null);
                    } else if (database instanceof Db2zDatabase) {
                        return queryDb2Zos(catalogAndSchema, null);
                    }

4. 新增queryDameng方法

liquibase.snapshot.ResultSetCache.SingleResultSetExtractor#queryDameng

                private List<CachedRow> queryDameng(CatalogAndSchema catalogAndSchema, String viewName) throws DatabaseException, SQLException {
                    String ownerName = CachingDatabaseMetaData.this.database.correctObjectName(catalogAndSchema.getCatalogName(), Schema.class);
                    String sql = "SELECT null as TABLE_CAT, a.OWNER as TABLE_SCHEM, a.VIEW_NAME as TABLE_NAME, 'TABLE' as TABLE_TYPE, c.COMMENTS as REMARKS, TEXT as OBJECT_BODY";
                    if (CachingDatabaseMetaData.this.database.getDatabaseMajorVersion() > 10) {
                        sql = sql + ", EDITIONING_VIEW";
                    }

                    sql = sql + " from ALL_VIEWS a join ALL_TAB_COMMENTS c on a.VIEW_NAME=c.table_name and a.owner=c.owner ";
                    if (viewName == null && JdbcDatabaseSnapshot.this.getAllCatalogsStringScratchData() != null) {
                        sql = sql + "WHERE a.OWNER IN ('" + ownerName + "', " + JdbcDatabaseSnapshot.this.getAllCatalogsStringScratchData() + ")";
                    } else {
                        sql = sql + "WHERE a.OWNER='" + ownerName + "'";
                    }

                    if (viewName != null) {
                        sql = sql + " AND a.VIEW_NAME='" + CachingDatabaseMetaData.this.database.correctObjectName(viewName, View.class) + "'";
                    }

                    return this.executeAndExtract(sql, CachingDatabaseMetaData.this.database);
                }

5. 修正源码的test方法

liquibase.change.ChangeParameterMetaDataTest#computedDatabasesCorrect
在这里插入图片描述

6. 修改版本号

maven打包的话，只修改liquibase-core的pom的版本号，然后打包即可。

在这里插入图片描述

已经提交打包了一份：点击跳转liquibase-core-3.8.10-local-SNAPSHOT.jar

四、修改后的校验

项目中的校验

gitee项目地址：https://gitee.com/gy297879328/jpa_dm_liquibase
Demo已经搭建完毕,启动项目后，数据库中的日志会初始化liquibase两张表跟master.xml的表。
在这里插入图片描述

数据库中的校验

在这里插入图片描述

飞奔的屎壳郎
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 6
    评论
专栏目录
项目mysql数据库切换达梦8数据库，sprongboot+hibernate+jpa集成dm8数据库
wuguangrong888的博客
09-02 1035
背景：由于国产替代的需求，数据库需要使用国产数据库，推荐使用达梦8数据库。 一、达梦数据库的安装： 1、在官网上面下载相应的linux版本的达梦8数据库。下载地址：http://www.dameng.com/down.aspx?TypeId=11&FId=t14:11:14 2、使用linux系统(Red Hat 4.8.5-39)。安装包下载完毕后，本地解压缩，上传DMInstall.bin至你需要安装linux目录下。 3、使用usergroup,u...
Liquibase兼容达梦V8记录
qq_21979607的博客
12-08 1641
liquibase兼容达梦国产数据库V8
DM8整合java的jpa框架（附整合源码）
飞奔的屎壳郎
04-21 1417
整合完毕后的地址：https://gitee.com/gy297879328/dm_jpa_demo/tree/master 项目结构 一、达梦数据库的建表sql CREATE TABLE "T_USER" ( "ID" INT IDENTITY(1, 1) NOT NULL, "USERNAME" VARCHAR(50), "PHONE" VARCHAR(50), UNIQUE("ID")); -- oracle create sequence user_seq increment by 1
jpa实体生成liquibase changeset
youngboy的博客
09-05 1426
话不多说直接上代码 public class LiquibaseUtil { public static String generateCreateTableXML(Class<?> clazz){ String tableName = Optional.ofNullable(clazz.getAnnotation(Table.class)).map(i-...
Spring Boot + Bootstrap + FreeMarker分页 (JPA, Liquibase, H2)
allway2的博客
10-17 824
将数据库结果划分为页是许多应用程序中常用的功能。本教程将介绍如何使用FreeMarker模板创建一个漂亮的分页组件。在本文中，我们将介绍基于Spring Boot JPA、Bootstrap 和。但为了示例应用程序的清晰度，我们将其与表一起保存在单个文件中。在本文中，我们介绍了如何基于春季JPA和。像往常一样，本文中使用的代码位于我们的。在数据库层中，我们创建一个具有字段（管理数据库更改的示例应用程序。是用于准备分页组件的实用程序类。我们将弹簧启动应用程序与。
【源码解读】liquibase启动逻辑
夫礼者的专栏
08-13 1188
liquibase的代码质量和设计还是相当不错的。
spring+springMVC+jpa+hibernate框架整合
01-07
在IT领域，构建高效、可扩展的Web应用是至关重要的，而"spring+springMVC+jpa+hibernate框架整合"就是一个常见的解决方案。这个整合涉及到四个关键的技术栈：Spring框架、SpringMVC、JPA（Java Persistence API）...
SpringBoot+JPA+thymeleaf框架实现增删改查分页显示
最新发布
05-12
SpringBoot+JPA+thymeleaf框架实现增删改查分页显示，前端通过bootstrap渲染
Springboot+jpa整合demo
04-19
**SpringBoot + JPA 整合详解** SpringBoot 和 JPA 的整合是现代Java开发中的常见实践，它极大地简化了数据库操作，使开发者能够更专注于业务逻辑而不是底层数据访问细节。下面将详细介绍如何在SpringBoot项目中...
springboot+jpa整合
05-11
SpringBoot简化了Spring框架的配置，而JPA（Java Persistence API）是Java平台上的对象关系映射标准，用于处理应用程序中的持久化数据。本文将深入探讨SpringBoot与JPA的整合过程以及相关知识点。 首先，我们要理解...
liquibase3
03-01
liquibase数据库版本工具，用于数据库版本的维护，数据库管理的svn
SpringMVC+Spring+JPA+Maven框架搭建
09-03
SpringMVC+Spring+JPA+Maven框架搭建 SpringMVC+Spring+JPA+Maven框架的搭建涉及到一系列的技术组件，其中SpringMVC是Spring框架的一个模块，用于构建Web应用，提供MVC架构；Spring框架是一套全面的企业级应用开发...
mysql point jpa 注解,Hibernate使用JPA（注释实体）和liquibase
weixin_28711397的博客
02-17 148
liquibase is a perfect alternative to hibernate's解决方案Yes, Liquibase uses hibernate's metadata classes, which are the same whether you use xml mappings or annotations. You do need a hibernate config f...
Java 代码实现 Liquibase 的基本使用方法
一个骚年的博客
02-11 1473
首发地址，欢迎查看：https://www.pengtao.vip/archives/javadaimashixianliquibasedejibenyongfa 前不久公司要求使用Liquibase替代Flyway对数据库版本进行管理，要求项目启动时进行数据库升级，但在网上搜索了一大圈，也不知道为啥，几乎没有关于使用Java代码操作Liquibase的教程，都是通过命令行进行管理。费了些劲，整理了Java操作 Liquibase 的几种常用方法，在此记录一下。 update update 通常用于将更.
关于Java使用代码调用liquibase
ly9918的博客
08-14 1251
最近使用Spring boot 开发的一个项目，需要分模块开发，数据库版本管理考虑了半天，还是使用liquibase来控制管理。但遇到一个问题，每次添加了数据表以后就需要向_db.changelog.xml中添加对应的xml文件，非常容易引起冲突。 项目auth模块结构如下图 两个_db.changelog.xml内容分别如下 文件1： <?xml version="1.0" encoding="UTF-8"?> <databaseChangeLog xml..
Liquibase下载网址（官网和Github）
CKApril_java的博客
10-19 944
Liquibase下载网址（官网和Github）官网Github 官网 https://www.liquibase.org/download Github https://github.com/liquibase/liquibase/releases/
Liquibase学习1 - 安装、简单使用
weixin_39651356的博客
07-10 2470
快速学习入门Liquibase使用
liquibase mysql_Liquibase不使用mysql autoincrement
weixin_42562079的博客
02-01 701
我尝试通过liquibase变更集创建一个新表,如下所示：这失败并出现以下错误：liquibase.exception.DatabaseException:Error executing SQL CREATE TABLEkkm.mytable (id numeric AUTO_INCREMENT NOT NULL, name VARCHAR(50) NULL, descriptionVARCHAR...
spring boot+liquibase踩坑记录
热门推荐
liubingyu12345的博客
12-25 2万+
前言Spring boot本身支持liquibase，所以pom文件中添加依赖后，application.yml/application.properties定制配置信息即可，不配置使用spring boot默认配置，这样就可以用了，项目启动的时候就会去运行指定目录下的数据库更改文件，使用中还是踩了两个坑，在此记录下来。配置照例还是先把配置过程 写下来 添加pom依赖 <!-- 未指定版本，默认用了
Spring+SpringMVC+JPA+Hibernate整合教程
以下是如何将这三个框架整合在一起的步骤： 1. 创建Web工程 首先，我们需要在MyEclipse 8.6中创建一个新的Web工程，这是所有后续工作的基础。 2. 组织项目结构 根据需求，创建必要的包结构，例如src/main/java下...
评论 6
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值