Mysql元数据导入Apache Atlas

最新推荐文章于 2023-12-05 00:48:13 发布
最新推荐文章于 2023-12-05 00:48:13 发布
阅读量5.6k 收藏 15
点赞数 6
分类专栏： Apache Atlas
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/fan_yi_bo/article/details/107011119
版权

通过Rest API实现Mysql元数据写入Apache Atlas

请求方式：POST
请求路径：http://hostname:21000/api/atlas/v2/entity

在atlas中，有多种实体类型定义，也可以自定义实体类型，本示例展示的是通过rdbms类型创建mysql元数据。数据库实例使用rdbms_instance类型、数据库使用rdbms_db类型、表使用rdbms_table类型、列使用rdbms_column类型。/v2/entity接口每次只创建一个实体，批量创建可以使用/v2/entity/bulk接口。atlas中通过json文件对实体类型进行定义，通过查看源码addons/models/2000-RDBMS/2010-rdbms_model.json可看到rdbms类型的定义。

创建数据源实例

rdbms_instance类型继承DataSet类型，attributeDefs中定义了该类型的属性信息，isOptional代表该属性是否是选填项，在创建实体时一定要填写必填项，否则在创建实体时会提示缺失mandatory attribute value missing in type，同时要注意父类型中的必填项。isUnique代表该属性是否唯一。

{
            "name": "rdbms_instance",
            "description": "Instance that the rdbms server is running on",
            "superTypes": ["DataSet"],
            "serviceType": "rdbms",
            "typeVersion": "1.1",
            "attributeDefs": [
                {
                    "name": "rdbms_type",
                    "typeName": "string",
                    "isOptional": false,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": true
                },
                {
                    "name": "platform",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": true
                },
                {
                    "name": "cloudOrOnPrem",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "hostname",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "port",
                    "typeName": "int",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "protocol",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "contact_info",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "comment",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                }
            ]
        }

example

{
    "entity":{
        "typeName":"rdbms_instance",
        "attributes":{
            "qualifiedName":"192.168.2.11@mysql",
            "name":"192.168.2.11@mysql",
            "rdbms_type":"MYSQL",
            "platform":"CentOS 7.5",
            "cloudOrOnPrem":"cloud",
            "hostname":"192.168.2.11",
            "port":"3306",
            "protocol":"http",
            "contact_info":"jdbc",
            "comment":"rdbms_instance API insert test",
            "description":"rdbms_instance test",
            "owner":"root"
        }
    }
}

[root@atlas bin]# curl -v -u admin:admin -X POST -H "Content-Type:application/json" -d '{"entity":{"typeName":"rdbms_instance","attributes":{"qualifiedName":"192.168.2.11@mysql","name":"192.168.2.11@mysql","rdbms_type":"MYSQL","platform":"CentOS 7.5","cloudOrOnPrem":"cloud","hostname":"192.168.2.11","port":"3306","protocol":"http","contact_info":"jdbc","comment":"rdbms_instance API insert test","description":"rdbms_instance test","owner":"root"}}}' "http://atlas :21000/api/atlas/v2/entity"
* About to connect() to atlas port 21000 (#0)
*   Trying 192.168.2.11...
* Connected to atlas (192.168.2.11) port 21000 (#0)
* Server auth using Basic with user 'admin'
> POST /api/atlas/v2/entity HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4=
> User-Agent: curl/7.29.0
> Host: atlas:21000
> Accept: */*
> Content-Type:application/json
> Content-Length: 363
> 
* upload completely sent off: 363 out of 363 bytes
< HTTP/1.1 200 OK
< Date: Sun, 28 Jun 2020 16:22:16 GMT
< Set-Cookie: ATLASSESSIONID=kt4u9zdyhjrb1aa8ierpllgpu;Path=/;HttpOnly
< Expires: Thu, 01 Jan 1970 00:00:00 GMT
< X-Frame-Options: DENY
< X-Content-Type-Options: nosniff
< X-XSS-Protection: 1; mode=block
< Strict-Transport-Security: max-age=31536000; includeSubDomains
< Content-Type: application/json; charset=UTF-8
< X-Content-Type-Options: nosniff
< Content-Security-Policy: default-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval' blob: data:; connect-src 'self'; img-src 'self' blob: data:; style-src 'self' 'unsafe-inline';font-src 'self' data:
< Server: Apache Atlas
< Transfer-Encoding: chunked
< 
* Connection #0 to host atlas left intact
{"mutatedEntities":{"CREATE":[{"typeName":"rdbms_instance","attributes":{"qualifiedName":"192.168.2.11@mysql"},"guid":"b68383ce-e9f9-4ac8-9731-b70622eb355b"}]},"guidAssignments":{"-420268170623097":"b68383ce-e9f9-4ac8-9731-b70622eb355b"}}

返回消息中有创建实体的guid信息，我们刚刚创建的mysql数据库实例的guid是b68383ce-e9f9-4ac8-9731-b70622eb355b，guid是全局唯一的标识，在创建数据库时填写数据库实例的guid可以对两者进行关联。还可以通过guid对实体进行查询。

创建数据库实例，并关联数据源实例

rdbms_db类型同样继承自DataSet。

{
            "name": "rdbms_db",
            "description": "a database (schema) in an rdbms",
            "superTypes": ["DataSet"],
            "serviceType": "rdbms",
            "typeVersion": "1.1",
            "attributeDefs": [
                {
                    "name": "prodOrOther",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": true
                },
                {
                    "name": "contact_info",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                }
            ]
        }

{
    "entity":{
        "typeName":"rdbms_db",
        "attributes":{
            "qualifiedName":"fyb@192.168.2.11@mysql",
            "owner":"root",
            "ownerType":"USER",
            "name":"fyb",
            "emailAddress":"root",
            "createdBy":"root",
            "createTime":"2020-06-28 10:18:46.555Z",
            "updatedBy":"root",
            "updateTime":"2020-06-28 10:18:46.666Z",
            "description":"rdbms_db fyb API input",
            "prodOrOther":"asd",
            "version":0,
            "contact_info":"qwe",
            "instance":{
                "guid":"b68383ce-e9f9-4ac8-9731-b70622eb355b",
                "typeName":"rdbms_instance"
            }
        }
    }
}

[root@atlas bin]# curl -v -u admin:admin -X POST -H "Content-Type:application/json" -d '{"entity":{"typeName":"rdbms_db","attributes":{"qualifiedName":"fyb@192.168.2.11@mysql","owner":"root","ownerType":"USER","name":"fyb","emailAddress":"root","createdBy":"root","createTime":"2020-06-28 10:18:46.555Z","updatedBy":"root","updateTime":"2020-06-28 10:18:46.666Z","description":"rdbms_db fyb API input","prodOrOther":"asd","version":0,"contact_info":"qwe","instance":{"guid":"b68383ce-e9f9-4ac8-9731-b70622eb355b","typeName":"rdbms_instance"}}}}' "http://atlas:21000/api/atlas/v2/entity"
* About to connect() to atlas port 21000 (#0)
*   Trying 192.168.2.11...
* Connected to atlas (192.168.2.11) port 21000 (#0)
* Server auth using Basic with user 'admin'
> POST /api/atlas/v2/entity HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4=
> User-Agent: curl/7.29.0
> Host: atlas:21000
> Accept: */*
> Content-Type:application/json
> Content-Length: 456
> 
* upload completely sent off: 456 out of 456 bytes
< HTTP/1.1 200 OK
< Date: Sun, 28 Jun 2020 16:29:28 GMT
< Set-Cookie: ATLASSESSIONID=1suf3omtstenfk81tc1g98jjp;Path=/;HttpOnly
< Expires: Thu, 01 Jan 1970 00:00:00 GMT
< X-Frame-Options: DENY
< X-Content-Type-Options: nosniff
< X-XSS-Protection: 1; mode=block
< Strict-Transport-Security: max-age=31536000; includeSubDomains
< Content-Type: application/json; charset=UTF-8
< X-Content-Type-Options: nosniff
< Content-Security-Policy: default-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval' blob: data:; connect-src 'self'; img-src 'self' blob: data:; style-src 'self' 'unsafe-inline';font-src 'self' data:
< Server: Apache Atlas
< Transfer-Encoding: chunked
< 
* Connection #0 to host atlas left intact
{"mutatedEntities":{"UPDATE":[{"typeName":"rdbms_instance","attributes":{"owner":"root","qualifiedName":"192.168.2.11@mysql","name":"192.168.2.11@mysql","description":"rdbms_instance test"},"guid":"b68383ce-e9f9-4ac8-9731-b70622eb355b","status":"ACTIVE","displayText":"192.168.2.11@mysql","classificationNames":[],"meaningNames":[],"meanings":[]}],"CREATE":[{"typeName":"rdbms_db","attributes":{"qualifiedName":"fyb@192.168.2.11@mysql"},"guid":"5972becf-c042-45a8-9156-1f32115f9fe6"}]},"guidAssignments":{"-420268170623100":"5972becf-c042-45a8-9156-1f32115f9fe6"}}

创建表实例

{
            "name": "rdbms_table",
            "description": "a table in an rdbms database (schema)",
            "superTypes": ["DataSet"],
            "serviceType": "rdbms",
            "typeVersion": "1.2",
            "options": {
              "schemaElementsAttribute": "columns"
            },
            "attributeDefs": [
                {
                    "name": "name_path",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "createTime",
                    "typeName": "date",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "comment",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "type",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "contact_info",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "valuesMinCount": 1,
                    "valuesMaxCount": 1,
                    "isUnique": false,
                    "isIndexable": false
                }
            ]
        }

{
    "entity":{
        "typeName":"rdbms_table",
        "attributes":{
            "qualifiedName":"fyb.haha@192.168.2.11@mysql",
            "createdBy":"root",
            "name":"haha",
            "comment":"rdbms_table API insert test",
            "description":"rdbms_table  手动输入",
            "owner":"root",
            "type":"table",
            "contact_info":"fyb_info",
            "db":{
                "guid":"5972becf-c042-45a8-9156-1f32115f9fe6",
                "typeName":"rdbms_db"
            }
        }
    }
}

[root@atlas bin]# curl -v -u admin:admin -X POST -H "Content-Type:application/json" -d '{"entity":{"typeName":"rdbms_table","attributes":{"qualifiedName":"fyb.haha@192.168.2.11@mysql","createdBy":"root","name":"haha","comment":"rdbms_table API insert test","description":"rdbms_table  手动输入","owner":"root","type":"table","contact_info":"table_01_info","db":{"guid":"5972becf-c042-45a8-9156-1f32115f9fe6","typeName":"rdbms_db"}}}}' "http://atlas:21000/api/atlas/v2/entity"
* About to connect() to atlas port 21000 (#0)
*   Trying 192.168.2.11...
* Connected to atlas (192.168.2.11) port 21000 (#0)
* Server auth using Basic with user 'admin'
> POST /api/atlas/v2/entity HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4=
> User-Agent: curl/7.29.0
> Host: atlas:21000
> Accept: */*
> Content-Type:application/json
> Content-Length: 349
> 
* upload completely sent off: 349 out of 349 bytes
< HTTP/1.1 200 OK
< Date: Mon, 29 Jun 2020 01:51:42 GMT
< Set-Cookie: ATLASSESSIONID=6rhcaqu554wx14ugizdodwu6b;Path=/;HttpOnly
< Expires: Thu, 01 Jan 1970 00:00:00 GMT
< X-Frame-Options: DENY
< X-Content-Type-Options: nosniff
< X-XSS-Protection: 1; mode=block
< Strict-Transport-Security: max-age=31536000; includeSubDomains
< Content-Type: application/json; charset=UTF-8
< X-Content-Type-Options: nosniff
< Content-Security-Policy: default-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval' blob: data:; connect-src 'self'; img-src 'self' blob: data:; style-src 'self' 'unsafe-inline';font-src 'self' data:
< Server: Apache Atlas
< Transfer-Encoding: chunked
< 
* Connection #0 to host atlas left intact
{"mutatedEntities":{"UPDATE":[{"typeName":"rdbms_db","attributes":{"owner":"root","qualifiedName":"fyb@192.168.2.11@mysql","name":"fyb","description":"rdbms_db fyb API input"},"guid":"5972becf-c042-45a8-9156-1f32115f9fe6","status":"ACTIVE","displayText":"fyb","classificationNames":[],"meaningNames":[],"meanings":[]}],"CREATE":[{"typeName":"rdbms_table","attributes":{"qualifiedName":"fyb.haha@192.168.2.11@mysql"},"guid":"06cccc33-8c39-4889-ae63-feefe0d8249c"}]},"guidAssignments":{"-422563721869641":"06cccc33-8c39-4889-ae63-feefe0d8249c"}}

创建字段实例

{
            "name": "rdbms_column",
            "description": "a column in an rdbms table",
            "superTypes": ["DataSet"],
            "serviceType": "rdbms",
            "typeVersion": "1.2",
            "options": {
              "schemaAttributes": "[\"name\", \"description\", \"owner\", \"data_type\", \"comment\", \" isPrimaryKey\", \" isNullable\"]"
            },
            "attributeDefs": [
                {
                    "name": "data_type",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": true
                },
                {
                    "name": "length",
                    "typeName": "int",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "default_value",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "comment",
                    "typeName": "string",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "isNullable",
                    "typeName": "boolean",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                },
                {
                    "name": "isPrimaryKey",
                    "typeName": "boolean",
                    "isOptional": true,
                    "cardinality": "SINGLE",
                    "isUnique": false,
                    "isIndexable": false
                }
            ]
        }

{
    "entity":{
        "typeName":"rdbms_column",
        "attributes":{
            "qualifiedName":"fyb.haha.id@192.168.2.11@mysql",
            "createdBy":"root",
            "name":"id",
            "comment":"rdbms_column API insert test",
            "description":"rdbms_column API insert test",
            "owner":"root",
            "data_type":"string",
            "length":20,
            "default_value":0,
            "isNullable":true,
            "isPrimaryKey":false,
            "contact_info":"id_info",
			"table":{
				"guid":"06cccc33-8c39-4889-ae63-feefe0d8249c",
				"typeName":"rdbms_table"
			}
        }
    }
}

[root@atlas bin]# curl -v -u admin:admin -X POST -H "Content-Type:application/json" -d '{"entity":{"typeName":"rdbms_column","attributes":{"qualifiedName":"fyb.haha.id@192.168.2.11@mysql","createdBy":"root","name":"id","comment":"rdbms_column API insert test","description":"rdbms_column API insert test","owner":"root","data_type":"string","length":20,"default_value":0,"isNullable":true,"isPrimaryKey":false,"contact_info":"id_info","table":{"guid":"06cccc33-8c39-4889-ae63-feefe0d8249c","typeName":"rdbms_table"}}}}' "http://atlas:21000/api/atlas/v2/entity"
* About to connect() to atlas port 21000 (#0)
*   Trying 192.168.2.11...
* Connected to atlas (192.168.2.11) port 21000 (#0)
* Server auth using Basic with user 'admin'
> POST /api/atlas/v2/entity HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4=
> User-Agent: curl/7.29.0
> Host: atlas:21000
> Accept: */*
> Content-Type:application/json
> Content-Length: 430
> 
* upload completely sent off: 430 out of 430 bytes
< HTTP/1.1 200 OK
< Date: Mon, 29 Jun 2020 01:59:54 GMT
< Set-Cookie: ATLASSESSIONID=ins06hsestd4qyscoc8f0y9r;Path=/;HttpOnly
< Expires: Thu, 01 Jan 1970 00:00:00 GMT
< X-Frame-Options: DENY
< X-Content-Type-Options: nosniff
< X-XSS-Protection: 1; mode=block
< Strict-Transport-Security: max-age=31536000; includeSubDomains
< Content-Type: application/json; charset=UTF-8
< X-Content-Type-Options: nosniff
< Content-Security-Policy: default-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval' blob: data:; connect-src 'self'; img-src 'self' blob: data:; style-src 'self' 'unsafe-inline';font-src 'self' data:
< Server: Apache Atlas
< Transfer-Encoding: chunked
< 
* Connection #0 to host atlas left intact
{"mutatedEntities":{"UPDATE":[{"typeName":"rdbms_table","attributes":{"owner":"root","createTime":0,"qualifiedName":"fyb.haha@192.168.2.11@mysql","name":"haha","description":"rdbms_table  手动输入"},"guid":"06cccc33-8c39-4889-ae63-feefe0d8249c","status":"ACTIVE","displayText":"haha","classificationNames":[],"meaningNames":[],"meanings":[]}],"CREATE":[{"typeName":"rdbms_column","attributes":{"qualifiedName":"fyb.haha.id@192.168.2.11@mysql"},"guid":"b4d37e2f-6c13-4533-a05c-09c53bdd6452"}]},"guidAssignments":{"-422563721869653":"b4d37e2f-6c13-4533-a05c-09c53bdd6452"}}

该示例只是演示下如何创建实体，以及创建实体时需要注意的一些事项，rdbms类型详细定义可以参考源码。

脚气水蟑螂药
关注
  • 6
    点赞
  • 踩
  • 15
    收藏
    觉得还不错? 一键收藏
  • 28
    评论
专栏目录
apache atlas mysql_记录Atlas安装与配置过程
weixin_39538687的博客
01-26 766
记录Atlas安装与配置过程安装环境是基于centos8，安装过程配置文件内容根据自己实际修改jdk要安装1.8版本Zookeeper安装下载Zookeepercurl -O https://downloads.apache.org/zookeeper/zookeeper-3.6.2/apache-zookeeper-3.6.2-bin.tar.gz解压tar -zxvf apache-zooke...
apache atlas mysql_apache atlas使用import-hive.sh导入hive历史元数据后没有lineage，并且报错...
weixin_39838328的博客
01-26 701
是一个命令行工具？使得结构化数据与Hadoop之间的导入导出变得容易可以导入整个库或者单个表可以与Oozie集成，将 导入导出作为工作流的一部分。内部转化为MapReduce，用于传输数据下载安装配置根据Hadoop版本选择对应的Sqoop，我这里是Hadoop，选择Sqoop 1.99.6：wget http://mirrors.hust.edu.cn/apache/sqoop/1.99.6/s...
大数据元数据开源解决方案apache atlas
11-01
大数据元数据开源解决方案apache atlas，提供数据治理，元数据管理等功能
【技术分享】 数据治理工具Apache Atlas初体验
Andytl的博客
09-24 1027
企业在数字化转型中会遇到各业务系统多，建设历程长，数据缺乏统一维护，从而导致数据无法贯通，数据字典缺失等问题。数据流转关系往往保留在业务或技术人员的脑海中，难以充分利用和传承。Apache Atlas就是为解决这些问题而产生的数据治理工具，利用Atlas可以自动构建数据字典，自动生成数据血缘，快速检索数据资源，不仅支持Hadoop生态的Hive、HBase、Sqoop等组件，还可以支持传统关系型数据库。 一、框架 上图可以看出，Atlas的框架有两个特点，一是基于Hadoop生态组件搭建，二是架构有些复杂
Mysql访问中间件--Atlas初探
落叶
11-28 676
Atlas是由 Qihoo 360公司Web平台部基础架构团队开发维护的一个基于MySQL协议的数据中间层项目。它在MySQL官方推出的MySQL-Proxy 0.8.2版本的基础上，修改了大量bug，添加了很多功能特性，目前该项目在360公司内部得到了广泛应用。 Atlas主要有以下功能 读写分离 从库负载均衡 IP过滤 自动分表（目前只支持在同一个库中进行分表） DBA可平滑上下线DB 自动...
导入MySQL元数据到Apache Atlas
沧浪之水的博客
08-13 3651
导入MySQL元数据到Apache Atlas
导入JDBC元数据到Apache Atlas
沧浪之水的博客
12-05 1467
前期实现了导入MySQL元数据到Apache Atlas, 由于是初步版本，且功能参照Atlas Hive Hook，实现的不够完美本期对功能进行改进，实现了导入多种关系型数据库元数据到Apache Atlas。
元数据管理Apache Atlas编译集成部署及测试
06-27 831
虚拟机之前部署过（2.7.3版本），略！kafka_2.13-3.2.0.tgz下载地址，速度比较快，如果不行，只能去官网下载了。 查看topic命令 查看具体topic内容命令 🍊2.3、hive 自行官网下载，有积分的花两分快速下载此次主要是增加变量，其路径部署atlas时会涉及到 bin/hive 指定hbase 添加hooks（还需要部署MySQL哟，也可以不部署，采用内嵌模式-应该不影响采集吧，尝试的越多越感觉无知） conf/atlas-application.proper.
Apache Atlas 安装部署
Nice的博客
07-17 2969
atlas 安装部署采坑记录
atlas 的 mysql-bridge.zip
01-20
4. **监控与调试**：启动 MySQL-Bridge 后，应定期检查日志以确保服务正常运行，并在 Atlas 平台上验证元数据是否正确导入和更新。 **最佳实践** 1. **定期更新**：设置合理的元数据同步频率，既能保证元数据的...
java代码将mysql表数据导入HBase表
03-14
总结，通过上述步骤，我们可以成功地将MySQL中的数据导入到HBase。在实际项目中，可能需要考虑更多因素，例如数据清洗、错误处理、性能优化等。此外，为了实现大规模数据迁移，可以考虑使用批处理或MapReduce等技术...
分析Mysql大量数据导入遇到的问题以及解决方案
09-09
主要介绍了Mysql大量数据导入遇到的问题以及解决方案，希望我们整理的内容能够帮助到大家。
MySQL 导入数据
12-16
本章节我们将深入探讨几种常见的 MySQL 导入数据的方法，帮助你更有效地管理数据库。 1. **mysql 命令导入** `mysql` 命令是一种通过命令行界面将数据导入 MySQL 数据库的简单方式。导入数据的语法格式如下： ```...
Apache Atlas部署FAQ
fan_yi_bo的博客
05-21 3045
Apache Atlas部署FAQAtlas部署问题Atlas启动报错(zookeeper启动失败导致)1.问题描述2.原因定位3.解决方法Atlas启动报错(solr启动失败导致)1.问题描述2.原因定位3.解决方法Atlas启动报错(HBase中没有Column)1.问题描述2.原因定位3.解决方法Atlas import-hive.sh报错1.问题描述2.原因定位3.解决方法 Atlas部署问题 Atlas启动报错(zookeeper启动失败导致) 通过Atlas内嵌HBase和Solr启动Atlas
Atlas RSET API使用
fan_yi_bo的博客
10-27 1586
Atlas REST API官方手册 1.DiscoveryREST 1.1GET /v2/search/attribute 1.2GET /v2/search/basic name type description constraints classification query limit the result to only entities tagged with the given classification or or its sub-types excludeDelet
通过Kafka向Atlas中写入数据
fan_yi_bo的博客
10-27 1464
在hive中创建数据库，并观察kafka中两个Atlas的topic内的数据 创建数据库 hive> create database test; OK Time taken: 0.253 seconds ATLAS_ENTITIESTopic的内容 [root@testkafka-01 bin]# ./kafka-console-consumer.sh --bootstrap-server testkafka-01:9092 --topic ATLAS_ENTITIES {"version":{"v
Apache Atlas部署
fan_yi_bo的博客
10-27 930
基于原生集群进行部署 1.Solr集群部署 [root@testkafka-01 bin]# ./solr start -c -z testkafka-01:2181,testkafka-02:2181,testkafka-03:2181 -p 8983 -force [root@testkafka-01 bin]# /opt/software/solr-7.5.0/bin/solr create -c vertex_index -d /opt/software/atlas-1.2.0/conf/solr
chromedriver-mac-arm64_126.0.6465.0.zip
最新发布
07-31
chromedriver-mac-arm64_126.0.6465.0.zip
评论 28
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值