Python3 实现 BeansDB 与 GoBeansDB 间双向数据迁移

最新推荐文章于 2024-03-16 09:38:18 发布
最新推荐文章于 2024-03-16 09:38:18 发布
阅读量473 收藏
点赞数 1
分类专栏： Python GoBeansDB BeansDB 文章标签： 数据迁移 双向支持
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-NC-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_42018518/article/details/102827604
版权
Python 同时被 3 个专栏收录
19 篇文章 0 订阅
订阅专栏
GoBeansDB
11 篇文章 0 订阅
订阅专栏
BeansDB
3 篇文章 0 订阅
订阅专栏

目录

1、Python3 实现 BeansDB 与 GoBeansDB 间双向数据迁移

2、以上实例输出部分结果

3、Python3 BeansDB / GoBeansDB 连接 - libmc 驱动模块

4、Python3 MySQL 数据库连接 - PyMySQL 驱动模块

5、GoBeansproxy（proxy-access.log）日志部分输出内容

6、GoBeansDB（gobeansdb.log），即磁盘上的样子（256分区）

1、Python3 实现 BeansDB 与 GoBeansDB 间双向数据迁移

#!/usr/bin/env python3
# -*- coding: UTF-8 -*-

'''=============================================================
@Project -> File   ：GobeansDB -> bidirectional_beansdb_gobeansdb.py
@IDE    ：PyCharm
@Author ：Mr. Wufei
@Date   ：2019/10/29 10:58
@Desc   ：Python3 实现 BeansDB 与 GoBeansDB 间双向数据迁移
============================================================='''

import time
import datetime
import mysqlconn
import python3_libmc_beansdb as plb

class DataMigration(object):

    def __init__(self, mysql_conn_dict, export_ips_port_list, import_ips_port_list):
        """
        :param mysql_conn_dict: 一个包含 MySQL 连接所需信息的字典（格式：{'host': '127.0.0.1', 'port': 3306, 'user': 'test', 'passwd': 'test', 'db': 'test'}）
        :param export_ips_port_list: 导出 BeansDB/GoBeansproxy 连接的 IP:PORT 列表（格式：['ip1:port1', 'ip2:port2']）
        :param import_ips_port_list: 导入 BeansDB/GoBeansproxy 连接的 IP:PORT 列表（格式：['ip1:port1', 'ip2:port2']）
        """
        self.__mysql_conn_dict = mysql_conn_dict
        self.__export_ips_port_list = export_ips_port_list
        self.__import_ips_port_list = import_ips_port_list

    def _construct_sql(self, *args, image_date = 'None'):
        """
        构造 SQL
        :param args: 接收一个或多个图片 ID（image_id），只有当 image_date = 'None' 时才会构造条件是 image_id 的 SQL
        :param image_date: 接收一个具体的日期（格式：2019-09-02）
        :return: sql（一个标准的 SQL 语句）
        """
        if image_date == 'None':
            sql = '''
                select
                    distinct image_path as image_key
                from t_beansdb_image
                where image_id in %s
            ''' %(args)
        else:
            start_ctime = str(image_date) + ' 00:00:00'
            end_ctime = str(image_date) + ' 23:59:59'
            sql = '''
                select
                    distinct image_path as image_key
                from t_beansdb_image
                where image_ctime between "%s" and "%s"
            ''' %(start_ctime, end_ctime)
        return sql

    def _mysql_operations(self, mysql_conn_dict, sql):
        """
        MySQL 操作
        :param mysql_conn_dict: 一个包含 MySQL 连接所需信息的字典
        :param sql: 一个可执行 SQL 语句
        :return: 一个或多个图片分布式存储路径（即图片在 BeansDB/GoBeansDB 的 key）的列表
        """
        image_keys_list = []
        with mysqlconn.MySqlDB(host = mysql_conn_dict['host'], port = mysql_conn_dict['port'], user = mysql_conn_dict['user'], passwd = mysql_conn_dict['passwd'], db = mysql_conn_dict['db']) as mysqldb:
            mysqldb.execute(sql)
            for i in mysqldb:
                image_keys_list.append(i['image_key'])
        return image_keys_list

    def _get_multi_list(self, ips_port_list, image_keys_list):
        """
        获取所有（一个或多个）给定 key 的值（cost maxrss about 900M）
        :param ips_port_list: BeansDB/GoBeansproxy 连接的 IP:PORT 列表（格式：['ip1:port1', 'ip2:port2']）
        :param image_keys_list: 一个或多个图片分布式存储路径（即图片在 BeansDB/GoBeansDB 的 key）的列表（格式：[key1, key2, key3]）
        :return: BeansDB/GoBeansDB 一个或多个 key-value 的字典（格式：{key1 : value1, key2 : value2 , key3 : value3}）【针对图片存储，上限为 720，最优为 100】
        """
        mc = plb.InteractiveConn(ips_port_list)
        image_keys_values_dict = mc.get_multi_list(image_keys_list)
        return image_keys_values_dict

    def _set_multi_dict(self, ips_port_list, image_keys_values_dict):
        """
        BeansDB/GoBeansDB 同时设置一个或多个 key-value
        :param ips_port_list: BeansDB/GoBeansproxy 连接的 IP:PORT 列表（格式：['ip1:port1', 'ip2:port2']）
        :param image_keys_values_dict: BeansDB/GoBeansDB 一个或多个 key-value 的字典（格式：{key1 : value1, key2 : value2 , key3 : value3}）
        :return: set_status（True/False）
        """
        mc = plb.InteractiveConn(ips_port_list)
        set_status = mc.set_multi_dict(image_keys_values_dict)
        return set_status

    def _date_verify(self, date):
        """
        日期格式验证
        :param date: 一个日期字符串，规定格式 "%Y-%m-%d"
        :return: True/False
        """
        try:
            time.strptime(date, "%Y-%m-%d")
            return True
        except Exception:
            return False
    def _get_every_day(self, start_date, end_date):
        """
        获取两时间区间内的每一天日期的列表
        :param start_date: 开始日期（格式：2019-10-01）
        :param end_date: 结束日期（格式：2019-10-03）
        :return: date_list，日期列表（格式：['2019-10-01', '2019-10-02', '2019-10-02']），如果开始日期 > 结束日期则只返回开始日期
        """
        date_list = []
        # 根据指定的格式把开始日期和结束日期字符串解析为时间元组
        start_date = datetime.datetime.strptime(start_date, "%Y-%m-%d")
        end_date = datetime.datetime.strptime(end_date, "%Y-%m-%d")
        # 判断开始日期与结束日期，如果开始日期 > 结束日期则只返回开始日期
        if start_date > end_date:
            date_str = start_date.strftime("%Y-%m-%d")
            date_list.append(date_str)
            return date_list
        while start_date <= end_date:
            date_str = start_date.strftime("%Y-%m-%d")
            date_list.append(date_str)
            start_date += datetime.timedelta(days = 1)
        return date_list

    def data_migration(self, *args, start_cdate = 'None', end_cdate = 'None'):
        """
        数据迁移操作函数
        :param args: 接收一个或多个图片 ID（image_id），只有当 start_cdate = 'None' and end_cdate = 'None' 才会生效
        :param start_cdate: 开始日期（格式：2019-10-01）
        :param end_cdate: 结束日期（格式：2019-10-03）
        :return:
        """
        sql_list = []
        # 校验开始日期与结束日期，接收 True/False
        start_cdate_verify = self._date_verify(start_cdate)
        end_cdate_verify = self._date_verify(end_cdate)

        # 如果仅开始日期不为 None
        if start_cdate_verify and not end_cdate_verify:
            sql = self._construct_sql(image_date = start_cdate)
            sql_list.append(sql)
        # 如果开始日期与结束日期均不为 None
        elif start_cdate_verify and end_cdate_verify:
            date_list = self._get_every_day(start_cdate, end_cdate)
            for date in date_list:
                sql = self._construct_sql(image_date = date)
                sql_list.append(sql)
        # 如果开始日期与结束日期均为 None，切 image_id 不为空
        elif not start_cdate_verify and not end_cdate_verify and len(args) != 0:
            sql = self._construct_sql(args)
            sql_list.append(sql)
        else:
            return 'Parameter Error'

        for sql in sql_list:
            print(sql)
            # 连接 MySQL，一个或多个图片分布式存储路径（即图片在 BeansDB/GoBeansDB 的 key）的列表
            image_keys_list = self._mysql_operations(self.__mysql_conn_dict, sql)
            # 获取列表长度，判断列表是否切片后循环执行
            list_len = len(image_keys_list)
            print('当前数据迁移 key-value 数量：', list_len)

            # image_keys_values_dict 针对图片存储，上限为 720，最优为 100，当长度大于 360 时每次 100 循环执行
            if list_len > 360:
                # 取整除，列表切片准则
                exactly_divisible = list_len // 100
                list_num = 0
                while list_num <= exactly_divisible:
                    slice_start = list_num * 100
                    # 判断是否为最后一次循环，当为最后一次是 stop 即为列表长度
                    if list_num == exactly_divisible:
                        slice_stop = list_len
                    else:
                        slice_stop = list_num * 100 + 100
                    # 连接BeansDB/GoBeansDB，获取所有（一个或多个）给定 key 的值
                    image_keys_values_dict = self._get_multi_list(self.__export_ips_port_list, image_keys_list[slice_start : slice_stop])
                    # 连接BeansDB/GoBeansDB，同时设置一个或多个 key-value（原理还是相当于依次执行 set）
                    set_status = self._set_multi_dict(self.__import_ips_port_list, image_keys_values_dict)
                    if not set_status:
                        # 如果为 False，不是整个 image_keys_values_dict 执行失败，而是个别 set 的值不存在，可忽略（因为可通过 Python 分析日志找出 set 失败的key）
                        # 当然，如果数据量小，可不用采取批量形式，set_key_value 即可
                        print('Data Migration Fail, Value does not exist.')
                    else:
                        print('>>> list_len: %d; slice_start: %d; slice_stop: %d' %(list_len, slice_start, slice_stop))

                    list_num += 1
            else:
                # 连接BeansDB/GoBeansDB，获取所有（一个或多个）给定 key 的值
                image_keys_values_dict = self._get_multi_list(self.__export_ips_port_list, image_keys_list)
                # 连接BeansDB/GoBeansDB，同时设置一个或多个 key-value
                set_status = self._set_multi_dict(self.__import_ips_port_list, image_keys_values_dict)
                if not set_status:
                    print('Data Migration Fail', image_keys_list)
                else:
                    print('>>> list_len: %d' %(list_len))

            # 等待 1s
            time.sleep(1)
        return 'Data Migration Successful'

"""
if __name__ == '__main__':
    mysql_higo_base_dict = {'host': 'xx.xx.2.36', 'port': 3212, 'user': 'mycat_reader', 'passwd': 'mycat_reader', 'db': 'gobeansdb'}
    beansdb_ips_port_list = ['xx.xx.1.93:8901', 'xx.xx.2.95:8901', 'xx.xx.5.17:8901']
    gobeansproxy_ips_port_list = ['xx.xx.3.36:7905']
    dm = DataMigration(mysql_higo_base_dict, beansdb_ips_port_list, gobeansproxy_ips_port_list)
    imageid_tuple = (310125868450372947, 310125866679005166, 310125836579062994, 310125836139798152, 310125834126452919)
    result = dm.data_migration(*imageid_tuple, start_cdate = '2019-10-01', end_cdate = '2019-10-30')
    print(result)
"""

2、以上实例输出部分结果

select
     distinct image_path as image_key
from t_beansdb_image
where image_ctime between "2019-10-30 00:00:00" and "2019-10-30 23:59:59"
 
当前数据迁移 key-value 数量： 7392
>>> list_len: 7392; slice_start: 0; slice_stop: 100
>>> list_len: 7392; slice_start: 100; slice_stop: 200
>>> list_len: 7392; slice_start: 200; slice_stop: 300
>>> list_len: 7392; slice_start: 300; slice_stop: 400
>>> list_len: 7392; slice_start: 400; slice_stop: 500
>>> list_len: 7392; slice_start: 500; slice_stop: 600
>>> list_len: 7392; slice_start: 600; slice_stop: 700
>>> list_len: 7392; slice_start: 700; slice_stop: 800
>>> list_len: 7392; slice_start: 800; slice_stop: 900
>>> list_len: 7392; slice_start: 900; slice_stop: 1000
>>> list_len: 7392; slice_start: 1000; slice_stop: 1100
>>> list_len: 7392; slice_start: 1100; slice_stop: 1200
>>> list_len: 7392; slice_start: 1200; slice_stop: 1300
>>> list_len: 7392; slice_start: 1300; slice_stop: 1400
>>> list_len: 7392; slice_start: 1400; slice_stop: 1500
>>> list_len: 7392; slice_start: 1500; slice_stop: 1600
>>> list_len: 7392; slice_start: 1600; slice_stop: 1700
>>> list_len: 7392; slice_start: 1700; slice_stop: 1800
>>> list_len: 7392; slice_start: 1800; slice_stop: 1900
>>> list_len: 7392; slice_start: 1900; slice_stop: 2000
>>> list_len: 7392; slice_start: 2000; slice_stop: 2100
>>> list_len: 7392; slice_start: 2100; slice_stop: 2200
>>> list_len: 7392; slice_start: 2200; slice_stop: 2300
>>> list_len: 7392; slice_start: 2300; slice_stop: 2400
>>> list_len: 7392; slice_start: 2400; slice_stop: 2500
>>> list_len: 7392; slice_start: 2500; slice_stop: 2600
>>> list_len: 7392; slice_start: 2600; slice_stop: 2700
>>> list_len: 7392; slice_start: 2700; slice_stop: 2800
>>> list_len: 7392; slice_start: 2800; slice_stop: 2900
>>> list_len: 7392; slice_start: 2900; slice_stop: 3000
>>> list_len: 7392; slice_start: 3000; slice_stop: 3100
>>> list_len: 7392; slice_start: 3100; slice_stop: 3200
>>> list_len: 7392; slice_start: 3200; slice_stop: 3300
>>> list_len: 7392; slice_start: 3300; slice_stop: 3400
>>> list_len: 7392; slice_start: 3400; slice_stop: 3500
>>> list_len: 7392; slice_start: 3500; slice_stop: 3600
>>> list_len: 7392; slice_start: 3600; slice_stop: 3700
>>> list_len: 7392; slice_start: 3700; slice_stop: 3800
>>> list_len: 7392; slice_start: 3800; slice_stop: 3900
>>> list_len: 7392; slice_start: 3900; slice_stop: 4000
>>> list_len: 7392; slice_start: 4000; slice_stop: 4100
>>> list_len: 7392; slice_start: 4100; slice_stop: 4200
>>> list_len: 7392; slice_start: 4200; slice_stop: 4300
>>> list_len: 7392; slice_start: 4300; slice_stop: 4400
>>> list_len: 7392; slice_start: 4400; slice_stop: 4500
>>> list_len: 7392; slice_start: 4500; slice_stop: 4600
>>> list_len: 7392; slice_start: 4600; slice_stop: 4700
>>> list_len: 7392; slice_start: 4700; slice_stop: 4800
>>> list_len: 7392; slice_start: 4800; slice_stop: 4900
>>> list_len: 7392; slice_start: 4900; slice_stop: 5000
>>> list_len: 7392; slice_start: 5000; slice_stop: 5100
>>> list_len: 7392; slice_start: 5100; slice_stop: 5200
>>> list_len: 7392; slice_start: 5200; slice_stop: 5300
>>> list_len: 7392; slice_start: 5300; slice_stop: 5400
>>> list_len: 7392; slice_start: 5400; slice_stop: 5500
>>> list_len: 7392; slice_start: 5500; slice_stop: 5600
>>> list_len: 7392; slice_start: 5600; slice_stop: 5700
>>> list_len: 7392; slice_start: 5700; slice_stop: 5800
>>> list_len: 7392; slice_start: 5800; slice_stop: 5900
>>> list_len: 7392; slice_start: 5900; slice_stop: 6000
>>> list_len: 7392; slice_start: 6000; slice_stop: 6100
>>> list_len: 7392; slice_start: 6100; slice_stop: 6200
>>> list_len: 7392; slice_start: 6200; slice_stop: 6300
>>> list_len: 7392; slice_start: 6300; slice_stop: 6400
>>> list_len: 7392; slice_start: 6400; slice_stop: 6500
>>> list_len: 7392; slice_start: 6500; slice_stop: 6600
>>> list_len: 7392; slice_start: 6600; slice_stop: 6700
>>> list_len: 7392; slice_start: 6700; slice_stop: 6800
>>> list_len: 7392; slice_start: 6800; slice_stop: 6900
>>> list_len: 7392; slice_start: 6900; slice_stop: 7000
>>> list_len: 7392; slice_start: 7000; slice_stop: 7100
>>> list_len: 7392; slice_start: 7100; slice_stop: 7200
>>> list_len: 7392; slice_start: 7200; slice_stop: 7300
>>> list_len: 7392; slice_start: 7300; slice_stop: 7392
Data Migration Successful

3、Python3 BeansDB / GoBeansDB 连接 - libmc 驱动模块

#!/usr/bin/env python3
# -*- coding: UTF-8 -*-

'''=========================================================
@Project -> File   ：GoBeansDB -> python3_libmc_beansdb.py
@IDE    ：PyCharm
@Author ：Mr. Wufei
@Date   ：2019/10/28 20:01
@Desc   ：Python3 BeansDB / GoBeansDB 连接 - libmc 驱动模块
========================================================='''

import libmc

class InteractiveConn(object):

    def __init__(self, db_ips_port_list):
        """
        推荐使用 libmc 客户端，获取所有（一个或多个）Client
        :param db_ips_port_list: ['beansdb_ip1:beansdb_port1', 'beansdb_ip2:beansdb_port2']
        """
        self.__mc = libmc.Client(db_ips_port_list)

    def set_key_value(self, key, value):
        """
        设置指定 key 的值：写入 K/V 到数据库。（日志重要信息截取：SET SUCC beansdb_ip:beansdb_port key）
        :param key:
        :param value:
        :return: True/False
        """
        return self.__mc.set(key, value)

    def get_key(self, key):
        """
        获取指定 key 的值，没有则返回 None。（日志重要信息截取：GET SUCC beansdb_ip:beansdb_port key）
        :param key:
        :return: value
        """
        return self.__mc.get(key)

    def del_key(self, key):
        """
        删除指定 key。（日志重要信息截取：key 不存在时：DELETE SUCC NoWhere key；key 存在是：DELETE SUCC beansdb_ip:beansdb_port key）
        :param key:
        :return: True/False
        """
        return self.__mc.delete(key)

    def set_multi_dict(self, keys_values_dict):
        """
        同时设置一个或多个 key-value。（日志重要信息截取同 set，相当于依次执行 set）
        :param keys_values_dict: 字典 {key1 : value1, key2 : value2 , key3 : value3}
        :return: True/False
        """
        return self.__mc.set_multi(keys_values_dict)

    def get_multi_list(self, keys_list):
        """
        获取所有（一个或多个）给定 key 的值。（日志重要信息截取：GETM SUCC beansdb_ip1:beans_port1,beansdb_ip2:beansdb_port2,beansdb_ip3:beansdb_port3 key1 key2 key3）
        :param keys_list: 列表 [key1, key2, key3]
        :return: 字典 {key1 : value1, key2 : value2 , key3 : value3}
        """
        return self.__mc.get_multi(keys_list)

    def del_multi_list(self, keys_list):
        """
        删除所有（一个或多个）给定 key 的值。（日志重要信息截取同 delete，相当于依次执行 delete）
        :param keys_list: 列表 [key1, key2, key3]
        :return: True/False
        """
        return self.__mc.delete_multi(keys_list)

4、Python3 MySQL 数据库连接 - PyMySQL 驱动模块

#!/usr/bin/env python3
# -*- coding: utf-8 -*-

'''=================================================
@Project -> File   ：GoBeansDB -> mysqlconn.py
@IDE    ：PyCharm
@Author ：Mr. Wufei
@Date   ：2019/10/23 21:00
@Desc   ：Python3 MySQL 数据库连接 - PyMySQL 驱动模块
=================================================='''

import pymysql

class MySqlDB(object):

    def __init__(self,host = 'localhost', port = 3306, user = 'root', passwd = 'root', db = '', charset = 'utf8'):
        # 建立连接
        self.conn = pymysql.connect(host = host, port = port, user = user, passwd = passwd, db = db, charset = charset)
        # 创建游标，操作设置为字典类型
        self.cur = self.conn.cursor(cursor = pymysql.cursors.DictCursor)

    def __enter__(self):
        # 返回游标
        return self.cur

    def __exit__(self, exc_type, exc_val, exc_tb):
        # 提交数据库并执行
        self.conn.commit()
        # 关闭游标
        self.cur.close()
        # 关闭数据库连接
        self.conn.close()

5、GoBeansproxy（proxy-access.log）日志部分输出内容

2019/10/31 12:38:27.870089 V1 xx.xx.2.35:55875 SET SUCC 298251 xx.xx.3.36:7980,xx.xx.3.36:7981 2960 xxx/_x/ff/ca/3410c212014e76dd15f6b6a861fe_960_1280.cz.jpg
2019/10/31 12:38:27.873790 V1 xx.xx.2.35:55875 SET SUCC 462369 xx.xx.3.36:7980,xx.xx.3.36:7981 2837 xxx/_x/ff/cd/f3dd3f7fafd9295db55e7f2dea09_930_930.cz.jpg
2019/10/31 12:38:27.876399 V1 xx.xx.2.35:55875 SET SUCC 35104 xx.xx.3.36:7980,xx.xx.3.36:7981 2469 xxx/_x/ff/d2/9b763c842f0edbe7eb1e1a0b7a41_750_750.cz.jpg
2019/10/31 12:38:27.882297 V1 xx.xx.2.35:55875 SET SUCC 65953 xx.xx.3.36:7980,xx.xx.3.36:7981 5732 xxx/_x/ff/d5/4c727e741cc8b3ef68dfbaf358e6_750_750.cz.jpg
2019/10/31 12:38:27.884632 V1 xx.xx.2.35:55875 SET SUCC 65115 xx.xx.3.36:7980,xx.xx.3.36:7981 2164 xxx/_x/ff/da/18e6cb57c9ede5bbf9cb3d5f6c1c_750_750.cz.jpg
2019/10/31 12:38:27.889006 V1 xx.xx.2.35:55875 SET SUCC 179593 xx.xx.3.36:7980,xx.xx.3.36:7982 3864 xxx/_x/ff/dd/dedfa34815a550063b4ce5da480c_750_750.cz.jpg
2019/10/31 12:38:27.893357 V1 xx.xx.2.35:55875 SET SUCC 459013 xx.xx.3.36:7980,xx.xx.3.36:7982 3335 xxx/_x/ff/e6/553c78a2a257e8d7c8161fee308f_1500_1800.cz.jpg
2019/10/31 12:38:27.896031 V1 xx.xx.2.35:55875 SET SUCC 52614 xx.xx.3.36:7980,xx.xx.3.36:7981 2447 xxx/_x/ff/f2/2bbaa84c67fc19bc598e41c2e8e3_750_750.cz.jpg
2019/10/31 12:38:27.897877 V1 xx.xx.2.35:55875 SET SUCC 175097 xx.xx.3.36:7981,xx.xx.3.36:7980 1473 xxx/_x/ff/f2/b77697729f6ea9c6586366b2697a_800_800.cz.jpg
2019/10/31 12:38:27.900968 V1 xx.xx.2.35:55875 SET SUCC 110108 xx.xx.3.36:7980,xx.xx.3.36:7981 2851 xxx/_x/ff/f9/4565ae30b4e314e225b7247e4f76_960_1280.cz.jpg

6、GoBeansDB（gobeansdb.log），即磁盘上的样子（256分区）

2019/10/31 12:37:05.079903 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/6/000.data
2019/10/31 12:37:05.097381 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/5/000.data
2019/10/31 12:37:05.110408 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/8/000.data
2019/10/31 12:37:05.169754 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/5/000.data
2019/10/31 12:37:05.193696 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/0/000.data
2019/10/31 12:37:05.203567 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/f/000.data
2019/10/31 12:37:05.209632 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/a/000.data
2019/10/31 12:37:05.225805 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/9/000.data
2019/10/31 12:37:05.243414 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/a/000.data
2019/10/31 12:37:05.301173 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/7/000.data
2019/10/31 12:37:05.396463 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/6/000.data
2019/10/31 12:37:05.403720 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/5/000.data
2019/10/31 12:37:05.409515 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/2/000.data
2019/10/31 12:37:05.438088 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/c/000.data
2019/10/31 12:37:05.452828 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/1/000.data
2019/10/31 12:37:05.470354 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/f/000.data
2019/10/31 12:37:05.475559 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/6/000.data
2019/10/31 12:37:05.482913 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/4/000.data
2019/10/31 12:37:05.487569 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/f/000.data
2019/10/31 12:37:05.494675 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/0/000.data
2019/10/31 12:37:05.500826 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/2/000.data
2019/10/31 12:37:05.526309 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/b/000.data
2019/10/31 12:37:05.606604 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/5/000.data
2019/10/31 12:37:05.612137 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/8/000.data
2019/10/31 12:37:05.643276 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/0/000.data
2019/10/31 12:37:05.649154 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/5/000.data
2019/10/31 12:37:05.656591 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/0/000.data
2019/10/31 12:37:05.662760 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/8/000.data
2019/10/31 12:37:05.670026 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/d/000.data
2019/10/31 12:37:05.725965 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/9/000.data
2019/10/31 12:37:05.741220 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/2/000.data
2019/10/31 12:37:05.780352 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/e/000.data
2019/10/31 12:37:05.786786 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/e/000.data
2019/10/31 12:37:05.792455 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/c/000.data
2019/10/31 12:37:05.798680 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/d/000.data
2019/10/31 12:37:05.809138 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/2/000.data
2019/10/31 12:37:05.830457 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/6/000.data
2019/10/31 12:37:05.855066 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/9/000.data
2019/10/31 12:37:05.864259 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/1/000.data
2019/10/31 12:37:05.887102 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/3/000.data
2019/10/31 12:37:05.895397 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/4/000.data
2019/10/31 12:37:05.909401 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/8/000.data
2019/10/31 12:37:05.921139 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/a/000.data
2019/10/31 12:37:05.934272 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/1/000.data
2019/10/31 12:37:05.948898 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/b/000.data
2019/10/31 12:37:05.974018 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/c/000.data
2019/10/31 12:37:05.983696 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/b/000.data
2019/10/31 12:37:05.989749 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/7/000.data
2019/10/31 12:37:06.013582 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/b/000.data
2019/10/31 12:37:06.024505 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/8/000.data
2019/10/31 12:37:06.029580 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/5/000.data
2019/10/31 12:37:06.042116 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/6/000.data
2019/10/31 12:37:06.087643 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/5/000.data
2019/10/31 12:37:06.111150 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/d/000.data
2019/10/31 12:37:06.119139 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/3/000.data
2019/10/31 12:37:06.127765 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/3/000.data
2019/10/31 12:37:06.215714 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/7/000.data
2019/10/31 12:37:06.221210 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/c/000.data
2019/10/31 12:37:06.282573 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/5/000.data
2019/10/31 12:37:06.294792 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/2/000.data
2019/10/31 12:37:06.303256 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/6/000.data
2019/10/31 12:37:06.310213 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/6/000.data
2019/10/31 12:37:06.315311 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/5/000.data
2019/10/31 12:37:06.339626 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/a/000.data
2019/10/31 12:37:06.376150 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/2/000.data
2019/10/31 12:37:06.383840 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/9/000.data
2019/10/31 12:37:06.396462 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/4/000.data
2019/10/31 12:37:06.404553 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/d/000.data
2019/10/31 12:37:06.412544 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/c/000.data
2019/10/31 12:37:06.422210 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/d/000.data
2019/10/31 12:37:06.431301 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/5/000.data
2019/10/31 12:37:06.448410 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/a/000.data
2019/10/31 12:37:06.470784 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/3/000.data
2019/10/31 12:37:06.478840 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/b/000.data
2019/10/31 12:37:06.484977 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/6/000.data
2019/10/31 12:37:06.509911 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/f/000.data
2019/10/31 12:37:06.515634 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/3/000.data
2019/10/31 12:37:06.530001 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/8/000.data
2019/10/31 12:37:06.534711 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/c/000.data
2019/10/31 12:37:06.544177 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/1/000.data
2019/10/31 12:37:06.553432 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/7/000.data
2019/10/31 12:37:06.559164 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/a/000.data
2019/10/31 12:37:06.569152 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/5/000.data
2019/10/31 12:37:06.580591 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/d/000.data
2019/10/31 12:37:06.594349 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/2/000.data
2019/10/31 12:37:06.604621 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/d/000.data
2019/10/31 12:37:06.610944 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/b/000.data
2019/10/31 12:37:06.616947 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/9/000.data
2019/10/31 12:37:06.623266 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/0/000.data
2019/10/31 12:37:06.630776 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/6/000.data
2019/10/31 12:37:06.638365 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/f/000.data
2019/10/31 12:37:06.644974 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/d/000.data
2019/10/31 12:37:06.660961 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/2/000.data
2019/10/31 12:37:07.182500 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/7/000.data
2019/10/31 12:37:07.192599 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/8/000.data
2019/10/31 12:37:07.221540 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/3/000.data
2019/10/31 12:37:07.253080 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/0/000.data
2019/10/31 12:37:07.270241 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/1/000.data
2019/10/31 12:37:07.291360 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/e/000.data
2019/10/31 12:37:07.301840 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/f/000.data
2019/10/31 12:37:07.307937 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/2/000.data
2019/10/31 12:37:07.321990 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/1/000.data
2019/10/31 12:37:07.337517 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/0/000.data
2019/10/31 12:37:07.352715 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/d/000.data
2019/10/31 12:37:07.388687 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/6/000.data
2019/10/31 12:37:07.434298 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/9/000.data
2019/10/31 12:37:07.458604 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/e/000.data
2019/10/31 12:37:07.494069 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/a/000.data
2019/10/31 12:37:07.502721 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/a/000.data
2019/10/31 12:37:07.512996 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/c/000.data
2019/10/31 12:37:07.520158 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/8/000.data
2019/10/31 12:37:07.527989 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/a/000.data
2019/10/31 12:37:07.549337 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/8/000.data
2019/10/31 12:37:07.571601 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/e/000.data
2019/10/31 12:37:07.577514 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/3/000.data
2019/10/31 12:37:07.592429 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/c/000.data
2019/10/31 12:37:07.612869 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/e/000.data
2019/10/31 12:37:07.620753 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/8/000.data
2019/10/31 12:37:07.639918 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/6/000.data
2019/10/31 12:37:07.656963 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/a/000.data
2019/10/31 12:37:07.692127 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/3/000.data
2019/10/31 12:37:07.711819 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/a/000.data
2019/10/31 12:37:07.719385 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/f/000.data
2019/10/31 12:37:07.730229 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/f/000.data
2019/10/31 12:37:07.735181 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/1/000.data
2019/10/31 12:37:07.741419 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/4/000.data
2019/10/31 12:37:07.771363 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/4/000.data
2019/10/31 12:37:07.788799 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/b/000.data
2019/10/31 12:37:07.836560 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/4/000.data
2019/10/31 12:37:07.854530 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/d/000.data
2019/10/31 12:37:07.874945 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/3/000.data
2019/10/31 12:37:07.918192 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/9/000.data
2019/10/31 12:37:07.925189 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/f/000.data
2019/10/31 12:37:07.951350 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/8/000.data
2019/10/31 12:37:07.961586 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/b/000.data
2019/10/31 12:37:07.967970 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/9/000.data
2019/10/31 12:37:07.973731 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/8/000.data
2019/10/31 12:37:07.979907 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/7/000.data
2019/10/31 12:37:07.988768 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/f/000.data
2019/10/31 12:37:08.023755 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/4/000.data
2019/10/31 12:37:08.047728 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/0/000.data
2019/10/31 12:37:08.085765 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/4/000.data
2019/10/31 12:37:08.091500 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/a/000.data
2019/10/31 12:37:08.099074 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/b/000.data
2019/10/31 12:37:08.117425 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/f/000.data
2019/10/31 12:37:08.129972 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/7/000.data
2019/10/31 12:37:08.201703 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/2/000.data
2019/10/31 12:37:08.209787 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/0/000.data
2019/10/31 12:37:08.247854 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/3/000.data
2019/10/31 12:37:08.253844 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/1/000.data
2019/10/31 12:37:08.260004 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/7/000.data
2019/10/31 12:37:08.344598 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/1/000.data
2019/10/31 12:37:10.068200 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/2/000.data
2019/10/31 12:37:10.117530 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/e/000.data
2019/10/31 12:37:10.129796 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/d/000.data
2019/10/31 12:37:10.143938 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/c/000.data
2019/10/31 12:37:10.150909 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/b/000.data
2019/10/31 12:37:10.191029 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/a/000.data
2019/10/31 12:37:10.202000 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/b/000.data
2019/10/31 12:37:10.242914 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/e/000.data
2019/10/31 12:37:10.274392 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/2/000.data
2019/10/31 12:37:10.296412 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/0/000.data
2019/10/31 12:37:10.315643 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/0/000.data
2019/10/31 12:37:10.322097 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/d/000.data
2019/10/31 12:37:10.334113 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/c/000.data
2019/10/31 12:37:10.341191 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/a/000.data
2019/10/31 12:37:10.362671 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/e/000.data
2019/10/31 12:37:10.368138 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/d/000.data
2019/10/31 12:37:10.373382 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/5/000.data
2019/10/31 12:37:10.378752 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/9/000.data
2019/10/31 12:37:10.382231 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/4/000.data
2019/10/31 12:37:10.389839 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/f/000.data
2019/10/31 12:37:10.414363 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/7/000.data
2019/10/31 12:37:10.424659 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/e/000.data
2019/10/31 12:37:10.489592 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/1/000.data
2019/10/31 12:37:10.512818 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/c/000.data
2019/10/31 12:37:10.518973 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/7/000.data
2019/10/31 12:37:10.525512 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/0/000.data
2019/10/31 12:37:10.532878 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/f/000.data
2019/10/31 12:37:10.577268 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/d/000.data
2019/10/31 12:37:10.581862 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/e/000.data
2019/10/31 12:37:10.604577 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/3/000.data
2019/10/31 12:37:10.611198 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/0/000.data
2019/10/31 12:37:10.635010 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/3/000.data
2019/10/31 12:37:10.647488 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/b/000.data
2019/10/31 12:37:10.683425 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/e/000.data
2019/10/31 12:37:10.693792 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/e/000.data
2019/10/31 12:37:10.755333 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/1/000.data
2019/10/31 12:37:10.761052 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/3/000.data
2019/10/31 12:37:10.826432 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/e/000.data
2019/10/31 12:37:10.852580 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/2/000.data
2019/10/31 12:37:10.869721 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/1/000.data
2019/10/31 12:37:11.542516 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/6/000.data
2019/10/31 12:37:11.573137 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/d/000.data
2019/10/31 12:37:11.597252 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/9/000.data
2019/10/31 12:37:11.607252 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/5/000.data
2019/10/31 12:37:11.617248 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/2/000.data
2019/10/31 12:37:11.663862 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/5/000.data
2019/10/31 12:37:11.681886 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/9/000.data
2019/10/31 12:37:11.688910 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/f/000.data
2019/10/31 12:37:11.730784 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/9/000.data
2019/10/31 12:37:11.752349 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/c/000.data
2019/10/31 12:37:11.793408 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/7/000.data
2019/10/31 12:37:11.814119 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/4/000.data
2019/10/31 12:37:11.824268 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/8/000.data
2019/10/31 12:37:11.843904 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/8/000.data
2019/10/31 12:37:11.869096 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/a/3/000.data
2019/10/31 12:37:11.874792 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/0/000.data
2019/10/31 12:37:11.880067 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/a/000.data
2019/10/31 12:37:11.987086 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/4/000.data
2019/10/31 12:37:12.042344 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/8/000.data
2019/10/31 12:37:12.061758 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/f/4/000.data
2019/10/31 12:37:12.930919 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/6/000.data
2019/10/31 12:37:12.938131 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/4/000.data
2019/10/31 12:37:12.955717 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/c/000.data
2019/10/31 12:37:13.096146 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/d/000.data
2019/10/31 12:37:13.099338 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/5/000.data
2019/10/31 12:37:13.218680 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/e/000.data
2019/10/31 12:37:13.233444 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/4/000.data
2019/10/31 12:37:13.334588 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/f/000.data
2019/10/31 12:37:13.366117 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/c/000.data
2019/10/31 12:37:13.955297 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/3/000.data
2019/10/31 12:37:13.996687 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/4/000.data
2019/10/31 12:37:14.171686 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/6/000.data
2019/10/31 12:37:14.234319 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/4/000.data
2019/10/31 12:37:14.255767 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/a/000.data
2019/10/31 12:37:14.300322 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/8/000.data
2019/10/31 12:37:14.406592 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/b/000.data
2019/10/31 12:37:14.429494 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/1/000.data
2019/10/31 12:37:14.450812 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/0/000.data
2019/10/31 12:37:16.286586 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/9/000.data
2019/10/31 12:37:16.339352 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/9/000.data
2019/10/31 12:37:16.399546 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/7/000.data
2019/10/31 12:37:16.452209 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/b/e/000.data
2019/10/31 12:37:16.452735 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/7/000.data
2019/10/31 12:37:16.506994 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/6/000.data
2019/10/31 12:37:16.524472 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/c/b/000.data
2019/10/31 12:37:16.600404 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/2/3/000.data
2019/10/31 12:37:16.608844 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/d/0/000.data
2019/10/31 12:37:16.630586 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/7/c/000.data
2019/10/31 12:37:16.763596 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/9/1/000.data
2019/10/31 12:37:16.866979 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/5/f/000.data
2019/10/31 12:37:18.840975 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/9/000.data
2019/10/31 12:37:18.881468 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/c/000.data
2019/10/31 12:37:18.887772 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/4/1/000.data
2019/10/31 12:37:18.908870 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/7/000.data
2019/10/31 12:37:19.310890 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/8/7/000.data
2019/10/31 12:37:20.129442 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/6/000.data
2019/10/31 12:37:21.318987 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/9/000.data
2019/10/31 12:37:21.589530 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/6/1/000.data
2019/10/31 12:37:21.635371 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/e/2/000.data
2019/10/31 12:37:21.642585 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/5/000.data
2019/10/31 12:37:22.711359 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/b/000.data
2019/10/31 12:37:23.545255 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/3/7/000.data
2019/10/31 12:37:23.554311 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/0/b/000.data
2019/10/31 12:37:23.854693 INFO          data.go: 202 - create data file: /home/work/service/gobeansdb_cluster7980/beansdb/1/2/000.data

 

if 0 = -I can
关注
专栏目录
beansdb 分析
PhoneLi的专栏
02-25 5036
beansdb源码分析，结构分析。
beansdb设计与实现
04-19
### BeansDB设计与实现 #### 一、BeansDB概述 BeansDB是一款由豆瓣开发的分布式存储系统，它主要被设计为一种高效的键值(Key-Value)数据库，具有良好的可扩展性和高可用性特点。该系统的目标是提供一个既能够应对...
Python3 BeansDB / GoBeansDB 连接 - libmc 驱动模块
SHOWufei
10-29 301
目录 写在最前： 1、python3_libmc_beansdb.py 2、Python Example 3、Example Results 写在最前： 1>、libmc由 Douban 开发和维护（豆瓣牛B） 协议： memcached。推荐 libmc 客户端（c++ 实现，目前支持 go 和 python，基于 poll 的并发 get_multi/set_multi）...
BeansDB
SHOWufei
08-30 533
目录 BeansDB是什么❓ BeansDB 的 CAP 特点表现为❓ BeansDB 功能组成❓ 服务器端程序实现的功能❓ 核心的 Python 脚本提供的功能❓ 1、proxy.py 2、sync.py BeansDB是什么❓ BeansDB是豆瓣荣誉出品的分布式 key-value 存储系统，该系统是对经典的 Dynamo 的简化。 BeansDB 的 CAP 特点表现...
beansdb测试
SAN_YUN的专栏
10-22 182
[code="python"] from dbclient import Beansdb s1 = "localhost:7100" s2 = "localhost:7101" BEANSDBCFG = { s1: range(16), s2: range(16), } key = 'txt:test' db = Beansdb(BEANSDBCFG, 1...
beansdb介绍
SAN_YUN的专栏
07-06 283
beansdb -d -f 1 -n 200 -p 7700 -H /data2/mediadb/ -u admin -L /duitang/logs/usr/beansdb.log   http://xumingming.sinaapp.com/280/beansdb-source-code-analysis-sync-py/   豆瓣beansdb源码浅析:  http://www...
Inside BeansDB
01-05
BeansDB的数据迁移过程相对简单，可以直接拷贝数据和HashTree文件，不过当前版本需要暂时关闭正常的数据库节点以确保数据一致性。在故障恢复方面，BeansDB通过多副本和数据冗余策略，确保即使在部分节点故障的情况下...
beansdb-0.5.3-中文源注释[Original].rar
03-17
这是本人花了几天的时间对 目前beansdb的源代码进行的分析，其中核心部分每一行都有详细注释。详细注释的文件有htree.c hstore.c bitcask.c record.c beansdb.c，其它部分注释的比较少。因为其它部分不会影响我们的...
Inside-BeansDB.rar_inside
09-24
综上所述，BeansDB是一个面向大数据的分布式键值存储解决方案，它通过HashTree实现数据校验和一致性，使用简化版本号管理以确保最终一致性，以及运用一致性哈希和多副本策略来保证高可用性和扩展性。对于那些需要...
已存档，请参阅GoBeansDB。-C/C++开发
05-26
Beansdb是为大型在线系统设计的分布式键值存储系统，旨在实现高可用性和易于管理。 它采用了Amazon Dynamo的想法，然后进行了简化以保留“什么是Beansdb”？ Beansdb是为大型在线系统设计的分布式键值存储系统，旨在...
Go-GoBeansDB来自豆瓣的分布式键值key-value存储系统
08-13
GoBeansDB：来自豆瓣的分布式键值key-value存储系统
开源项目-douban-gobeansdb.zip
10-15
开源项目-douban-gobeansdb.zip,GoBeansDB - A High performance distributed object storage server from Douban Inc.
BeansDB简单了解
老付
11-12 241
    1. 使用算法hash, bucket, btree. 2. 独立存储节点，独立数据目录,bucket扩展 3. 可靠性保证：多机冗余（N＝3），同步写（同时想多个节点写，写成功2个节点即可），依次读 4. 一致性（最终一致性） 用Hash tree的数据结构做节点数据同步 存储引擎：没有使用TokyoCabinet，BerkeleyDB，使用了Bitcask存储算法 通过...
【noqsl】beansdb的分布式实现～简单粗暴有效～
weixin_34198762的博客
05-07 98
版本: beansdb 0.5.3 下载地点：http://code.google.com/p/beansdb/ beansdb是豆瓣用来存储不变小object的支持中等数据规模的nosql的持久型数据库～跟memcache相比，主要特点如下 1. 数据是持久化的，value 完全在硬盘上操作，内存中只存放key的hash索引 2. 在持久化的基础上，为了提高可靠性，一份数据可以设置...
BeansDB: 分布式KV存储系统
最新发布
gitblog_00046的博客
03-16 411
BeansDB: 分布式KV存储系统 BeansDB 是一款由豆瓣开发的分布式键值对存储系统。它基于LSM树（Log-Structured Merge Tree）算法实现，并针对大规模数据集和高并发读写场景进行了优化。 什么是BeansDB？ BeansDB的设计目标是为云计算环境中的海量数据提供高效、稳定且易于扩展的存储解决方案。它主要适用于以下场景： 内容缓存：如图片、文件等静态资源的存储与...
BeansDB学习笔记
NeeMo——仗剑走天涯
08-14 2591
BeansDB是豆瓣的刘洪清大哥写的一个分布式存储系统。关于它的详细介绍可以参看 http://www.douban.com/note/122507891/  同时InfoQ中还有刘洪清大哥的演讲视频及资料：http://www.infoq.com/cn/presentations/lhq-beansdb-design-implementation BeansDB是一个简化了的D
beansdb 结构简单描述
PhoneLi的专栏
02-18 2930
beansdb是豆瓣的key-value分布式系统 beansdb可以部署在多个节点上。有proxy集中管理。方便简单。 beansdb结构： Hstore{     (节点)0 ～ （节点E）；     每个节点默认16开，即0～F号biscask；     每个biscask有一个hash tree做索引； } 大概如上结构。
[转]豆瓣beansdb浅析
heiyeluren的blog（黑夜路人的开源世界）
08-06 4565
作者：tos 来源：http://hi.baidu.com/dongliqian/item/21e2fb1d07d3fc7a7a5f2565  豆瓣beansdb浅析 (1) 一直以来对这种分布式的东西就非常好奇，很想学习一下它们究竟是如何是实现的,于是决定从实现相对比较简单的beansdb开始。 beansdb是豆瓣的一位工程师借鉴memcache开发的分布式的
beansdb的性能测试
SAN_YUN的专栏
03-21 243
最近对beansdb做了一次性能测试，结果性能一般，下面是我的测试过程。   1. 启动beansdb server /duitang/dist/sys/beansdb/bin/beansdb -d -H /duitang/data/test-beansdb   2. 往beansdb set 30000条数据 from beansdb.dbclient import Bean...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值