云端对象存储
阿里云配置连接到OSS存储桶
新建用户
创建用户 配置AK 权限只赋予你要上传的桶
策略:
{
"Version": "1",
"Statement": [
{
"Effect": "Allow",
"Action": "oss:*",
"Resource": [
"acs:oss:*:*:oss桶名称",
"acs:oss:*:*:oss桶名称/*"
]
}
]
}
生成的AK
AccessKey ID
AccessKey Secret
安装ossutil64 软件
官方文档:https://help.aliyun.com/zh/oss/developer-reference/configure-ossutil?spm=a2c4g.11186623.0.0.405c5e2ea45Q1O#section-jbl-p9e-h40
cd /opt
wget https://gosspublic.alicdn.com/ossutil/1.7.13/ossutil64
chmod 755 ossutil64
./ossutil64 config #交互式配置生成配置文件 或者 vim /root/.ossutilconfig
cp /opt/ossutil64 /usr/local/bin #可以在任意目录下执行,不复制只能在/opt执行
输入 endpoint 以及AK
ossutil64 cp /opt/test.log oss://sgm-logs/jumpserver_log/ #测试上传本地文件到桶的jumpserver_log/目录下
同账户下相同地域OSS复制
因配置文件配置的是终结点,终结点默认是根据地域来的,该地域下的桶都能看到(根据RAM授权规则来)
ossutil64 -c bucketcof cp oss://Abucket/test oss://Bbucket -r
增量备份日志上传到存储桶
ossutil64 cp -r /opt/test/ oss://sgm-logs/test/ --meta X-oss-Storage-Class:IA --snapshot-path=path
#递归复制本地/opt/test/ 目录下所有文件到sgm-logs桶的test/目录下
#--meta X-oss-Storage-Class:IA 指定上传文件存储类型为低频访问存储
#--snapshot-path=path 指定为增量上传,下次执行该命令将会忽略已上传的文件
59 23 * * * ossutil64 cp -r /opt/test/ oss://sgm-logs/test/ --meta X-oss-Storage-Class:IA --snapshot-path=path
#创建计划任务每天晚上11点59执行上传到oss存储桶命令
图形化管理OSS
https://help.aliyun.com/zh/oss/developer-reference/install-and-log-on-to-ossbrowser?spm=a2c4g.11186623.0.0.123b3000zbym83
Azure VM连接blob
https://docs.azure.cn/zh-cn/storage/blobs/storage-how-to-mount-container-linux
存储账号由以下界面提供
cat /etc/os-release
sudo rpm -Uvh https://packages.microsoft.com/config/rhel/7/packages-microsoft-prod.rpm
sudo yum install blobfuse -y
mkdir /storageaccount/resource/blobfusetmp -p
chown root.root /mnt/resource/blobfusetmp
vim /root/fuse_connection.cfg
accountName test #存储账户名称
accountKey 07LLarfm6RATPd7uqBo3DlBgTQiCTan #存储账户访问密钥
containerName mysqldump #blob容器名称
blobEndpoint test.blob.core.chinacloudapi.cn # 终结点
chmod 600 /root/fuse_connection.cfg
mkdir /storageaccount/mysqldump #创建与容器相通的目录
#指定的blob容器装载到 /storageaccount/mysqldump
blobfuse /storageaccount/mysqldump --tmp-path=/storageaccount/resource/blobfusetmp --config-file=/root/fuse_connection.cfg -o attr_timeout=240 -o entry_timeout=240 -o negative_timeout=120
编辑/etc/fstab 持久化挂载
vim /etc/fstab
在末尾添加
blobfuse /storageaccount/mysqldump fuse defaults,_netdev,--tmp-path=/storageaccount/resource/blobfusetmp,--config-file=/root/fuse_connection.cfg,--log-level=LOG_DEBUG,allow_other 0 0
检查挂载情况
mount -v -a #检查文件语法
mount -a #测试挂载
dmesg | grep -i mount # 检查系统日志文件以获取挂载的详细信息
解除挂载:
df -Th #查看挂载的blob
cd ~
umount /storageaccount/wecomstorage
移除/etc/fstab 文件blobfuse 这一行
图形化管理blob
Microsoft Azure Storage Explorer
腾讯云COS-CLI 连接到对象存储
https://cloud.tencent.com/document/product/436/63143
wget https://github.com/tencentyun/coscli/releases/download/v0.13.0-beta/coscli-linux
mv coscli-linux coscli
chmod 755 coscli
coscli version v0.13.0-beta #查看是否安装成功
./coscli config init #交互式地生成配置文件
cos:
base:
secretid: XXXXXXXXXXXXXXX
secretkey: XXXXXXXXXXXXXXXXX
sessiontoken: ""
protocol: https
buckets:
- name: examplebucket1-1250000000
alias: bucket1
region: ap-shanghai
endpoint: cos.ap-shanghai.myqcloud.com
ofs: false
- name: examplebucket2-1250000000
alias: bucket2
region: ap-guangzhou
endpoint: cos.ap-guangzhou.myqcloud.com
ofs: false
- name: examplebucket3-1250000000
alias: bucket3
region: ap-chengdu
endpoint: cos.ap-chengdu.myqcloud.com
ofs: false
图形化管理
https://cloud.tencent.com/document/product/436/11366