ubuntu安装milvus、可视化

最新推荐文章于 2024-05-17 18:17:01 发布
最新推荐文章于 2024-05-17 18:17:01 发布
阅读量643 收藏 6
点赞数 6
分类专栏： 软件安装&使用 文章标签： milvus
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_51133173/article/details/137941959
版权

目录

docker安装milvus

拉取cpu版milvus镜像

查看milvus镜像

准备配置文件

新建3个文件夹

启动milvus镜像

查看milvus容器

可视化

拉取milvus-em镜像

查看镜像

启动镜像

浏览器查看

按id搜向量

docker安装milvus

拉取cpu版milvus镜像
sudo docker pull milvusdb/milvus:1.1.0-cpu-d050721-5e559c
查看milvus镜像

准备配置文件

准备server config文件：https://raw.githubusercontent.com/milvus-io/milvus/v1.1.0/core/conf/demo/server_config.yaml

链接打不开的话直接使用下面文件：server_config.yaml

      
# Copyright (C) 2019-2020 Zilliz. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software distributed under the License
# is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express
# or implied. See the License for the specific language governing permissions and limitations under the License.

version: 0.5

#----------------------+------------------------------------------------------------+------------+-----------------+
# Cluster Config       | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# enable               | If runinng with Mishards, set true, otherwise false.       | Boolean    | false           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# role                 | Milvus deployment role: rw / ro                            | role       | rw              |
#----------------------+------------------------------------------------------------+------------+-----------------+
cluster:
  enable: false
  role: rw

#----------------------+------------------------------------------------------------+------------+-----------------+
# General Config       | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# time_zone            | Use UTC-x or UTC+x to specify a time zone.                 | Timezone   | UTC+8           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# meta_uri             | URI for metadata storage, using SQLite (for single server  | URL        | sqlite://:@:/   |
#                      | Milvus) or MySQL (for distributed cluster Milvus).         |            |                 |
#                      | Format: dialect://username:password@host:port/database     |            |                 |
#                      | Keep 'dialect://:@:/', 'dialect' can be either 'sqlite' or |            |                 |
#                      | 'mysql', replace other texts with real values.             |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
general:
  timezone: UTC+8
  meta_uri: sqlite://:@:/

#----------------------+------------------------------------------------------------+------------+-----------------+
# Network Config       | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# bind.address         | IP address that Milvus server monitors.                    | IP         | 0.0.0.0         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# bind.port            | Port that Milvus server monitors. Port range (1024, 65535) | Integer    | 19530           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# http.enable          | Enable web server or not.                                  | Boolean    | true            |
#----------------------+------------------------------------------------------------+------------+-----------------+
# http.port            | Port that Milvus web server monitors.                      | Integer    | 19121           |
#                      | Port range (1024, 65535)                                   |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
network: 
  bind.address: 0.0.0.0
  bind.port: 19530
  http.enable: true
  http.port: 19121

#----------------------+------------------------------------------------------------+------------+-----------------+
# Storage Config       | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# path                 | Path used to save meta data, vector data and index data.   | Path       | /var/lib/milvus |
#----------------------+------------------------------------------------------------+------------+-----------------+
# auto_flush_interval  | The interval, in seconds, at which Milvus automatically    | Integer    | 1 (s)           |
#                      | flushes data to disk.                                      |            |                 |
#                      | 0 means disable the regular flush.                         |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
storage:
  path: /var/lib/milvus
  auto_flush_interval: 1

#----------------------+------------------------------------------------------------+------------+-----------------+
# WAL Config           | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# enable               | Whether to enable write-ahead logging (WAL) in Milvus.     | Boolean    | true            |
#                      | If WAL is enabled, Milvus writes all data changes to log   |            |                 |
#                      | files in advance before implementing data changes. WAL     |            |                 |
#                      | ensures the atomicity and durability for Milvus operations.|            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# recovery_error_ignore| Whether to ignore logs with errors that happens during WAL | Boolean    | false           |
#                      | recovery. If true, when Milvus restarts for recovery and   |            |                 |
#                      | there are errors in WAL log files, log files with errors   |            |                 |
#                      | are ignored. If false, Milvus does not restart when there  |            |                 |
#                      | are errors in WAL log files.                               |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# buffer_size          | Sum total of the read buffer and the write buffer in MBs.  | Integer    | 256 (MB)        |
#                      | buffer_size must be in range [64, 4096] (MB).              |            |                 |
#                      | If the value you specified is out of range, Milvus         |            |                 |
#                      | automatically uses the boundary value closest to the       |            |                 |
#                      | specified value. It is recommended you set buffer_size to  |            |                 |
#                      | a value greater than the inserted data size of a single    |            |                 |
#                      | insert operation for better performance.                   |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# path                 | Location of WAL log files.                                 | String     |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
wal:
  enable: true
  recovery_error_ignore: false
  buffer_size: 256MB
  path: /var/lib/milvus/wal

#----------------------+------------------------------------------------------------+------------+-----------------+
# Cache Config         | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# cache_size           | The size of CPU memory used for caching data for faster    | Integer    | 4 (GB)          |
#                      | query. The sum of 'cpu_cache_capacity' and                 |            |                 |
#                      | 'insert_buffer_size' must be less than system memory size. |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# insert_buffer_size   | Buffer size used for data insertion.                       | Integer    | 1 (GB)          |
#                      | The sum of 'insert_buffer_size' and 'cpu_cache_capacity'   |            |                 |
#                      | must be less than system memory size.                      |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# preload_collection   | A comma-separated list of collection names that need to    | StringList |                 |
#                      | be pre-loaded when Milvus server starts up.                |            |                 |
#                      | '*' means preload all existing tables (single-quote or     |            |                 |
#                      | double-quote required).                                    |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
cache:
  cache_size: 4GB
  insert_buffer_size: 1GB
  preload_collection:

#----------------------+------------------------------------------------------------+------------+-----------------+
# GPU Config           | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# enable               | Enable GPU resources or not.                               | Boolean    | false           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# cache_size           | The size of GPU memory per card used for cache.            | Integer    | 1 (GB)          |
#----------------------+------------------------------------------------------------+------------+-----------------+
# gpu_search_threshold | A Milvus performance tuning parameter. This value will be  | Integer    | 1000            |
#                      | compared with 'nq' to decide if the search computation will|            |                 |
#                      | be executed on GPUs only.                                  |            |                 |
#                      | If nq >= gpu_search_threshold, the search computation will |            |                 |
#                      | be executed on GPUs only;                                  |            |                 |
#                      | if nq < gpu_search_threshold, the search computation will  |            |                 |
#                      | be executed on CPUs only.                                  |            |                 |
#                      | The SQ8H index is special, if nq < gpu_search_threshold,   |            |                 |
#                      | the search will be executed on both CPUs and GPUs.         |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# search_resources     | The list of GPU devices used for search computation.       | DeviceList | gpu0            |
#                      | Must be in format gpux.                                    |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# build_index_resources| The list of GPU devices used for index building.           | DeviceList | gpu0            |
#                      | Must be in format gpux.                                    |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
gpu:
  enable: false
  cache_size: 1GB
  gpu_search_threshold: 1000
  search_devices:
    - gpu0
  build_index_devices:
    - gpu0

#----------------------+------------------------------------------------------------+------------+-----------------+
# FPGA Config           | Description                                               | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# enable               | Use FPGA devices or not.                                   | Boolean    | false           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# search_devices       | The list of FPGA devices used for search computation.      | DeviceList | fpga0           |
#                      | Must be in format fpgax.                                   |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
fpga:
   enable: false
   search_devices:
     - fpga0

#----------------------+------------------------------------------------------------+------------+-----------------+
# Logs Config          | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# level                | Log level in Milvus. Must be one of debug, info, warning,  | String     | debug           |
#                      | error, fatal                                               |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# trace.enable         | Whether to enable trace level logging in Milvus.           | Boolean    | true            |
#----------------------+------------------------------------------------------------+------------+-----------------+
# path                 | Absolute path to the folder holding the log files.         | String     |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# max_log_file_size    | The maximum size of each log file, size range [512, 4096]  | Integer    | 1024 (MB)       |
#----------------------+------------------------------------------------------------+------------+-----------------+
# log_rotate_num       | The maximum number of log files that Milvus keeps for each | Integer    | 0               |
#                      | logging level, num range [0, 1024], 0 means unlimited.     |            |                 |
#----------------------+------------------------------------------------------------+------------+-----------------+
# log_to_stdout        | Whether to write logs to standard output in Milvus.        | Boolean    | false           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# log_to_file          | Whether to write logs to files in Milvus                   | Boolean    | true            |
#----------------------+------------------------------------------------------------+------------+-----------------+
logs:
  level: debug
  trace.enable: true
  path: /var/lib/milvus/logs
  max_log_file_size: 1024MB
  log_rotate_num: 0
  log_to_stdout: false
  log_to_file: true

#----------------------+------------------------------------------------------------+------------+-----------------+
# Metric Config        | Description                                                | Type       | Default         |
#----------------------+------------------------------------------------------------+------------+-----------------+
# enable               | Enable monitoring function or not.                         | Boolean    | false           |
#----------------------+------------------------------------------------------------+------------+-----------------+
# address              | Pushgateway address                                        | IP         | 127.0.0.1       +
#----------------------+------------------------------------------------------------+------------+-----------------+
# port                 | Pushgateway port, port range (1024, 65535)                 | Integer    | 9091            |
#----------------------+------------------------------------------------------------+------------+-----------------+
metric:
  enable: false
  address: 127.0.0.1
  port: 9091

milvus数据存储、日志、配置文件路径如下

新建3个文件夹

  • conf: 存放配置文件

  • db: 存放数据

  • logs: 存放日志

当前目录结构如下

启动milvus镜像

  • 将刚才新建的3个文件夹目录映射到milvus容器

  • 宿主机的2个端口号 映射到 milvus容器

sudo docker run -d --name milvus \
> -p 19530:19530 \
> -p 19121:19121 \
> -v /xx/conf:/var/lib/milvus/conf \
> -v /xx/db:/var/lib/milvus/db \
> -v /xx/logs:/var/lib/milvus/logs \
> milvusdb/milvus:1.1.0-cpu-d050721-5e559c
查看milvus容器
sudo docker ps

可视化

拉取milvus-em镜像
sudo docker pull milvusdb/milvus-em:v0.4.2
查看镜像

启动镜像
sudo docker run -d --name milvus-em -p 3000:80 milvusdb/milvus-em:v0.4.2

查看容器

sudo docker ps
浏览器查看

按id搜向量

Universe-hello
关注
  • 6
    点赞
  • 踩
  • 6
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
专栏目录
ModaHub魔搭社区：可视化的AI原生云向量数据库 Milvus 2.2.9 ：JSON、PartitionKey、Dynamic Schema
LCHub低代码社区
07-06 707
随着 LLM 的持续火爆，众多应用开发者将目光投向了向量数据库领域，而。本次新版本不仅可以，还增加了等，也增加了一些类似“支持用户自定义 task 调度策略”的小功能。此外，我们也进行了部分优化，例如优等。总体而言，拥有诸多新特性加持的 Milvus 2.2.9 不仅满足了社区用户的迫切需求，也在一定程度上降低了用户的使用门槛，使用体验拉满！本文将带大家全方位解读 Milvus 2.2.9 的新特性，前方丰富信息量预警……图片。
milvus向量数据库离线安装
08-24
milvus向量数据库离线安装
基于ubuntu20.04docker安装milvus2.3及attu可视化工具
IT大头的博客
10-11 1513
docker快速部署milvus2.x版本及可视化工具
向量数据库Milvus安装教程,统信UOS离线服务器基于Docker安装(Milvus v2.4.0)
qq_44754301的博客
05-17 798
Milvus支持基于Kubernetes或Docker Compose安装, 最新2.4.x版本仅需要Docker即可, 本文示例为基于Docker的单机部署, 提供在线和离线方案.笔者在统信UOS-1041验证过下述安装流程可用, 故此分享, 仅供参考Milvus对硬件有一定要求,具体见表格清单要求建议注意中央处理器Intel 第二代酷睿 CPU 或更高;Apple 芯片单机：4 核或更多;集群：8核以上CPU 指令集SSE4.2;AVX;AVX2;
大模型必备向量数据库-Milvus的安装过程
xian0710830114的专栏
02-24 2561
Milvus是一个开源的向量相似度搜索引擎，专注于大规模向量数据的快速相似度搜索。本文将介绍Milvus的安装，跟着走，肯定能装上(#^.^#)
在ubuntu上搭建Milvus的以图搜图服务
qq_40396104的博客
08-18 499
在ubuntu上搭建Milvus的以图搜图服务
milvus可视化，增删查改api，元数据mysql理解
qq_15821487的博客
02-23 2049
官网：https://milvus.io/ 安装文档：https://milvus.io/cn/docs/v1.1.1/milvus_docker-cpu.md 可视化：https://zilliz.com/products/em CURD API文档来表示 增加:Create 修改:Update 查找:Read 删除:Delete 外 代码文档api:https://milvus.io/cn/api-reference/pymilvus/v1.1.2/api.html 函数说明：https://milvu
Ubuntu18.04 Docker Docker-Compose MySQL Milvus安装指南
Andrwin的博客
04-29 733
ubuntu18.04安装Docker和Docker-compose
源码编译部署篇（一）成功安装Milvus!零基础Ubuntu部署安装Milvus教程
qq_43893755的博客
01-02 2473
网上可参考的Milvus源码安装教程资料太少，且不全，会缺少很多依赖安装，导致最后编译安装会遇到很多问题，在此，整理自己源码编译安装的全过程，方便日后查看。
Milvus可视化Zilliz以及Grafana展示 Milvus监控指标 安装步骤
qq_15821487的博客
02-21 2612
官网：https://milvus.io/ 安装文档：https://milvus.io/cn/docs/v1.1.1/milvus_docker-cpu.md 可视化：https://zilliz.com/products/em 步骤一 docker pull milvusdb/milvus-em:v0.4.2 步骤二 docker run -d -p 3000:80 milvusdb/milvus-em:v0.4.2 步骤三 访问 http://localhost:3000/ 步骤四 根据容器端口
一文带你入门向量数据库milvus：含docker安装、milvus安装使用、attu 可视化，完整指南启动 Milvus 进行了向量相似度搜索
热门推荐
丨汀、的博客
07-21 3万+
一文带你入门向量数据库milvus：含docker安装、milvus安装使用、attu 可视化，完整指南启动 Milvus 进行了向量相似度搜索
Milvus可视化工具Attu的Windows安装包
04-18
Milvus可视化工具Attu的Windows安装包
milvus安装资源以及zilliz安装资源
05-17
milvus 版本2.1.4 安装部署 前提，安装好docker 1、docker load -i xxx.tar 解压资源包 2、./conder-compose up -d //用docker-compost直接启动 3、docker run -itd --restart=always -p 13000:3000 -e HOST_URL=...
Milvus安装工具包
最新发布
06-12
Milvus安装工具包
docs：Milvus文档
02-23
Milvus文档 该存储库包含技术文档， 是设计的开源矢量相似度搜索引擎。 可以在上找到最新的技术文档。 请注意，并非该存储库中存在网站上的所有文档。 一些项目具有自己的独立存储库和特定于项目的文档。 欢迎大家...
ubantu20.04-milvus源码编译安装
jiangxuzheng的博客
09-11 379
将go1.18.linux-amd64.tar.gz上传到/data目录下。过程非常漫长，需要耐心等待~~~~~~~~~~~~~~~~对应出现报错问题，我们需要通过apt-get安装依赖库。但是有些c++库缺少，需要apt进来。到这里我们的工作完成了80%了。从官网下载go1.18压缩包。需要下载googletest。4、安装protobuf。6、下载milvus源码。，这里直接下载最新的。上传到/data下面。
Milvus 安装与配置
沛哥儿的专栏
05-15 593
Milvus 的安装与配置是一个涉及环境准备、安装步骤和配置优化的过程。通过 Docker 或源码编译安装 Milvus，并根据系统资源和需求进行配置优化。确保安全性，并利用官方文档和社区资源以获得更好的支持。
【向量数据库】向量数据库Milvus及可视化界面attu的安装、启动
weixin_62645763的博客
11-05 3386
记录总结一下自己安装配置启动milvus及其可视化界面attu的过程，我觉得还是比较简单清晰的
安装Milvus的可视化工具Attu教程
Sonsay的专栏
04-18 995
至此安装完成！浏览器输入地址 http:127.0.0.1:8000即可访问。
windows安装milvus 可视化
08-14
您可以按照以下步骤在 Windows 上安装 Milvus 可视化界面： 1. 首先，确保您已经成功安装并启动了 Milvus 数据库。您可以使用 Docker 命令来启动 Milvus，具体命令如下： ``` docker run -d --name milvus_cpu -p 19530:19530 -p 19121:19121 -p 9091:9091 -v C:\milvus\db:/var/lib/milvus/db -v C:\milvus\conf:/var/lib/milvus/conf -v C:\milvus\logs:/var/lib/milvus/logs -v C:\milvus\wal:/var/lib/milvus/wal milvusdb/milvus:0.8.0-cpu-d041520-464400 ``` 这个命令会将 Milvus 文件映射到您本地的文件路径。 2. 接下来，您需要下载并安装 Milvus 可视化界面工具。您可以从 Milvus 的官方 GitHub 仓库中下载最新版本的 Milvus 可视化工具。 3. 下载完成后，解压缩文件，并在命令提示符中进入解压缩后的目录。 4. 运行以下命令来启动 Milvus 可视化界面工具： ``` python app.py ``` 这将启动一个本地服务器，并将 Milvus 可视化界面工具在默认端口上运行。 5. 打开您的浏览器，并访问 `http://localhost:5000`，即可进入 Milvus 可视化界面。 请注意，这只是 Milvus 可视化界面的基本安装步骤。具体的安装步骤可能因为 Milvus 版本的不同而有所变化，建议您参考 Milvus 的官方文档以获取最准确的安装指南。<span class="em">1</span><span class="em">2</span><span class="em">3</span> #### 引用[.reference_title] - *1* [Milvus Windows](https://blog.csdn.net/jacke121/article/details/109062927)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"] - *2* *3* [milvus实战 | docker部署单机版](https://blog.csdn.net/xd15074483478/article/details/129628757)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"] [ .reference_list ]

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值