docker-镜像注册中心-harbor实践
前言
- docker官方的registry虽然提供了私有仓库的能力,但易用性来说还是不太友好,没有仓库的管理中心,操作起来也不方便
- Harbor是一个用于存储Docker镜像的企业级Registry服务
- 除了提供可视化管理界面外,还有其他更多功能
- github地址为 https://github.com/goharbor/harbor ,github上有详细的安装说明
- 本文将以harbor的安装为例进行实践
安装前注意
- harbor默认使用80端口(想要修改也是可以的,通过修改docker-compose.yml和harbor.cfg),因此请保证80端口不会被占用(如果不想使用80端口那么请先查看本文中的端口修改此节的内容,否则修改端口意味着又要重新部署)
- harbor安装过程会安装如下镜像,因此注意原有的镜像不要与harbor的同名,否则会导致安装失败
- goharbor/nginx-photon
- goharbor/harbor-portal
- goharbor/harbor-core
- goharbor/harbor-db
- goharbor/harbor-registryctl
- goharbor/registry-photon
- goharbor/harbor-log
- goharbor/harbor-jobservice
- goharbor/redis-photon
- 需要提前安装docker-compose :https://docs.docker.com/compose/install/
- 但是docker-compose如果不科学上网那基本是下不下来的
sudo curl -L "https://github.com/docker/compose/releases/download/1.24.0/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose sudo chmod +x /usr/local/bin/docker-compose sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose docker-compose --version
安装
-
对于harbor的安装github上已有比较详细的说明 :https://github.com/goharbor/harbor/blob/master/docs/installation_guide.md ,如果不看官方说明,也可以按照我下面的流程安装
-
下载在线版到本地,版本号请根据实际情况修改
wget -c https://storage.googleapis.com/harbor-releases/release-1.7.0/harbor-online-installer-v1.7.5.tgz
-
解压
tar xvf harbor-online-installer-<version>.tgz
-
打开./harbor/harbor.cfg,主要修改hostname为本机ip,其余基本保持默认
-
以下是harbor.cfg文件的内容
## Configuration file of Harbor #This attribute is for migrator to detect the version of the .cfg file, DO NOT MODIFY! _version = 1.7.0 #The IP address or hostname to access admin UI and registry service. #DO NOT use localhost or 127.0.0.1, because Harbor needs to be accessed by external clients. #DO NOT comment out this line, modify the value of "hostname" directly, or the installation will fail. hostname = 192.168.25.215 #The protocol for accessing the UI and token/notification service, by default it is http. #It can be set to https if ssl is enabled on nginx. ui_url_protocol = http #Maximum number of job workers in job service max_job_workers = 10 #Determine whether or not to generate certificate for the registry's token. #If the value is on, the prepare script creates new root cert and private key #for generating token to access the registry. If the value is off the default key/cert will be used. #This flag also controls the creation of the notary signer's cert. customize_crt = on #The path of cert and key files for nginx, they are applied only the protocol is set to https ssl_cert = /data/cert/server.crt ssl_cert_key = /data/cert/server.key #The path of secretkey storage secretkey_path = /data #Admiral's url, comment this attribute, or set its value to NA when Harbor is standalone admiral_url = NA #Log files are rotated log_rotate_count times before being removed. If count is 0, old versions are removed rather than rotated. log_rotate_count = 50 #Log files are rotated only if they grow bigger than log_rotate_size bytes. If size is followed by k, the size is assumed to be in kilobytes. #If the M is used, the size is in megabytes, and if G is used, the size is in gigabytes. So size 100, size 100k, size 100M and size 100G #are all valid. log_rotate_size = 200M #Config http proxy for Clair, e.g. http://my.proxy.com:3128 #Clair doesn't need to connect to harbor internal components via http proxy. http_proxy = https_proxy = no_proxy = 127.0.0.1,localhost,core,registry #NOTES: The properties between BEGIN INITIAL PROPERTIES and END INITIAL PROPERTIES #only take effect in the first boot, the subsequent changes of these properties #should be performed on web ui #************************BEGIN INITIAL PROPERTIES************************ #Email account settings for sending out password resetting emails. #Email server uses the given username and password to authenticate on TLS connections to host and act as identity. #Identity left blank to act as username. email_identity = email_server = smtp.mydomain.com email_server_port = 25 email_username = sample_admin@mydomain.com email_password = abc email_from = admin <sample_admin@mydomain.com> email_ssl = false email_insecure = false ##The initial password of Harbor admin, only works for the first time when Harbor starts. #It has no effect after the first launch of Harbor. #Change the admin password from UI after launching Harbor. harbor_admin_password = Harbor12345 ##By default the auth mode is db_auth, i.e. the credentials are stored in a local database. #Set it to ldap_auth if you want to verify a user's credentials against an LDAP server. auth_mode = db_auth #The url for an ldap endpoint. ldap_url = ldaps://ldap.mydomain.com #A user's DN who has the permission to search the LDAP/AD server. #If your LDAP/AD server does not support anonymous search, you should configure this DN and ldap_search_pwd. #ldap_searchdn = uid=searchuser,ou=people,dc=mydomain,dc=com #the password of the ldap_searchdn #ldap_search_pwd = password #The base DN from which to look up a user in LDAP/AD ldap_basedn = ou=people,dc=mydomain,dc=com #Search filter for LDAP/AD, make sure the syntax of the filter is correct. #ldap_filter = (objectClass=person) # The attribute used in a search to match a user, it could be uid, cn, email, sAMAccountName or other attributes depending on your LDAP/AD ldap_uid = uid #the scope to search for users, 0-LDAP_SCOPE_BASE, 1-LDAP_SCOPE_ONELEVEL, 2-LDAP_SCOPE_SUBTREE ldap_scope = 2 #Timeout (in seconds) when connecting to an LDAP Server. The default value (and most reasonable) is 5 seconds. ldap_timeout = 5 #Verify certificate from LDAP server ldap_verify_cert = true #The base dn from which to lookup a group in LDAP/AD ldap_group_basedn = ou=group,dc=mydomain,dc=com #filter to search LDAP/AD group ldap_group_filter = objectclass=group #The attribute used to name a LDAP/AD group, it could be cn, name ldap_group_gid = cn #The scope to search for ldap groups. 0-LDAP_SCOPE_BASE, 1-LDAP_SCOPE_ONELEVEL, 2-LDAP_SCOPE_SUBTREE ldap_group_scope = 2 #Turn on or off the self-registration feature self_registration = on #The expiration time (in minute) of token created by token service, default is 30 minutes token_expiration = 30 #The flag to control what users have permission to create projects #The default value "everyone" allows everyone to creates a project. #Set to "adminonly" so that only admin user can create project. project_creation_restriction = everyone #************************END INITIAL PROPERTIES************************ #######Harbor DB configuration section####### #The address of the Harbor database. Only need to change when using external db. db_host = postgresql #The password for the root user of Harbor DB. Change this before any production use. db_password = root123 #The port of Harbor database host db_port = 5432 #The user name of Harbor database db_user = postgres ##### End of Harbor DB configuration####### ##########Redis server configuration.############ #Redis connection address redis_host = redis #Redis connection port redis_port = 6379 #Redis connection password redis_password = #Redis connection db index #db_index 1,2,3 is for registry, jobservice and chartmuseum. #db_index 0 is for UI, it's unchangeable redis_db_index = 1,2,3 ########## End of Redis server configuration ############ ##########Clair DB configuration############ #Clair DB host address. Only change it when using an exteral DB. clair_db_host = postgresql #The password of the Clair's postgres database. Only effective when Harbor is deployed with Clair. #Please update it before deployment. Subsequent update will cause Clair's API server and Harbor unable to access Clair's database. clair_db_password = root123 #Clair DB connect port clair_db_port = 5432 #Clair DB username clair_db_username = postgres #Clair default database clair_db = postgres #The interval of clair updaters, the unit is hour, set to 0 to disable the updaters. clair_updaters_interval = 12 ##########End of Clair DB configuration############ #The following attributes only need to be set when auth mode is uaa_auth uaa_endpoint = uaa.mydomain.org uaa_clientid = id uaa_clientsecret = secret uaa_verify_cert = true uaa_ca_cert = /path/to/ca.pem ### Harbor Storage settings ### #Please be aware that the following storage settings will be applied to both docker registry and helm chart repository. #registry_storage_provider can be: filesystem, s3, gcs, azure, etc. registry_storage_provider_name = filesystem #registry_storage_provider_config is a comma separated "key: value" pairs, e.g. "key1: value, key2: value2". #To avoid duplicated configurations, both docker registry and chart repository follow the same storage configuration specifications of docker registry. #Refer to https://docs.docker.com/registry/configuration/#storage for all available configuration. registry_storage_provider_config = #registry_custom_ca_bundle is the path to the custom root ca certificate, which will be injected into the truststore #of registry's and chart repository's containers. This is usually needed when the user hosts a internal storage with self signed certificate. registry_custom_ca_bundle = #If reload_config=true, all settings which present in harbor.cfg take effect after prepare and restart harbor, it overwrites exsiting settings. #reload_config=true #Regular expression to match skipped environment variables #skip_reload_env_pattern=(^EMAIL.*)|(^LDAP.*)
-
保存后执行install.sh即会进入安装过程,此过程会创建文件等,因此需要有权限,加上sudo
-
可以看到安装过程中会从dockerhub拉取相关镜像,如果某些镜像网络原因下载失败,则再次执行install.sh尝试即可
-
当看到如下提示即表示安装成功
✔ ----Harbor has been installed and started successfully.---- Now you should be able to visit the admin portal at http://192.168.25.215. For more details, please visit https://github.com/goharbor/harbor .
-
此时打开(ip地址根据实际情况修改) http://192.168.25.215,默认用户/密码为 admin/Harbor12345,登录成功,表示大功告成,鼓掌鼓掌
数据持久化
- 你一定会有疑惑,如果harbor移除后数据会不会丢失,答案是不会,因为默认数据就保存在物理机的/data目录下,当然你可以在harbor.cfg中修改
更新
-
如果配置文件有更新,则需要执行以下命令
$ sudo docker-compose down -v $ vim harbor.cfg $ sudo prepare $ sudo docker-compose up -d
端口修改
-
默认端口非常容易被占用
-
因此有必要修改默认端口,主要分为三步
-
第一步是修改docker-compose.yml,用8888代替80,如下
proxy: image: goharbor/nginx-photon:v1.6.0 container_name: nginx restart: always volumes: - ./common/config/nginx:/etc/nginx:z ports: - 8888:80 - 443:443 depends_on: - postgresql - registry - core - portal - log logging: driver: "syslog" options: syslog-address: "tcp://127.0.0.1:1514" tag: "proxy"
-
第二步是修改harbor.cfg
hostname = 192.168.25.215:8888
-
第三步则是重新部署harbor
管理harbor
-
harbor有一大堆镜像,因此可以使用docker-compose来管理它们的启停
-
在docker-compose.yml的同级目录下
sudo docker-compose stop #停止 sudo docker-compose start #启动
推送镜像
-
登录到刚刚部署完毕的harbor
docker login 192.168.25.215
-
登录时会产生如下错误,这是因为我们在安装时用的是http,因此需要在daemon.json中增加–insecure-registry
Error response from daemon: Get https://192.168.25.215/v2/: dial tcp 192.168.25.215:443: connect: connection refused
-
在/etc/docker/daemon.json中增加
{ "insecure-registries":["192.168.25.215"] }
-
保存后重启docker
-
此时为hello-world打一个tag
sudo docker tag hello-world 192.168.25.215/hwj/helloworld:1
-
然后推送上去
# docker push reg.yourdomain.com/myproject/myrepo:mytag sudo docker push 192.168.25.215/hwj/helloworld:1
-
会发现提示:denied: requested access to the resource is denied
-
这是因为我们还没有创建项目,因此需要在 http://192.168.25.215 这个网页中创建hwj这个项目,创建后再push就会发现可以了
拉取pull
-
如果想拉取私有仓库的镜像,那么则需要加上私有仓库服务的ip和端口,如
sudo docker pull 192.168.25.215/hwj/helloworld
-
或者在/etc/docker/daemon.json中的registry-mirrors添加 http://192.168.25.215
{
“registry-mirrors”: [“http://192.168.25.215:80”],
“insecure-registries”:[“192.168.25.215:80”]
} -
然后重启docker
-
之后就可以直接使用名称下载,不用每次都加上ip和端口了
sudo docker pull hwj/helloworld
最后
- 总的来说harbor安装相比nexus还是复杂了些,如果就单纯地想存镜像的话那么建议使用nexus就好了
参考
Harbor仓库介绍与搭建过程-运维生涯-51CTO博客
https://blog.51cto.com/11093860/2117805