自备 DaoliNet install

运行实例，（通过文档运行时存在一些小问题，所以这里有一些修改）

1. 安装环境准备


DaoliNet依赖的软件：


Docker Version 1.9 or later
Golang Version 1.5 or later
wget https://storage.googleapis.com/golang/go1.7.1.linux-amd64.tar.gz
tar -C /usr/local -xzf go1.7.1.linux-amd64.tar.gz
mkdir -p $HOME/gowork/src $HOME/gowork/bin
vim .profile
export GOROOT=/usr/local/go
export PATH=$PATH:$GOROOT/bin
export GOPATH=$HOME/gowork


source .profile
go get github.com/tools/godep
cp xxxx /root/gowork/src/github.com  # xxx 是go的编译包
cp xxxx /root/gowork/src/golang.org  # xxx 是go的编译包
# git clone https://github.com/golang/tools.git
go get -U github.com/tools/godep
vim .profile
export PATH=$PATH:$GOPATH/bin

Git
Python 2.7


Docker环境
  yum install docker -y
Golang环境
执行以下命令安装Golang，详细安装请参考Go Getting Started
    wget https://storage.googleapis.com/golang/go1.5.3.linux-amd64.tar.gz
    tar xzvf go1.5.3.linux-amd64.tar.gz -C /usr/local/
    export PATH=$PATH:/usr/local/go/bin
Git环境
    yum install -y gcc git epel-release
Python环境
    yum install -y python-devel python-pip
注意：

文档中所有export命令都可以配置到profile文件中永久生效

yum install -y iptables-services
所有节点添加如下iptables规则允许内网其它节点可以访问：

  iptables -I INPUT -s <SUBNET>/<PREFIX> -j ACCEPT

2. DaoliNet安装

DaoliNet安装过程包括manager节点安装和agent节点安装过程, 在所有swarm manager节点上安装daolinet api service, 所有swarm agent节点安装daolinet agent服务.


2.1 部署manager节点


部署manager节点需要以下步骤:


安装Etcd
安装Swarm Manager
安装ryu (OpenFlow框架)
安装daolinet (DaoliNet API服务)
安装daolictl (DaoliNet命令行工具)
安装Daolicontroller (OpenFlow控制器)
以下详细说明manager节点安装过程


2.1.1. 安装Etcd


docker pull microbox/etcd
docker run -ti -d -p 4001:4001 -p 7001:7001 --restart=always --name discovery microbox/etcd -addr 172.16.0.30:4001 -peer-addr 172.16.0.30:7001
2.1.2. 安装Swarm Manager


docker pull swarm
docker run -ti -d -p 3376:3376 --restart=always --name swarm-manager swarm m --addr 172.16.0.30:3376 --host tcp://0.0.0.0:3376 etcd://172.16.0.30:4001
2.1.3. 安装Ryu


# Install openflow framework
pip install ryu
2.1.4. 编译安装DaoliNet API Service


mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
# /root/daolinet/src/github.com/daolinet/daolinet
go get github.com/daolinet/daolinet/cli
godep go build -ldflags "-s -w"

# mkdir -p /root/daolinet/bin

mkdir -p ../../../../bin/

mv daolinet ../../../../bin/


# Run api server
cd /root/daolinet/bin
daolinet server --swarm tcp://172.16.0.30:3376 etcd://172.16.0.30:4001


2.1.5. 安装DaoliCtl命令行工具
cd $HOME/daolinet/src/github.com/daolinet
git clone https://github.com/daolinet/daolictl.git
cd daolictl
go get github.com/daolinet/daolictl/cli

godep go build -ldflags "-s -w"

mkdir -p ../../../../bin/
mv daolictl ../../../../bin/

2.1.6. 安装openflow控制器


# Install depend packages
yum install -y python-requests python-docker-py
# Install openflow controller
git clone https://github.com/daolinet/daolicontroller.git
cd daolicontroller; python ./setup.py install
# Run daolicontroller
systemctl start daolicontroller.service


2.2. 部署agent节点


配置Docker启动参数
安装Swarm Agent
配置和安装OpenvSwitch
安装OpenvSwitch Plugin
安装DaoliNet Agent
连接OpenFlow控制器
以下详细说明agent节点安装步骤


2.2.1. 配置docker启动参数


1.修改docker daemon启动参数，添加swarm管理和etcd支持。例如在CentOS7下修改/usr/lib/systemd/system/docker.service文件中如下ExecStart参数：


ExecStart=/usr/bin/dockerd -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2376 --cluster-store=etcd://172.16.0.30:4001
旧版本配置如下：


ExecStart=/usr/bin/docker daemon -H fd:// -H tcp://0.0.0.0:2376 --cluster-store=etcd://172.16.0.30:4001
2.然后重启服务：


systemctl daemon-reload
systemctl restart docker.service
2.2.2. 安装Swarm Agent


docker pull swarm
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.27:2376 etcd://172.16.0.30:4001
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.31:2376 etcd://172.16.0.30:4001
docker run -ti -d --restart=always --name swarm-agent swarm j --addr 172.16.0.32:2376 etcd://172.16.0.30:4001


2.2.3. 配置和安装openvswitch


执行以下命令安装OpenvSwitch，详细安装请参考How to Install Open vSwitch on Linux, FreeBSD and NetBSD


# 编译openvswitch源码
yum install -y openssl-devel rpm-build
wget http://openvswitch.org/releases/openvswitch-2.5.0.tar.gz
mkdir -p ~/rpmbuild/SOURCES
cp openvswitch-2.5.0.tar.gz ~/rpmbuild/SOURCES/
tar xzf openvswitch-2.5.0.tar.gz
yum install rpm-build -y
rpmbuild -bb --without check openvswitch-2.5.0/rhel/openvswitch.spec


# 安装生成的软件包
yum localinstall -y rpmbuild/RPMS/x86_64/openvswitch-2.5.0-1.x86_64.rpm
/etc/init.d/openvswitch start


# 执行OpenvSwitch脚本配置网卡
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s
# 如果有多个网卡，可以指定一个
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s -- <DEVNAME>

因为daolinet的虚拟网卡创建后，运行到ovs-vsctl set-controller 最后一条命令时，会出现全部的网络不能访问的情况，才添加一下的虚拟网卡：

vim /etc/sysconfig/network-scripts/ifcfg-eth1114

DEVICE=eth1114
TYPE=Bridge
ONBOOT=yes
BOOTPROTO=none

ovs-vsctl add-port daolinet eth1114

2.2.4. 安装OpenvSwitch Plugin
# https://github.com/daolinet/

pip install gunicorn flask netaddr

git clone https://github.com/daolinet/ovsplugin.git

python setup.py install

systemctl start daoliplugin.service

上边的git clone下来之后，你会发现没有start.sh这个文件，你可以从下方的地址找到旧版的程序里的start.sh拷贝到新的地址里的ovsplugin目录下用。

git clone https://github.com/daolicloud/ovsplugin.git 

cd ovsplugin/

./start.sh


2.2.5. 安装DaoliNet Agent Service


# Install daolinet
mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
godep go build -ldflags "-s -w"
mv daolinet ../../../../bin/


# Run agent service

# daolinet agent --iface <DEVNAME:DEVIP> etcd://172.16.0.30:4001

daolinet agent --iface daolinet:172.16.0.27 etcd://172.16.0.30:4001
daolinet agent --iface daolinet:172.16.0.31 etcd://172.16.0.30:4001
daolinet agent --iface daolinet:172.16.0.32 etcd://172.16.0.30:4001

这里的代码显然是不能运行的，如果调试会提示：

WARN[0334] Watch to disconnected, retrying again.

然后循环10分钟左右会告诉你不能连接，提示：ERRO[0600] error chan: Error to watch path (Docker/network/v1.0/network)，

说明daolinet官网给出来的文件是过时的，不可用的。

2.2.6. 连接OpenFlow控制器


在agent节点完成以上步骤，最后配置ovs连接到daolicontroller控制器：

# ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP>:6633

ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP1>:6633,tcp:<CONTROLLER-IP2>:6633

注意：为了提高系统可用性，集群中可以启动多个daolicontroller控制器，同时在配置ovs时指定多个控制器地址:

ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP1>:6633,tcp:<CONTROLLER-IP2>:6633

来源：https://github.com/daolinet/daolinet/blob/master/docs/%E4%B8%AD%E6%96%87%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md