记麒麟V10 +飞腾1500A 安装kvm失败全过程

麒麟v10 FT1500A服务器安装kvm，失败全过程

1.查看操作系统

uname -a
=============================================================================================
Linux xxx 4.19.90-17.ky10.aarch64 #1 SMP Sun Jun 28 14:27:40 CST 2020 aarch64 aarch64 aarch64 GNU/Linux
=============================================================================================

2.查看cpu型号

lscpu
=============================================================================================
架构：                           aarch64
CPU 运行模式：                   32-bit, 64-bit
字节序：                         Little Endian
CPU:                             16
在线 CPU 列表：                  0-15
每个核的线程数：                 1
每个座的核数：                   4
座：                             4
NUMA 节点：                      1
厂商 ID：                        Phytium
型号：                           1
型号名称：                       Phytium,FT-1500A
步进：                           0x1
BogoMIPS：                       100.00
NUMA 节点0 CPU：                 0-15
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1:        Mitigation; __user pointer sanitization
Vulnerability Spectre v2:        Vulnerable
Vulnerability Tsx async abort:   Not affected
标记：                           fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid
=============================================================================================

3.是否支持虚拟化

dmesg | grep kvm
=============================================================================================
[    0.878732] kvm [1]: 8-bit VMID
[    0.878741] kvm [1]: IPA Size Limit: 44bits
[    0.878885] kvm [1]: vgic-v2@29c20000
[    0.878894] kvm [1]: GIC system register CPU interface enabled
[    0.879121] kvm [1]: vgic interrupt IRQ1
[    0.879321] kvm [1]: Hyp mode initialized successfully
=============================================================================================

4.安装KVM

yum -y install qemu* libvirt* virt-install

5.修改所属用户/组

vi /etc/libvirt/qemu.conf
=============================================================================================
# Since a sequence of digits is a valid user name, a leading plus sign
# can be used to ensure that a user id will not be interpreted as a user
# name.
#
# Some examples of valid values are:
#
#       user = "qemu"   # A user named "qemu"
#       user = "+0"     # Super user (uid=0)
#       user = "100"    # A user named "100" or a user with uid=100
#
user = "root"

# The group for QEMU processes run by the system instance. It can be
# specified in a similar way to user.
group = "root"
=============================================================================================

6.重启libvirtd服务

systemctl start libvirtd
=============================================================================================
Job for libvirtd.service failed because the control process exited with error code.
See "systemctl status libvirtd.service" and "journalctl -xe" for details.
=============================================================================================

查看具体报错信息
journalctl -u libvirtd.service -b
=============================================================================================
为 /usr/libexec/qemu-kvm 探测功能失败：内部错误：Failed to start QEMU binary /usr/libexec/qemu-kvm for probing: /usr/libexec/qemu-kvm: relocation error: /lib64/libgbm.so.1: symbol mesa_memcpy version GLIBC_2.17 not defined in file libc.so.6 with link time reference>
操作失败: Cannot find CPU model with PVR 0x660
内部错误：connection closed due to keepalive timeou
=============================================================================================
需升级GLIBC
yum update GLIBC

重新启动
systemctl restart libvirtd

systemctl status libvirtd  
===================================================================================================
11月 15 21:47:47 xxx libvirtd[3090360]: 操作失败: Cannot find CPU model with PVR 0x660
11月 15 21:47:47 xxx libvirtd[3090360]: 操作失败: Cannot find CPU model with PVR 0x660
11月 15 21:47:47 xxx libvirtd[3090360]: 操作失败: Cannot find CPU model with PVR 0x660
===================================================================================================
journalctl -u libvirtd.service -b
=========================================================================================
内部错误：Failed to load module '/usr/lib64/libvirt/storage-backend/kend_rbd.so': /usr/lib64/ceph/libceph-common.so.0: symbol pthread_cond
=========================================================================================
因quem未安装可能带来问题

7.源码编译安装quem

详情请查看
https://www.cnblogs.com/changxy-codest/p/15814323.html

安装过程中出现的问题

https://www.cnblogs.com/changxy-codest/p/15814323.html
需安装quem
https://download.qemu.org/qemu-5.2.0.tar.xz
cp qemu-5.2.0.tar.xz /usr/locel/
cd qemu-5.2.0.tar.xz
tar -xvf qemu-5.2.0.tar.xz
cd qemu-5.2.0/
./configure --enable-kvm --enable-debug   --enable-strip --target-list=aarch64-softmmu
make -j4
make install


如果报错
1.ERROR：Dependency "pixman-1" not found, tried pkgconfig
解决办法：没有安装pixman，下载pixman源码后编译安装。下载地址：pixman源码地址：https://www.cairographics.org/releases/
wget https://www.cairographics.org/releases/pixman-0.40.0.tar.gz  #下载的是0.40版本
tar -xzvf pixman-0.40.0.tar.gz
cd pixman-0.40.0
./configure    #生成Makefile文件
make && make install  #编译及安装

8.网络配置

创建网桥
brctl addbr br0
================================================
-bash: brctl：未找到命令
================================================
yum install bridge-utils

修改宿主机默认网卡
cd /etc/sysconfig/network-scripts/
cp ifcfg-enp125s0f0 ifcfg-enp125s0f0.bak
vi ifcfg-enp125s0f0
将IPADDR、NETMASK、GATEWAY三项删掉，添加以下内容：
================================================
BRIDGE="br0"
================================================

配置网桥
vi ifcfg-br0
================================================
BOOTPROTO=static
NAME=br0
DEVICE=br0
TYPE=Bridge
ONBOOT=yes
IPADDR="xxx.xxx.xxx.xxx"
NETMASK=255.255.255.0
GATEWAY="xxx.xxx.xxx.xxx"
DNS1="192.168.xxx.xxx
DNS2="192.168.xxx.xxx"
================================================
虚拟机内部网络配置

修改/etc/sysconfig/network-scripts/ifcfg-xxx，配置ip跟宿主机同一网段即可。

网桥设置
ip tuntap add dev tap0 mod tap
brctl addif br0 tap0
ifconfig tap0 0.0.0.0 promisc up

nmcli  connection up br0
nmcli c reload
nmcli d reapply br0
nmcli c reload

9.最后结果

● libvirtd.service - Virtualization daemon
   Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled)
   Active: inactive (dead) since Fri 2023-03-10 18:14:41 CST; 2 days ago
     Docs: man:libvirtd(8)
           https://libvirt.org
  Process: 3207515 ExecStart=/usr/sbin/libvirtd $LIBVIRTD_ARGS (code=exited, status=0/SUCCESS)
 Main PID: 3207515 (code=exited, status=0/SUCCESS)

3月 10 17:59:54 xxx libvirtd[3207515]: hostname: cnki-120-145-189
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 17:59:54 xxx libvirtd[3207515]: 操作失败: Cannot find CPU model with PVR 0x660
3月 10 18:12:41 xxx libvirtd[3207515]: 内部错误：connection closed due to keepalive timeout
3月 10 18:14:41 xxx systemd[1]: libvirtd.service: Succeeded.

个人认为是飞腾1500A 不支持
在cpu模板路径/usr/share/libvirt/cpu_map下没有找到FT1500A 模板

arm_cortex-a53.xml
arm_cortex-a57.xml
arm_cortex-a72.xml
arm_features.xml
arm_FT-2000plus.xml
arm_Kunpeng-920.xml
arm_Tengyun-S2500.xml
arm_vendors.xml
index.xml
ppc64_POWER6.xml
ppc64_POWER7.xml
ppc64_POWER8.xml
ppc64_POWER9.xml
ppc64_POWERPC_e5500.xml
ppc64_POWERPC_e6500.xml
ppc64_vendors.xml
x86_486.xml
x86_athlon.xml
x86_Broadwell-IBRS.xml
x86_Broadwell-noTSX-IBRS.xml
x86_Broadwell-noTSX.xml
x86_Broadwell.xml
x86_Cascadelake-Server-noTSX.xml
x86_Cascadelake-Server.xml
x86_Conroe.xml
x86_Cooperlake.xml
x86_core2duo.xml
x86_coreduo.xml
x86_cpu64-rhel5.xml
x86_cpu64-rhel6.xml
x86_Dhyana.xml
x86_EPYC-IBPB.xml
x86_EPYC.xml
x86_features.xml
x86_Haswell-IBRS.xml
x86_Haswell-noTSX-IBRS.xml
x86_Haswell-noTSX.xml
x86_Haswell.xml
x86_Icelake-Client-noTSX.xml
x86_Icelake-Client.xml
x86_Icelake-Server-noTSX.xml
x86_Icelake-Server.xml
x86_IvyBridge-IBRS.xml
x86_IvyBridge.xml
x86_kvm32.xml
x86_kvm64.xml
x86_n270.xml
x86_Nehalem-IBRS.xml
x86_Nehalem.xml
x86_Opteron_G1.xml
x86_Opteron_G2.xml
x86_Opteron_G3.xml
x86_Opteron_G4.xml
x86_Opteron_G5.xml
x86_Penryn.xml
x86_pentium2.xml
x86_pentium3.xml
x86_pentiumpro.xml
x86_pentium.xml
x86_phenom.xml
x86_qemu32.xml
x86_qemu64.xml
x86_SandyBridge-IBRS.xml
x86_SandyBridge.xml
x86_Skylake-Client-IBRS.xml
x86_Skylake-Client-noTSX-IBRS.xml
x86_Skylake-Client.xml
x86_Skylake-Server-IBRS.xml
x86_Skylake-Server-noTSX-IBRS.xml
x86_Skylake-Server.xml
x86_vendors.xml
x86_Westmere-IBRS.xml
x86_Westmere.xml