SPDK 初学者

最新推荐文章于 2024-06-06 16:56:38 发布
最新推荐文章于 2024-06-06 16:56:38 发布
阅读量2.4k 收藏 4
点赞数
分类专栏： 存储 文章标签： spdk
转载请关注我的-公众号-青儿创客基地-QQ技术交流群852283276
本文链接：https://blog.csdn.net/Zhu_Zhu_2009/article/details/85330473
版权

作者

QQ群：852283276
微信：arm80x86
微信公众号：青儿创客基地
B站：主页 https://space.bilibili.com/208826118

参考

Getting Started

SPDK编译运行

j2@j2-pc:~/spdk-18.10.1$ sudo scripts/pkgdep.sh
...error...
j2@j2-pc:~/spdk-18.10.1$ pip install --upgrade pip
j2@j2-pc:~/spdk-18.10.1$ sudo scripts/pkgdep.sh
Traceback (most recent call last):
  File "/usr/bin/pip", line 9, in <module>
    from pip import main
ImportError: cannot import name main
Error!

pip问题：Traceback (most recent call last): File “/usr/bin/pip”, line 9, in

将 /usr/bin/pip 文件中：

from pip import  main
if __name__ == '__main__':
    sys.exit(main())

改为：

from pip import __main__
if __name__ == '__main__':
    sys.exit(__main__._main())

重新pkgdep，有警告

The directory '/home/j2/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/home/j2/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
...
You are using pip version 8.1.1, however version 18.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Crypto requires NASM version 2.12.02 or newer. Please install
or upgrade and re-run this script if you are going to use Crypto.

编译，测试，

j2@j2-pc:~/spdk-18.10.1$ ./configure 
j2@j2-pc:~/spdk-18.10.1$ make
j2@j2-pc:~/spdk-18.10.1$ ./test/unit/unittest.sh
j2@j2-pc:~/spdk-18.10.1$ sudo scripts/setup.sh
j2@j2-pc:~/spdk-18.10.1$ sudo examples/nvme/identify/identify

setup和identify这里必须用sudo。

测试

SPDK实战、QoS延时验证：Intel Optane P4800X评测(5)
SPDK生态工具（二）：性能评估工具
spdk（bdev层） + fio测试nvme 设备的性能

fio

# --build-static
j2@j2-pc:~/fio-fio-3.12$ ./configure --prefix=/home/j2/fio-fio-3.12/ubuntu16.04.4
j2@j2-pc:~/fio-fio-3.12$ make
j2@j2-pc:~/fio-fio-3.12$ make install
j2@j2-pc:~/spdk-18.10.1$ ./configure --with-fio=/home/j2/fio-fio-3.12
j2@j2-pc:~/spdk-18.10.1$ make
j2@j2-pc:~/spdk-18.10.1$ sudo LD_PRELOAD=examples/nvme/fio_plugin/fio_plugin fio ../spdk.fio

job file，

perf

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 32 -s 4096 -w randwrite -t 1200 -c 0xF -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xF -m 4096 --file-prefix=spdk_pid28398 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: Not enough memory available! Requested: 4096MB, available: 2048MB
EAL: FATAL: Cannot init memory

EAL: Cannot init memory

Failed to initialize DPDK
Unable to initialize SPDK env
./examples/nvme/perf/perf: errors occured
j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ sudo scripts/setup.sh reset
0000:05:00.0 (8086 0953): uio_pci_generic -> nvme
0000:0b:00.0 (8086 0953): uio_pci_generic -> nvme
0000:81:00.0 (8086 0953): uio_pci_generic -> nvme
0000:84:00.0 (8086 0953): uio_pci_generic -> nvme
0000:88:00.0 (8086 0953): uio_pci_generic -> nvme
0000:00:04.0 (8086 6f20): uio_pci_generic -> ioatdma
0000:80:04.0 (8086 6f20): uio_pci_generic -> ioatdma
0000:00:04.1 (8086 6f21): uio_pci_generic -> ioatdma
0000:80:04.1 (8086 6f21): uio_pci_generic -> ioatdma
0000:00:04.2 (8086 6f22): uio_pci_generic -> ioatdma
0000:80:04.2 (8086 6f22): uio_pci_generic -> ioatdma
0000:00:04.3 (8086 6f23): uio_pci_generic -> ioatdma
0000:80:04.3 (8086 6f23): uio_pci_generic -> ioatdma
0000:00:04.4 (8086 6f24): uio_pci_generic -> ioatdma
0000:80:04.4 (8086 6f24): uio_pci_generic -> ioatdma
0000:00:04.5 (8086 6f25): uio_pci_generic -> ioatdma
0000:80:04.5 (8086 6f25): uio_pci_generic -> ioatdma
0000:00:04.6 (8086 6f26): uio_pci_generic -> ioatdma
0000:80:04.6 (8086 6f26): uio_pci_generic -> ioatdma
0000:00:04.7 (8086 6f27): uio_pci_generic -> ioatdma
0000:80:04.7 (8086 6f27): uio_pci_generic -> ioatdma
j2@j2-pc:~/spdk-18.10.1$ sudo HUGEMEM=4096 scripts/setup.sh
0000:05:00.0 (8086 0953): nvme -> uio_pci_generic
0000:0b:00.0 (8086 0953): nvme -> uio_pci_generic
0000:81:00.0 (8086 0953): nvme -> uio_pci_generic
0000:84:00.0 (8086 0953): nvme -> uio_pci_generic
0000:88:00.0 (8086 0953): nvme -> uio_pci_generic
0000:00:04.0 (8086 6f20): ioatdma -> uio_pci_generic
0000:80:04.0 (8086 6f20): ioatdma -> uio_pci_generic
0000:00:04.1 (8086 6f21): ioatdma -> uio_pci_generic
0000:80:04.1 (8086 6f21): ioatdma -> uio_pci_generic
0000:00:04.2 (8086 6f22): ioatdma -> uio_pci_generic
0000:80:04.2 (8086 6f22): ioatdma -> uio_pci_generic
0000:00:04.3 (8086 6f23): ioatdma -> uio_pci_generic
0000:80:04.3 (8086 6f23): ioatdma -> uio_pci_generic
0000:00:04.4 (8086 6f24): ioatdma -> uio_pci_generic
0000:80:04.4 (8086 6f24): ioatdma -> uio_pci_generic
0000:00:04.5 (8086 6f25): ioatdma -> uio_pci_generic
0000:80:04.5 (8086 6f25): ioatdma -> uio_pci_generic
0000:00:04.6 (8086 6f26): ioatdma -> uio_pci_generic
0000:80:04.6 (8086 6f26): ioatdma -> uio_pci_generic
0000:00:04.7 (8086 6f27): ioatdma -> uio_pci_generic
0000:80:04.7 (8086 6f27): ioatdma -> uio_pci_generic
j2@j2-pc:~/spdk-18.10.1$ ./examples/nvme/perf/perf -h\
> 
./examples/nvme/perf/perf: invalid option -- 'h'
./examples/nvme/perf/perf options [AIO device(s)]...
        [-q io depth]
        [-o io size in bytes]
        [-w io pattern type, must be one of
                (read, write, randread, randwrite, rw, randrw)]
        [-M rwmixread (100 for reads, 0 for writes)]
        [-L enable latency tracking via sw, default: disabled]
                -L for latency summary, -LL for detailed histogram
        [-l enable latency tracking via ssd (if supported), default: disabled]
        [-t time in seconds]
        [-c core mask for I/O submission/completion.]
                (default: 1)]
        [-D disable submission queue in controller memory buffer, default: enabled]
        [-r Transport ID for local PCIe NVMe or NVMeoF]
         Format: 'key:value [key:value] ...'
         Keys:
          trtype      Transport type (e.g. PCIe, RDMA)
          adrfam      Address family (e.g. IPv4, IPv6)
          traddr      Transport address (e.g. 0000:04:00.0 for PCIe or 192.168.100.8 for RDMA)
          trsvcid     Transport service identifier (e.g. 4420)
          subnqn      Subsystem NQN (default: nqn.2014-08.org.nvmexpress.discovery)
         Example: -r 'trtype:PCIe traddr:0000:04:00.0' for PCIe or
                  -r 'trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' for NVMeoF
        [-e metadata configuration]
         Keys:
          PRACT      Protection Information Action bit (PRACT=1 or PRACT=0)
          PRCHK      Control of Protection Information Checking (PRCHK=GUARD|REFTAG|APPTAG)
         Example: -e 'PRACT=0,PRCHK=GUARD|REFTAG|APPTAG'
                  -e 'PRACT=1,PRCHK=GUARD'
        [-s DPDK huge memory size in MB.]
        [-m max completions per poll]
                (default: 0 - unlimited)
        [-i shared memory group ID]
j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 32 -s 4096 -w randwrite -t 16 -c 0xF -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xF -m 4096 --file-prefix=spdk_pid29850 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 3
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 2
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 1
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 3
Starting thread on core 2
Starting thread on core 1
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 3:   68497.19     267.57     467.14       4.87    9674.24
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 2:   68362.69     267.04     468.10       5.03    9715.33
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 1:   68318.69     266.87     468.40       4.87    9824.85
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:   68364.38     267.05     468.07       4.96    9825.13
========================================================
Total                                                  :  273542.94    1068.53     467.93       4.87    9825.13

j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ 
j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 32 -s 4096 -w randwrite -t 16 -c 0x1 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 4096 --file-prefix=spdk_pid29858 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:  286650.12    1119.73     111.61       4.82    6628.92
========================================================
Total                                                  :  286650.12    1119.73     111.61       4.82    6628.92

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 32 -s 4096 -w write -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 4096 --file-prefix=spdk_pid29863 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:  292685.00    1143.30     109.33       4.91    5617.24
========================================================
Total                                                  :  292685.00    1143.30     109.33       4.91    5617.24

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 32 -s 4096 -w write -t 4 -c 0x2000 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x2000 -m 4096 --file-prefix=spdk_pid29868 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 13
Initialization complete. Launching workers.
Starting thread on core 13
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 13:  294559.75    1150.62     108.63       4.98    6066.26
========================================================
Total                                                  :  294559.75    1150.62     108.63       4.98    6066.26

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4m -q 32 -s 4096 -w write -t 4 -c 0x2000 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x2000 -m 4096 --file-prefix=spdk_pid29874 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
WARNING: controller INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) ns 1 has invalid ns size 1200243695616 / block size 512 for I/O size 4
WARNING: Some requested NVMe devices were skipped
No valid NVMe controllers or AIO devices found
j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4194304 -q 32 -s 4096 -w write -t 4 -c 0x2000 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x2000 -m 4096 --file-prefix=spdk_pid29878 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 13
Initialization complete. Launching workers.
Starting thread on core 13
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 13:     308.25    1233.00  104935.04   22555.34  117980.98
========================================================
Total                                                  :     308.25    1233.00  104935.04   22555.34  117980.98

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4194304 -q 32 -s 4096 -w write -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 4096 --file-prefix=spdk_pid29881 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:     307.75    1231.00  104911.70   22699.09  116968.86
========================================================
Total                                                  :     307.75    1231.00  104911.70   22699.09  116968.86

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4194304 -q 32 -s 4096 -w write -t 4 -c 0xf -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xf -m 4096 --file-prefix=spdk_pid29886 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 3
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 2
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 1
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 3
Starting thread on core 2
Starting thread on core 1
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 3:      84.00     336.00  399191.18   28751.61  444618.98
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 2:      83.25     333.00  402924.51   32200.29  443727.62
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 1:      82.50     330.00  406014.98   37059.40  443168.02
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:      82.50     330.00  406212.16   35146.04  444680.55
========================================================
Total                                                  :     332.25    1329.00  403564.37   28751.61  444680.55

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 16777216 -q 32 -s 4096 -w write -t 4 -c 0xf -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xf -m 4096 --file-prefix=spdk_pid29892 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
controller IO queue size 4096 less than required
Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver.
WARNING: Some requested NVMe devices were skipped
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 3
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 2
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 1
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 3
Starting thread on core 2
Starting thread on core 1
Starting thread on core 0
starting I/O failed
starting I/O failed
starting I/O failed
starting I/O failed
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 3:      26.50     424.00 1378237.92  189295.82 1681419.63
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 2:      26.50     424.00 1384060.60  199343.94 1682199.80
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 1:      26.25     420.00 1393641.04  201916.80 1682298.07
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:      26.25     420.00 1395348.45  206082.71 1682435.40
========================================================
Total                                                  :     105.50    1688.00 1387790.38  189295.82 1682435.40

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 16777216 -q 32 -s 4096 -w write -t 4 -c 0xf -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xf -m 4096 --file-prefix=spdk_pid29903 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
controller IO queue size 4096 less than required
Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver.
WARNING: Some requested NVMe devices were skipped
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 3
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 2
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 1
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 3
Starting thread on core 2
Starting thread on core 1
Starting thread on core 0
starting I/O failed
starting I/O failed
starting I/O failed
starting I/O failed
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 3:      26.50     424.00 1382522.50  190645.81 1683826.64
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 2:      26.25     420.00 1386511.40  198855.35 1685283.25
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 1:      26.25     420.00 1399044.62  208331.21 1685504.39
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:      26.25     420.00 1400331.67  206634.96 1685705.08
========================================================
Total                                                  :     105.25    1684.00 1392079.79  190645.81 1685705.08

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 16777216 -q 32 -s 4096 -w read -t 4 -c 0xf -r 'trtype:PCIe traddr:0000:05:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0xf -m 4096 --file-prefix=spdk_pid29909 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:05:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:05:00.0
Attached to NVMe Controller at 0000:05:00.0 [8086:0953]
controller IO queue size 4096 less than required
Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver.
WARNING: Some requested NVMe devices were skipped
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 3
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 2
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 1
Associating INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 3
Starting thread on core 2
Starting thread on core 1
Starting thread on core 0
starting I/O failed
starting I/O failed
starting I/O failed
starting I/O failed
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 3:      46.50     744.00  717634.73  164784.63  830421.20
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 2:      46.25     740.00  719570.26  168117.04  829957.78
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 1:      46.00     736.00  721743.18  177461.95  830567.32
INTEL SSDPEDMW012T4  (CVCQ6523001M1P2JGN  ) from core 0:      46.00     736.00  722301.30  176895.23  829961.81
========================================================
Total                                                  :     184.75    2956.00  720304.12  164784.63  830567.32
j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 1 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid487 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:  120407.00     470.34       8.26       5.79    4635.11
========================================================
Total                                                  :  120407.00     470.34       8.26       5.79    4635.11

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 4 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid492 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:  279772.75    1092.86      14.27       4.76    4760.82
========================================================
Total                                                  :  279772.75    1092.86      14.27       4.76    4760.82

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 409616 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid497 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4096 -q 16 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid503 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:  287862.00    1124.46      55.56       4.90    5568.93
========================================================
Total                                                  :  287862.00    1124.46      55.56       4.90    5568.93

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4194304 -q 16 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid507 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:     301.75    1207.00   53260.31   11526.45   62177.25
========================================================
Total                                                  :     301.75    1207.00   53260.31   11526.45   62177.25

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 4194304 -q 16 -s 2048 -w randread -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid519 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:     737.50    2950.00   21703.05    7895.89   25541.66
========================================================
Total                                                  :     737.50    2950.00   21703.05    7895.89   25541.66

j2@j2-pc:~/spdk-18.10.1$ sudo ./examples/nvme/perf/perf -o 16777216 -q 16 -s 2048 -w randwrite -t 4 -c 0x1 -r 'trtype:PCIe traddr:0000:0b:00.0'
Starting SPDK v18.10.1 / DPDK 18.08.0 initialization...
[ DPDK EAL parameters: perf --no-shconf -c 0x1 -m 2048 --file-prefix=spdk_pid524 ]
EAL: Detected 24 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
Initializing NVMe Controllers
EAL: PCI device 0000:0b:00.0 on NUMA socket 0
EAL:   probe driver: 8086:953 spdk_nvme
Attaching to NVMe Controller at 0000:0b:00.0
Attached to NVMe Controller at 0000:0b:00.0 [8086:0953]
Associating INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) with lcore 0
Initialization complete. Launching workers.
Starting thread on core 0
========================================================
                                                                                            Latency(us)
Device Information                                     :       IOPS       MB/s    Average        min        max
INTEL SSDPEDMW012T4  (CVCQ652400851P2JGN  ) from core 0:      78.25    1252.00  208153.12   47927.36  232573.98
========================================================
Total                                                  :      78.25    1252.00  208153.12   47927.36  232573.98
三遍猪
关注
  • 0
    点赞
  • 踩
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
一文读懂SPDK加速关键应用：解析SPDK Perf应用
weixin_37097605的博客
12-12 969
作者简介 喻津，Intel软件工程师， 主要从事SPDK软件开发工作。导读随着SPDK集成应用的日益广泛，我们希望可以通过解读spdk/example/nvme/per...
spdk 入门 hello world源码解析
wade1010的专栏
01-28 941
接下来重点看下22行return spdk_pci_enumerate(spdk_pci_nvme_get_driver(),pcie_nvme_enum_cb, &enum_ctx);接下来重点看下22行return spdk_pci_enumerate(spdk_pci_nvme_get_driver(),pcie_nvme_enum_cb, &enum_ctx);关注重点16行rc = nvme_transport_ctrlr_scan(probe_ctx, direct_connect);
ideal提示类似“内存不足”的报错时解决方法（3种）
bug444的博客
10-23 1762
ideal内存不足解决方法
SPDK的本地环境搭建和本地测试方法
最新发布
developersupport的博客
06-06 670
SPDK（Storage Performance Development Kit），顾名思义是一组用于提高存储性能的开发工具包，提供了一组用于编写高性能、可伸缩、用户态存储应用程序的工具和库。SPDK可以通过如下关键技术提高性能：1) 将所有必需的驱动程序移至用户空间，这样就避免了系统调用，并允许从应用程序中进行零拷贝访问；2) 轮询硬件任务的完成而不是依靠中断，这会降低总延迟和延迟抖动；3) 避免在I/O路径中出现锁, 而是依赖消息传递。
浅谈SPDK（二）虚拟机搭建SPDK环境
饿狗博客
06-22 2388
从上一节简单介绍完SPDK之后，这里我开始就想搭建一下SPDK，然后再去了解其细节。 测试环境 win10 + virtualbox 6.0.24 + vagrant 2.2.16 虚拟机操作系统是ubuntu1804 安装参考链接： -在虚拟机上部署SPDK NVME测试案例 -Vagrant Development Environment Introduction 安装spdk环境 1、准备软件、安装包 准备virtualbox和vagrant 我们下载virtualbox 6.0和vagrant 2
dpdk内存管理之calc_num_pages_per_socket()函数分析
sinat_32343037的博客
09-24 460
dpdk calc_num_pages_per_socket 函数分析
详细 SPDK安装指南
baidu_41778202的博客
03-28 4012
title: SPDK 安装指南 date: 2022-03-21 09:57:55 tags: SPDK，一款用于NMVe协议的驱动开发工具。但是由于境内网络原因、版本问题、Python安装问题，将其`github`主页上区区几行命令的执行难度，提升了不少。 经历过两次痛苦的安装过程（第一次没有好好记录），我决定这一次要好好地记录一回。 前置 Ubuntu16.04.5 Desktop LST，但是后来自动升级了Ubuntu16.04.7？ 默认有 Python2.7.12 与Python3..
java初学者
09-13
学习过程中总结,积累出来的东西,包括,java的基本数据类型,基本语句,运算符,基本sql 语句,servlet3.0,线程,网络编程.
wxWidgets初学者导引.zip
11-02
wxWidgets初学者导引.zip
Linux初学者入门
01-05
Linux初学者入门，让linux初学者学习到一些linux的基本操作。
selenium初学者指南
03-20
**Selenium初学者指南** Selenium是一款强大的自动化测试工具，尤其在Web应用程序的测试领域，它占据了重要地位。本指南专为初次接触Selenium的读者设计，旨在帮助你们快速掌握这个强大的工具，从而提高测试效率，...
IDAPython 初学者指南
05-27
IDAPython 初学者指南 IDAPython 初学者指南 IDAPython 初学者指南
SPDK相关讲解
clever_wr的博客
12-23 2336
首先是安装： git clone https://github.com/spdk/spdk.git cd spdk git submodule update --init 然后是安装相关的库（如果只是安装能把SPDK运行起来的最少需要安装的包，执行第一条；如果安装所有包就执行第二条，推荐第二条）： sudo scripts/pkgdep.sh sudo scripts/pkgdep.sh --all 如果在执行第二条的时候出现有的package在github上download下来失败的错误.
DPDK内存初始化失败
weixin_30929295的博客
12-16 914
dpdk应用程序启动失败，信息提示： Current CONFIG_RTE_MAX_MEMSEG=256 is not enoughPlease either increase it or request less amount of memory.PANIC in rte_eal_init():Cannot init memory 罪魁祸首是内存碎片，app无法申请到足够多的连续大块内存，只...
Ubuntu报错“rte_virtio_pmd_init(): IOPL call failed - cannot use virtio PMD”
AlwaySimple的博客
06-18 602
参考资料：https://blog.csdn.net/jiechuhoudeshang/article/details/89213949 rte_virtio_pmd_init(): IOPL call failed - cannot use virtio PMD EAL: Detected 4 lcore(s) EAL: Multi-process socket /home/yo...
Halcon中“Not enough memory available”异常处理方法之一
oShouQianShou的博客
11-16 1万+
Halcon在执行threshold_sub_pix算子的时候，有几率抛出异常“Not enough memory available”。 查询手册，异常代码为：H_ERR_MEM 6001 Not enough memory available解决方法：使用threshold算子替代即可。 异常代码：threshold_sub_pix (ImageReduced, Border,
k8s 多 pod 环境运行 dpdk 多进程问题
龙瑜的博客
10-15 1115
本文描述了 dpdk 多进程程序在 k8s 环境运行的一个问题，从 dpdk 代码实现上来看，dpdk 对这种场景的支持并不好，可能还存在其它问题。上半年我写的程序启动顺序引发的血案之 dpdk 进程死锁这篇博客描述了 dpdk 多进程共享用户态锁潜在的死锁问题，在这个场景中也存在。这些问题比较隐晦，缺少对 dpdk 底层原理的理解则很难在方案设计前期识别出来，是一个风险点。
Centos7安装DPDK
暗焰之珩的博客
11-28 2787
目录 Centos7安装DPDK 1系统准备工作 1.1查看Linux机器是否为NUMA结构 1.2大页内存的挂载和分配 1.3加载启动dpdk需要的uio功能 1.4网络端口绑定和解绑定到内核驱动模块 2.安装依赖包 3.解压与编译运行 4.问题与解决方法 4.1make: *** /lib/modules/3.10.0-229.el7.x86_64/build: 没有那个文...
Pktgen-DPDK install 安装部署
热门推荐
编码人生——朝阳_tony
07-10 1万+
声明:此文档只做学习交流使用,请勿用作其他商业用途 author:朝阳_tony E-mail : linzhaolover@gmail.com Create Date: 2013-7-10 13:59:31 Wednesday Last Change: 2013-7-10 14:00:29 Wednesday 转载请注明出处：http://blog.csdn.net/linzhao
c语言编程题+初学者+基础练习题
11-18
180道基础C语言编程题，为本人在校（cqupt）初学C语言时的练习题目，代码较少，适用于初学者（部分文件内容展示在首页文章中）

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值