音视频处理 ffmpeg初级开发 命令行工具-实用命令

参考链接

目录

  • 1,help命令使用
    • 1.1 ffmpeg命令的语法结构
    • 1.2 获取详细的help信息
    • 1.3 打印帮助或者支持能力的信息
    • 1.4 全局选项
    • 1.5 文件选项
    • 1.6 视频/音频/字幕相关选项
  • 2,流选择选项
  • 3,视频封装解封装
    • 3.1 视频格式转换
    • 3.2 分离/合并视频音频流
    • 3.3 截取视频片段
    • 3.4 视频转换为m3u8格式
    • 3.5 把视频文件推送到rtmp服务器
    • 3.6 对视频进行切片
  • 4,视频解码编码
    • 4.1 视频截图
    • 4.2 视频/图片尺寸修改
    • 4.3 分离视频的YUV通道分量
    • 4.4 图片序列与视频的互相转换
  • 5,视频filter
    • 5.1 视频加水印overlay
    • 5.2 视频旋转transpose
    • 5.3 调色3DLutFilter
    • 5.4 图像/视频转换成黑白的hue
    • 5.5 裁剪视频crop
    • 5.6 视频尺寸缩放scale
    • 5.7 视频中去水印delogo
    • 5.8 给视频或图像加上黑边pad
    • 5.9 计算psnr/ssim
    • 5.10 视频按时间拼接
    • 5.11 视频左右拼接
    • 5.12 打印视频帧的一些信息showinfo
    • 5.13 生成纯色的图片
    • 5.14 打印帧序号/pts到视频帧水印drawtext
  • 6,音频解码编码     PCM原始数据和WAV格式转换
  • 7,音频filter             倍速atempo
  • 8,字幕相关
    • 8.1 字幕文件转换
    • 8.2 集成字幕到视频文件
  • 9,ffplay命令
    • 9.1 ffplay播放yuv视频数据
    • 9.2 ffplay播放PCM音频数据
    • 9.3 ffplay播放音频并显示波形图
    • 9.4 ffplay指定显示宽高
  • 10,ffprobe命令
    • 10.1 ffprobe查看媒体文件的信息
    • 10.2 ffprobe查看时间戳
  • 11,其他
    • 11.1 ffmpeg或ffplay 打开 DEBUG 日志输出
    • 11.2 FFmpeg命令日志输出到文件
    • 11.3 打印支持DirectShow的设备列表

1,help命令使用

  • ffmpeg -help
  • 终端打印帮助信息
  • 打印ffmpeg以及各个模块的版本信息
chy-cpabe@ubuntu:~/ffmpeg-source/ffmpeg$ ffmpeg -help
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Hyper fast Audio and Video encoder
usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...

Getting help:
    -h      -- print basic options
    -h long -- print more options
    -h full -- print all options (including all format and codec specific options, very long)
    -h type=name -- print all options for the named decoder/encoder/demuxer/muxer/filter/bsf/protocol
    See man ffmpeg for detailed description of the options.

Print help / information / capabilities:
-L                  show license
-h topic            show help
-? topic            show help
-help topic         show help
--help topic        show help
-version            show version
-buildconf          show build configuration
-formats            show available formats
-muxers             show available muxers
-demuxers           show available demuxers
-devices            show available devices
-codecs             show available codecs
-decoders           show available decoders
-encoders           show available encoders
-bsfs               show available bit stream filters
-protocols          show available protocols
-filters            show available filters
-pix_fmts           show available pixel formats
-layouts            show standard channel layouts
-sample_fmts        show available audio sample formats
-dispositions       show available stream dispositions
-colors             show available color names
-sources device     list sources of the input device
-sinks device       list sinks of the output device
-hwaccels           show available HW acceleration methods

Global options (affect whole program instead of just one file):
-loglevel loglevel  set logging level
-v loglevel         set logging level
-report             generate a report
-max_alloc bytes    set maximum size of a single allocated block
-y                  overwrite output files
-n                  never overwrite output files
-ignore_unknown     Ignore unknown stream types
-filter_threads     number of non-complex filter threads
-filter_complex_threads  number of threads for -filter_complex
-stats              print progress report during encoding
-max_error_rate maximum error rate  ratio of decoding errors (0.0: no errors, 1.0: 100% errors) above which ffmpeg returns an error instead of success.
-vol volume         change audio volume (256=normal)

Per-file main options:
-f fmt              force format
-c codec            codec name
-codec codec        codec name
-pre preset         preset name
-map_metadata outfile[,metadata]:infile[,metadata]  set metadata information of outfile from infile
-t duration         record or transcode "duration" seconds of audio/video
-to time_stop       record or transcode stop time
-fs limit_size      set the limit file size in bytes
-ss time_off        set the start time offset
-sseof time_off     set the start time offset relative to EOF
-seek_timestamp     enable/disable seeking by timestamp with -ss
-timestamp time     set the recording timestamp ('now' to set the current time)
-metadata string=string  add metadata
-program title=string:st=number...  add program with specified streams
-target type        specify target file type ("vcd", "svcd", "dvd", "dv" or "dv50" with optional prefixes "pal-", "ntsc-" or "film-")
-apad               audio pad
-frames number      set the number of frames to output
-filter filter_graph  set stream filtergraph
-filter_script filename  read stream filtergraph description from a file
-reinit_filter      reinit filtergraph on input parameter changes
-discard            discard
-disposition        disposition

Video options:
-vframes number     set the number of video frames to output
-r rate             set frame rate (Hz value, fraction or abbreviation)
-fpsmax rate        set max frame rate (Hz value, fraction or abbreviation)
-s size             set frame size (WxH or abbreviation)
-aspect aspect      set aspect ratio (4:3, 16:9 or 1.3333, 1.7777)
-vn                 disable video
-vcodec codec       force video codec ('copy' to copy stream)
-timecode hh:mm:ss[:;.]ff  set initial TimeCode value.
-pass n             select the pass number (1 to 3)
-vf filter_graph    set video filters
-ab bitrate         audio bitrate (please use -b:a)
-b bitrate          video bitrate (please use -b:v)
-dn                 disable data

Audio options:
-aframes number     set the number of audio frames to output
-aq quality         set audio quality (codec-specific)
-ar rate            set audio sampling rate (in Hz)
-ac channels        set number of audio channels
-an                 disable audio
-acodec codec       force audio codec ('copy' to copy stream)
-vol volume         change audio volume (256=normal)
-af filter_graph    set audio filters

Subtitle options:
-s size             set frame size (WxH or abbreviation)
-sn                 disable subtitle
-scodec codec       force subtitle codec ('copy' to copy stream)
-stag fourcc/tag    force subtitle tag/fourcc
-fix_sub_duration   fix subtitles duration
-canvas_size size   set canvas size (WxH or abbreviation)
-spre preset        set the subtitle options to the indicated preset

1.1 ffmpeg命令的语法结构

  • ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...
  • options:对输入和输出均有影响的选项
  • [[infile options] -i infile]  指定输入选项和输入文件  ... 表示可以包含多个输入文件
  • {[outfile options] outfile} 指定输出选项和输出文件 ... 表示可以包含多个输出文件

1.2 获取详细的help信息

Getting help:
    -h      -- print basic options
    -h long -- print more options
    -h full -- print all options (including all format and codec specific options, very long)
    -h type=name -- print all options for the named decoder/encoder/demuxer/muxer/filter/bsf/protocol
    See man ffmpeg for detailed description of the options.
  •  -h long: 打印更多的选项参数
  • -h full: 打印所有的选项参数,包括所有针对于format和codec的选项,信息特别的长
  • -h type=name: 打印指定名称的decoder/encoder/demuxer/muxer/filter的所有选项信息
  • man ffmpeg: 查看ffmpeg的帮助手册
  • 特别注意:
    • 重点使用 -h type=name
    • 例如,查看libx264支持的参数  ffmpeg -h encoder=libx264
chy-cpabe@ubuntu:~/ffmpeg-source/ffmpeg$ ffmpeg -h encoder=libx264
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Encoder libx264 [libx264 H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10]:
    General capabilities: dr1 delay threads 
    Threading capabilities: other
    Supported pixel formats: yuv420p yuvj420p yuv422p yuvj422p yuv444p yuvj444p nv12 nv16 nv21
libx264 AVOptions:
  -preset            <string>     E..V....... Set the encoding preset (cf. x264 --fullhelp) (default "medium")
  -tune              <string>     E..V....... Tune the encoding params (cf. x264 --fullhelp)
  -profile           <string>     E..V....... Set profile restrictions (cf. x264 --fullhelp) 
  -fastfirstpass     <boolean>    E..V....... Use fast settings when encoding first pass (default true)
  -level             <string>     E..V....... Specify level (as defined by Annex A)
  -passlogfile       <string>     E..V....... Filename for 2 pass stats
  -wpredp            <string>     E..V....... Weighted prediction for P-frames
  -a53cc             <boolean>    E..V....... Use A53 Closed Captions (if available) (default true)
  -x264opts          <string>     E..V....... x264 options
  -crf               <float>      E..V....... Select the quality for constant quality mode (from -1 to FLT_MAX) (default -1)
  -crf_max           <float>      E..V....... In CRF mode, prevents VBV from lowering quality beyond this point. (from -1 to FLT_MAX) (default -1)
  -qp                <int>        E..V....... Constant quantization parameter rate control method (from -1 to INT_MAX) (default -1)
  -aq-mode           <int>        E..V....... AQ method (from -1 to INT_MAX) (default -1)
     none            0            E..V.......
     variance        1            E..V....... Variance AQ (complexity mask)
     autovariance    2            E..V....... Auto-variance AQ
     autovariance-biased 3            E..V....... Auto-variance AQ with bias to dark scenes
  -aq-strength       <float>      E..V....... AQ strength. Reduces blocking and blurring in flat and textured areas. (from -1 to FLT_MAX) (default -1)
  -psy               <boolean>    E..V....... Use psychovisual optimizations. (default auto)
  -psy-rd            <string>     E..V....... Strength of psychovisual optimization, in <psy-rd>:<psy-trellis> format.
  -rc-lookahead      <int>        E..V....... Number of frames to look ahead for frametype and ratecontrol (from -1 to INT_MAX) (default -1)
  -weightb           <boolean>    E..V....... Weighted prediction for B-frames. (default auto)
  -weightp           <int>        E..V....... Weighted prediction analysis method. (from -1 to INT_MAX) (default -1)
     none            0            E..V.......
     simple          1            E..V.......
     smart           2            E..V.......
  -ssim              <boolean>    E..V....... Calculate and print SSIM stats. (default auto)
  -intra-refresh     <boolean>    E..V....... Use Periodic Intra Refresh instead of IDR frames. (default auto)
  -bluray-compat     <boolean>    E..V....... Bluray compatibility workarounds. (default auto)
  -b-bias            <int>        E..V....... Influences how often B-frames are used (from INT_MIN to INT_MAX) (default INT_MIN)
  -b-pyramid         <int>        E..V....... Keep some B-frames as references. (from -1 to INT_MAX) (default -1)
     none            0            E..V.......
     strict          1            E..V....... Strictly hierarchical pyramid
     normal          2            E..V....... Non-strict (not Blu-ray compatible)
  -mixed-refs        <boolean>    E..V....... One reference per partition, as opposed to one reference per macroblock (default auto)
  -8x8dct            <boolean>    E..V....... High profile 8x8 transform. (default auto)
  -fast-pskip        <boolean>    E..V....... (default auto)
  -aud               <boolean>    E..V....... Use access unit delimiters. (default auto)
  -mbtree            <boolean>    E..V....... Use macroblock tree ratecontrol. (default auto)
  -deblock           <string>     E..V....... Loop filter parameters, in <alpha:beta> form.
  -cplxblur          <float>      E..V....... Reduce fluctuations in QP (before curve compression) (from -1 to FLT_MAX) (default -1)
  -partitions        <string>     E..V....... A comma-separated list of partitions to consider. Possible values: p8x8, p4x4, b8x8, i8x8, i4x4, none, all
  -direct-pred       <int>        E..V....... Direct MV prediction mode (from -1 to INT_MAX) (default -1)
     none            0            E..V.......
     spatial         1            E..V.......
     temporal        2            E..V.......
     auto            3            E..V.......
  -slice-max-size    <int>        E..V....... Limit the size of each slice in bytes (from -1 to INT_MAX) (default -1)
  -stats             <string>     E..V....... Filename for 2 pass stats
  -nal-hrd           <int>        E..V....... Signal HRD information (requires vbv-bufsize; cbr not allowed in .mp4) (from -1 to INT_MAX) (default -1)
     none            0            E..V.......
     vbr             1            E..V.......
     cbr             2            E..V.......
  -avcintra-class    <int>        E..V....... AVC-Intra class 50/100/200/300/480 (from -1 to 480) (default -1)
  -me_method         <int>        E..V....... Set motion estimation method (from -1 to 4) (default -1)
     dia             0            E..V.......
     hex             1            E..V.......
     umh             2            E..V.......
     esa             3            E..V.......
     tesa            4            E..V.......
  -motion-est        <int>        E..V....... Set motion estimation method (from -1 to 4) (default -1)
     dia             0            E..V.......
     hex             1            E..V.......
     umh             2            E..V.......
     esa             3            E..V.......
     tesa            4            E..V.......
  -forced-idr        <boolean>    E..V....... If forcing keyframes, force them as IDR frames. (default false)
  -coder             <int>        E..V....... Coder type (from -1 to 1) (default default)
     default         -1           E..V.......
     cavlc           0            E..V.......
     cabac           1            E..V.......
     vlc             0            E..V.......
     ac              1            E..V.......
  -b_strategy        <int>        E..V....... Strategy to choose between I/P/B-frames (from -1 to 2) (default -1)
  -chromaoffset      <int>        E..V....... QP difference between chroma and luma (from INT_MIN to INT_MAX) (default 0)
  -sc_threshold      <int>        E..V....... Scene change threshold (from INT_MIN to INT_MAX) (default -1)
  -noise_reduction   <int>        E..V....... Noise reduction (from INT_MIN to INT_MAX) (default -1)
  -udu_sei           <boolean>    E..V....... Use user data unregistered SEI if available (default false)
  -x264-params       <dictionary> E..V....... Override the x264 configuration using a :-separated list of key=value parameters

1.3 打印帮助或者支持能力的信息

  • 获取help信息
  • 打印各种格式支持的能力
Print help / information / capabilities:
-L                  show license
-h topic            show help
-? topic            show help
-help topic         show help
--help topic        show help
-version            show version
-buildconf          show build configuration
-formats            show available formats
-muxers             show available muxers
-demuxers           show available demuxers
-devices            show available devices
-codecs             show available codecs
-decoders           show available decoders
-encoders           show available encoders
-bsfs               show available bit stream filters
-protocols          show available protocols
-filters            show available filters
-pix_fmts           show available pixel formats
-layouts            show standard channel layouts
-sample_fmts        show available audio sample formats
-dispositions       show available stream dispositions
-colors             show available color names
-sources device     list sources of the input device
-sinks device       list sinks of the output device
-hwaccels           show available HW acceleration methods

1.4 全局选项

  •  全局选项说明
Global options (affect whole program instead of just one file):
-loglevel loglevel  set logging level
-v loglevel         set logging level
-report             generate a report
-max_alloc bytes    set maximum size of a single allocated block
-y                  overwrite output files
-n                  never overwrite output files
-ignore_unknown     Ignore unknown stream types
-filter_threads     number of non-complex filter threads
-filter_complex_threads  number of threads for -filter_complex
-stats              print progress report during encoding
-max_error_rate maximum error rate  ratio of decoding errors (0.0: no errors, 1.0: 100% errors) above which ffmpeg returns an error instead of success.
-vol volume         change audio volume (256=normal)

1.5 文件选项

  • 针对每个文件可以指定的选项
  • 例:-f fmt指定的文件的格式
Per-file main options:
-f fmt              force format
-c codec            codec name
-codec codec        codec name
-pre preset         preset name
-map_metadata outfile[,metadata]:infile[,metadata]  set metadata information of outfile from infile
-t duration         record or transcode "duration" seconds of audio/video
-to time_stop       record or transcode stop time
-fs limit_size      set the limit file size in bytes
-ss time_off        set the start time offset
-sseof time_off     set the start time offset relative to EOF
-seek_timestamp     enable/disable seeking by timestamp with -ss
-timestamp time     set the recording timestamp ('now' to set the current time)
-metadata string=string  add metadata
-program title=string:st=number...  add program with specified streams
-target type        specify target file type ("vcd", "svcd", "dvd", "dv" or "dv50" with optional prefixes "pal-", "ntsc-" or "film-")
-apad               audio pad
-frames number      set the number of frames to output
-filter filter_graph  set stream filtergraph
-filter_script filename  read stream filtergraph description from a file
-reinit_filter      reinit filtergraph on input parameter changes
-discard            discard
-disposition        disposition

1.6 视频/音频/字幕相关选项

  •  针对视频/音频/字幕相关的选项
Video options:
-vframes number     set the number of video frames to output
-r rate             set frame rate (Hz value, fraction or abbreviation)
-fpsmax rate        set max frame rate (Hz value, fraction or abbreviation)
-s size             set frame size (WxH or abbreviation)
-aspect aspect      set aspect ratio (4:3, 16:9 or 1.3333, 1.7777)
-vn                 disable video
-vcodec codec       force video codec ('copy' to copy stream)
-timecode hh:mm:ss[:;.]ff  set initial TimeCode value.
-pass n             select the pass number (1 to 3)
-vf filter_graph    set video filters
-ab bitrate         audio bitrate (please use -b:a)
-b bitrate          video bitrate (please use -b:v)
-dn                 disable data

Audio options:
-aframes number     set the number of audio frames to output
-aq quality         set audio quality (codec-specific)
-ar rate            set audio sampling rate (in Hz)
-ac channels        set number of audio channels
-an                 disable audio
-acodec codec       force audio codec ('copy' to copy stream)
-vol volume         change audio volume (256=normal)
-af filter_graph    set audio filters

Subtitle options:
-s size             set frame size (WxH or abbreviation)
-sn                 disable subtitle
-scodec codec       force subtitle codec ('copy' to copy stream)
-stag fourcc/tag    force subtitle tag/fourcc
-fix_sub_duration   fix subtitles duration
-canvas_size size   set canvas size (WxH or abbreviation)
-spre preset        set the subtitle options to the indicated preset

2,流选择选项

  • 媒体格式如Mp4、AVI等内部包含了多种类型的流
    • FFmpeg可以识别5种流类型
    • 音频 audio a
    • 附件 attachment t
    • 数据 data d
    • 字幕 subtitle s
    • 视频 video v
  • 使用 -map选择需要的流,语法如下 file_number:stream_type[:stream_number]
    • file_number:       文件索引
    • stream_number  流索引 
  • 特别的流选择指令
    • -map 0  选择所有的流类型和其中所有的流
    • -map i:v  选择文件i中的所有视频流
    • -map i:a  选择文件i中的所有音频流
    • -map i:s  选择文件i中的所有字幕流

3,视频封装解封装

3.1 视频格式转换

chy-cpabe@ubuntu:~/ffmpeg-source/ffmpeg$ ffmpeg -i /home/chy-cpabe/Videos/avi_2_mp4.mp4 /home/chy-cpabe/Videos/mp4_2_ts.ts
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/home/chy-cpabe/Videos/avi_2_mp4.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf59.23.100
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1632 kb/s
  Stream #0:0[0x1](und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1500 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](und): Audio: mp3 (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 -> #0:0 (mpeg4 (native) -> mpeg2video (native))
  Stream #0:1 -> #0:1 (mp3 (mp3float) -> mp2 (native))
Press [q] to stop, [?] for help
Output #0, mpegts, to '/home/chy-cpabe/Videos/mp4_2_ts.ts':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf59.23.100
  Stream #0:0(und): Video: mpeg2video (Main), yuv420p(progressive), 480x360 [SAR 1:1 DAR 4:3], q=2-31, 200 kb/s, 24 fps, 90k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.27.100 mpeg2video
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
  Stream #0:1(und): Audio: mp2, 44100 Hz, stereo, s16, 384 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.27.100 mp2
frame= 1082 fps=622 q=31.0 Lsize=    4504kB time=00:00:45.04 bitrate= 819.1kbits/s speed=25.9x    
video:1968kB audio:2111kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 10.405245%

3.2 分离/合并视频音频流

  • 分离音频流
    • ffmpeg -i input-video -vn -c:a copy output-audio
      • -vn:表示不要视频
      • -acodec copy:表示拷贝输入视频的音频流
      • 输出文件 例如 output.wav
chy-cpabe@ubuntu:~/ffmpeg-source/ffmpeg$ ffmpeg -i /home/chy-cpabe/Videos/video_avi.avi -vn -c:a copy /home/chy-cpabe/Videos/video_avi.wav
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, avi, from '/home/chy-cpabe/Videos/video_avi.avi':
  Metadata:
    software        : Lavf54.59.106
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1640 kb/s
  Stream #0:0: Video: mpeg4 (Simple Profile) (FMP4 / 0x34504D46), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1501 kb/s, 24 fps, 24 tbr, 24 tbn
  Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp, 128 kb/s
Output #0, wav, to '/home/chy-cpabe/Videos/video_avi.wav':
  Metadata:
    software        : Lavf54.59.106
    ISFT            : Lavf59.23.100
  Stream #0:0: Audio: mp3 (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp, 128 kb/s
Stream mapping:
  Stream #0:1 -> #0:0 (copy)
Press [q] to stop, [?] for help
size=     704kB time=00:00:45.03 bitrate= 128.0kbits/s speed=6.41e+03x    
video:0kB audio:704kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.014572%
  • 分离视频流
    • ffmpeg -i input-video -c:v copy -an output-video
      • -an:表示不要音频
      • -vcodec copy:表示拷贝输入视频的视频流
  • 同时分离音频和视频流
    • ffmpeg -i input-video -c:v copy -an output-video -c:a copy -vn output-audio
    • ffmpeg -i /home/chy-cpabe/Videos/video_avi.avi -c:v copy -an /home/chy-cpabe/Videos/video_mp4_1.mp4 -c:a copy -vn /home/chy-cpabe/Videos/video_avi_1.wav
      
  • 合并视频音频流
    • ffmpeg -i video_file -i audio_file -c:v copy -c:a copy output_file
    • ffmpeg -i /home/chy-cpabe/Videos/video_avi_1.wav -i /home/chy-cpabe/Videos/video_mp4_1.mp4 -c:v copy -c:v copy /home/chy-cpabe/Videos/merge.mp4
      

3.3 截取视频片段

  • 截取视频片段
    • ffmpeg -ss 5 -i input.mp4 -t 10 -c:v copy -c:a copy output.mp4
      • -ss 5指定从输入视频第5秒开始截取,-t 10指明最多截取10秒
      • 而-c:v copy -c:a copy标示视频与音频的编码不发生改变,而是直接复制,这样会大大提升速度,因为这样就不需要完全解码视频
      • 例子:ffmpeg -ss 5 -i merge.mp4 -t 10 -c:v copy -c:a copy merge_5-15.mp4
    • 截取10s到20s
      • 这个存在一个问题:音频数据流与先前保持不变,视频数据流 只显示10-20的数据
      • ffmpeg -i input.mp4 -c:v libx264 -filter:v select="between(t\, 10\, 20)" out.mp4
  • 从头截取前10帧
    • ffmpeg -i input.mp4 -c:v libx264 -filter:v select="gt(n\, -1)" -vframes 10 out.mp4
    • ffmpeg -i input.mp4 -c:v libx264 -filter:v select="between(n\, 0\, 9)" out.mp4
  • 中间截取 10-20 帧
    • ffmpeg -i input.mp4 -c:v libx264 -filter:v select="between(n\, 10\, 20)" out.mp4

3.4 视频转换为m3u8格式

  • ffmpeg -i yoona.mp4 -c copy -map 0 -f segment -segment_list yoona.m3u8 -segment_time 10 yoona-%04d.ts

    • 形成一个以m3u8结尾的视频文件,并进一步进行数据切分,形成以 yoona-%04d.ts命名规则以ts结尾的的视频切片

  • ffmpeg -i output20.mp4 -codec copy  -hls_list_size 0  -hls_wrap 0 -strict -2  -vbsf h264_mp4toannexb -absf aac_adtstoasc -f hls -hls_base_url https://test.com/ test.m3u8
    • -hls_time n: 设置每片的长度,默认值为2。单位为秒。即EXTINF tag对应的值。hls_time设置后效果不一定准确,会受到关键帧大小及其他因素影响。如果需要相对非常准确的切片,可以添加hls_flags的子参数split_by_time来保证生成的切片能够与hls_time设置的切片时长差不多。split_by_time参数必须与hls_time配合使用,并且使用split_by_time参数有可能会影响首画面体验,例如花屏或者首画面显示慢的问题,因为视频的第一帧不一定是关键帧。
    • -hls_list_size n:设置播放列表保存的最多条目,设置为0会保存有所片信息,默认值为5。为了解决这个问题,需要指定参数-hls_list_size 0,这样就能包含所有的片段。
    • -hls_wrap n:设置多少片之后开始覆盖,如果设置为0则不会覆盖,默认值为0.这个选项能够避免在磁盘上存储过多的 片,而且能够限制写入磁盘的最多的片的数量。
    • -hls_start_number n:设置播放列表中sequence number的值为number,默认值为0。注意:播放列表的sequence number 对每个segment来说都必须是唯一的,而且它不能和片的文件名(当使用wrap选项时,文件名有可能会重复使用)混淆
    • h264_mp4toannexb: h264有两种封装,一种是annexb模式,传统模式,有startcode,SPS和PPS是在ES中,vlc里打开编码器信息中显示h264;一种是mp4模式,一般mp4 ,mkv会有,没有startcode,SPS和PPS以及其它信息被封装在container中,每一个frame前面是这个frame的长度,vlc里打开编码器信息中显示avc1。很多解码器只支持annexb这种模式,因此需要将mp4做转换。
    • aac_adtstoasc:将AAC编码器编码后的原始码流(ADTS头 + ES流)封装为MP4或者FLV或者MOV等格式时,需要先将ADTS头转换为MPEG-4 AudioSpecficConfig (将音频相关编解码参数提取出来),并将原始码流中的ADTS头去掉(只剩下ES流);相反,从MP4或者FLV或者MOV等格式文件中解封装出AAC码流(只有ES流)时,需要在解析出的AAC码流前添加ADTS头(含音频相关编解码参数)
    • hls_base_url 参数用于为M3U8列表的文件路径设置前置基本路径参数,因为在FFmpeg中生成M3U8时写入的TS切片路径默认为M3U8生成的路径相同,但是实际上TS所存储的路径既可以为本地绝对路径,也可以为相对路

3.5 把视频文件推送到rtmp服务器

  • ffmpeg -re -i jack.mp4 -c copy -f flv rtmp://host/live/test        
  • 需要搭建 支持rtmp协议的服务器

3.6 对视频进行切片

  • 均匀切片
    • ffmpeg -i input.mp4 -c copy -f segment -segment_format mp4 -segment_time 300 -reset_timestamps 1 test_output-%d.mp4 
    • 将input.mp4 切换为5分钟时长的视频片段  300 / 60 = 5
    • 使用ffmpeg -h muxer=segment 查询segment muxer的参数
  • 按照时间点进行视频裁剪
    • ffmpeg -i input.mp4 -c copy -f segment -segment_format mp4 -segment_times 60,120,150 -reset_timestamps 1 test_output-%d.mp4 
    • 在第60秒 120秒 150秒 这三个时间点进行数据切片

4,视频解码编码

4.1 视频截图

  • 获取指定时间点的截图
ffmpeg -ss 01:23:45 -i input -vframes 1 -q:v 2 output.jpg

-i input file           the path to the input file
-ss 01:23:45            seek the position to the specified timestamp
-vframes 1              only handle one video frame
-q:v 2                  to control output quality. Full range is a linear scale of 1-31 where a lower value results in a higher quality. 2-5 is a good range to try.
output.jpg              output filename, should have a well-known extension
  • 截取指定帧序号的图像 帧序号从0开始
  • ffmpeg -i <input> -vf "select=eq(n\,34)" -vframes 1 out.png
  • 例子:ffmpeg -i test.mp4 -vf "select=eq(n\,6)" -vframes 1 output_1.png 

4.2 视频/图片尺寸修改

  • 安装imagemagick,apt-get install imagemagick
  • 用identify命令查看图片信息 数据信息较少 
  • 包括:文件名,图像格式,图像大小,图像深度,颜色空间,文件大小,用户时间等,例如:

chy-cpabe@ubuntu:~/Videos$ identify -verbose output.png 
Image: output.png
  Format: PNG (Portable Network Graphics)
  Mime type: image/png
  Class: DirectClass
  Geometry: 1920x1080+0+0
  Resolution: 1x1
  Print size: 1920x1080
  Units: Undefined
  Type: TrueColor
  Endianess: Undefined
  Colorspace: sRGB
  Depth: 8-bit
  Channel depth:
    red: 8-bit
    green: 8-bit
    blue: 8-bit
  Channel statistics:
    Pixels: 2073600
    Red:
      min: 0 (0)
      max: 255 (1)
      mean: 131.067 (0.513989)
      standard deviation: 56.6858 (0.222297)
      kurtosis: -1.2
      skewness: -0.241095
      entropy: 0.923994
    Green:
      min: 0 (0)
      max: 255 (1)
      mean: 147.134 (0.576995)
      standard deviation: 62.2514 (0.244123)
      kurtosis: -1.2576
      skewness: -0.216637
      entropy: 0.933398
    Blue:
      min: 0 (0)
      max: 255 (1)
      mean: 147.762 (0.579459)
      standard deviation: 66.8398 (0.262117)
      kurtosis: -1.27695
      skewness: -0.220383
      entropy: 0.936936
  Image statistics:
    Overall:
      min: 0 (0)
      max: 255 (1)
      mean: 141.988 (0.556814)
      standard deviation: 62.0647 (0.243391)
      kurtosis: -1.15139
      skewness: -0.182663
      entropy: 0.931443
  Rendering intent: Perceptual
  Gamma: 0.50994
  Chromaticity:
    red primary: (0.64,0.33)
    green primary: (0.3,0.6)
    blue primary: (0.15,0.06)
    white point: (0.3127,0.329)
  Background color: white
  Border color: srgb(223,223,223)
  Matte color: grey74
  Transparent color: black
  Interlace: None
  Intensity: Undefined
  Compose: Over
  Page geometry: 1920x1080+0+0
  Dispose: Undefined
  Iterations: 0
  Compression: Zip
  Orientation: Undefined
  Properties:
    date:create: 2022-05-15T00:04:35-07:00
    date:modify: 2022-05-15T00:04:35-07:00
    png:cHRM: chunk was found (see Chromaticity, above)
    png:gAMA: gamma=0.50994 (See Gamma, above)
    png:IHDR.bit-depth-orig: 8
    png:IHDR.bit_depth: 8
    png:IHDR.color-type-orig: 2
    png:IHDR.color_type: 2 (Truecolor)
    png:IHDR.interlace_method: 0 (Not interlaced)
    png:IHDR.width,height: 1920, 1080
    png:pHYs: x_res=1, y_res=1, units=0
    signature: 102364a6ba97efa6c6693cdca6ecbc0df735fa8532195c0c7b21aec0c3e254f9
  Artifacts:
    filename: output.png
    verbose: true
  Tainted: False
  Filesize: 2.39MB
  Number pixels: 2.074M
  Pixels per second: 29.62MB
  User time: 0.050u
  Elapsed time: 0:01.070
  Version: ImageMagick 6.9.7-4 Q16 x86_64 20170114 http://www.imagemagick.org
  • 修改 图片的储存大小为先前的一半
  • ffmpeg -i sample.jpg -s w*h out.jpg  
  • ffmpeg -i output.png -s 960*540 output_change.png

4.3 分离视频的YUV通道分量

  • ffmpeg -i jack.mp4 -filter_complex "extractplanes=y+u+v[y][u][v]" -map "[y]" jack_y.mp4 -map "[u]" jack_u.mp4 -map "[v]" jack_v.mp4    
  • https://zh.wikipedia.org/zh-sg/YUV
chy-cpabe@ubuntu:~/Videos$ ffmpeg -i test.mp4 -filter_complex "extractplanes=y+u+v[y][u][v]" -map "[y]" out_y.mp4 -map "[u]" out_u.mp4 -map "[v]" out_v.mp4
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test.mp4':
  Metadata:
    major_brand     : M4V 
    minor_version   : 1
    compatible_brands: isomavc1mp42
    creation_time   : 2021-02-14T02:11:02.000000Z
  Duration: 00:00:23.36, start: 0.000000, bitrate: 6313 kb/s
  Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 6147 kb/s, 23.98 fps, 23.98 tbr, 24k tbn (default)
    Metadata:
      creation_time   : 2021-02-14T02:11:02.000000Z
      handler_name    : ETI ISO Video Media Handler
      vendor_id       : [0][0][0][0]
      encoder         : Elemental H.264
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 160 kb/s (default)
    Metadata:
      creation_time   : 2021-02-14T02:11:02.000000Z
      handler_name    : ETI ISO Audio Media Handler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 (h264) -> extractplanes:default
  extractplanes -> Stream #0:0 (libx264)
  extractplanes -> Stream #1:0 (libx264)
  extractplanes -> Stream #2:0 (libx264)
Press [q] to stop, [?] for help
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284e9dc40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284eba2c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284ed4580] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284eee840] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284f08b00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284f22dc0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284f3d080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284f57340] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284e90c40] [swscaler @ 0x559284f72540] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559284f95b40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559284fafe00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559284fca0c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559284fe4380] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559284ffe640] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559285018900] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559285033b00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x55928504a140] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284f88b80] [swscaler @ 0x559285064400] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x55928508b680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x5592850b4980] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x5592850dbe40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x5592850f3ec0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x559285123380] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x55928514a840] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x559285171d00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x559285189d80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55928507e6c0] [swscaler @ 0x5592851b9240] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eb83c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f70680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284ee6080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f55480] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f62440] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eff1c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284e90c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f20f80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f2fd80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eb83c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f70680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284ee6080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f55480] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f62440] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eff1c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284e90c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f20f80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f31bc0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eb83c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f70680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284ee6080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f55480] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f62440] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284eff1c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284e90c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f20f80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284ed2700] [swscaler @ 0x559284f2fd80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fadf80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fe2500] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285031c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284ff4f40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285001f00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285016ac0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284f88b40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x5592850482c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285055280] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fadf80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fe2500] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285031c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284ff4f40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285001f00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285016ac0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285023ac0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284f8c840] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x5592850482c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fadf80] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284fe2500] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285031c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284ff4f40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285001f00] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285016ac0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559285023ac0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x559284f8c840] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x559284fc8240] [swscaler @ 0x5592850482c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928515f080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285197340] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592851b5580] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850bc280] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285175980] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850da000] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285091140] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285114380] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928513f580] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928515f080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285197340] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285150480] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850b68c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285173c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850da000] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928507e4c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285094bc0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928512e880] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928515f080] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285197340] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285150480] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850b68c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285173c40] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x5592850da000] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928507e4c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x559285094bc0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x5592851a8400] [swscaler @ 0x55928512e880] deprecated pixel format used, make sure you did set range correctly
[libx264 @ 0x559283ebb640] using SAR=1/1
[libx264 @ 0x559283ebb640] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x559283ebb640] profile High 4:4:4 Predictive, level 4.0, 4:4:4 8-bit
[libx264 @ 0x559283ebb640] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=23 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'out_y.mp4':
  Metadata:
    major_brand     : M4V 
    minor_version   : 1
    compatible_brands: isomavc1mp42
    encoder         : Lavf59.23.100
  Stream #0:0: Video: h264 (avc1 / 0x31637661), yuvj444p(pc, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 23.98 fps, 24k tbn
    Metadata:
      encoder         : Lavc59.27.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
[libx264 @ 0x559283e909c0] using SAR=1/1
[libx264 @ 0x559283e909c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x559283e909c0] profile High 4:4:4 Predictive, level 3.1, 4:4:4 8-bit
[libx264 @ 0x559283e909c0] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=23 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #1, mp4, to 'out_u.mp4':
  Metadata:
    major_brand     : M4V 
    minor_version   : 1
    compatible_brands: isomavc1mp42
    encoder         : Lavf59.23.100
  Stream #1:0: Video: h264 (avc1 / 0x31637661), yuvj444p(pc, bt709, progressive), 960x540 [SAR 1:1 DAR 16:9], q=2-31, 23.98 fps, 24k tbn
    Metadata:
      encoder         : Lavc59.27.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
[libx264 @ 0x559283ec5680] using SAR=1/1
[libx264 @ 0x559283ec5680] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x559283ec5680] profile High 4:4:4 Predictive, level 3.1, 4:4:4 8-bit
[libx264 @ 0x559283ec5680] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=23 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #2, mp4, to 'out_v.mp4':
  Metadata:
    major_brand     : M4V 
    minor_version   : 1
    compatible_brands: isomavc1mp42
    encoder         : Lavf59.23.100
  Stream #2:0: Video: h264 (avc1 / 0x31637661), yuvj444p(pc, bt709, progressive), 960x540 [SAR 1:1 DAR 16:9], q=2-31, 23.98 fps, 24k tbn
    Metadata:
      encoder         : Lavc59.27.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=  560 fps= 13 q=-1.0 Lq=-1.0 q=-1.0 size=   15581kB time=00:00:23.23 bitrate=5494.4kbits/s speed=0.556x    
video:17234kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
[libx264 @ 0x559283ebb640] frame I:3     Avg QP:20.11  size:127210
[libx264 @ 0x559283ebb640] frame P:204   Avg QP:22.05  size: 51523
[libx264 @ 0x559283ebb640] frame B:353   Avg QP:25.57  size: 14319
[libx264 @ 0x559283ebb640] consecutive B-frames:  3.2% 36.4%  5.4% 55.0%
[libx264 @ 0x559283ebb640] mb I  I16..4: 43.2%  0.0% 56.8%
[libx264 @ 0x559283ebb640] mb P  I16..4: 16.9%  0.0%  8.5%  P16..4: 39.6% 15.0%  5.4%  0.0%  0.0%    skip:14.6%
[libx264 @ 0x559283ebb640] mb B  I16..4:  1.7%  0.0%  0.7%  B16..8: 44.4%  5.9%  0.8%  direct: 2.2%  skip:44.2%  L0:43.1% L1:48.9% BI: 8.0%
[libx264 @ 0x559283ebb640] coded y,u,v intra: 28.8% 0.0% 0.0% inter: 14.0% 0.0% 0.0%
[libx264 @ 0x559283ebb640] i16 v,h,dc,p: 51% 24% 14% 11%
[libx264 @ 0x559283ebb640] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 18% 21%  5%  7%  5%  8%  4%  6%
[libx264 @ 0x559283ebb640] Weighted P-Frames: Y:5.4% UV:0.0%
[libx264 @ 0x559283ebb640] ref P L0: 65.1% 19.9% 10.6%  4.1%  0.3%
[libx264 @ 0x559283ebb640] ref B L0: 92.5%  6.0%  1.5%
[libx264 @ 0x559283ebb640] ref B L1: 98.6%  1.4%
[libx264 @ 0x559283ebb640] kb/s:5462.08
[libx264 @ 0x559283e909c0] frame I:13    Avg QP:12.93  size:  4437
[libx264 @ 0x559283e909c0] frame P:214   Avg QP:16.17  size:  2041
[libx264 @ 0x559283e909c0] frame B:333   Avg QP:16.81  size:   871
[libx264 @ 0x559283e909c0] consecutive B-frames:  3.2% 51.1%  4.3% 41.4%
[libx264 @ 0x559283e909c0] mb I  I16..4: 86.6%  0.0% 13.4%
[libx264 @ 0x559283e909c0] mb P  I16..4: 16.9%  0.0%  0.3%  P16..4: 24.3%  3.5%  1.7%  0.0%  0.0%    skip:53.3%
[libx264 @ 0x559283e909c0] mb B  I16..4:  0.4%  0.0%  0.0%  B16..8: 26.6%  1.8%  0.0%  direct: 0.1%  skip:71.0%  L0:44.5% L1:55.2% BI: 0.4%
[libx264 @ 0x559283e909c0] coded y,u,v intra: 1.9% 0.0% 0.0% inter: 0.9% 0.0% 0.0%
[libx264 @ 0x559283e909c0] i16 v,h,dc,p: 62% 23% 11%  4%
[libx264 @ 0x559283e909c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 25% 33%  1%  1%  1%  1%  0%  0%
[libx264 @ 0x559283e909c0] Weighted P-Frames: Y:0.5% UV:0.0%
[libx264 @ 0x559283e909c0] ref P L0: 74.1%  3.1% 16.5%  6.2%  0.0%
[libx264 @ 0x559283e909c0] ref B L0: 88.4%  9.7%  1.9%
[libx264 @ 0x559283e909c0] ref B L1: 98.5%  1.5%
[libx264 @ 0x559283e909c0] kb/s:268.71
[libx264 @ 0x559283ec5680] frame I:12    Avg QP:13.33  size:  5060
[libx264 @ 0x559283ec5680] frame P:255   Avg QP:16.90  size:  2326
[libx264 @ 0x559283ec5680] frame B:293   Avg QP:17.38  size:   888
[libx264 @ 0x559283ec5680] consecutive B-frames:  3.9% 78.6%  1.1% 16.4%
[libx264 @ 0x559283ec5680] mb I  I16..4: 83.6%  0.0% 16.4%
[libx264 @ 0x559283ec5680] mb P  I16..4: 17.8%  0.0%  0.3%  P16..4: 26.9%  4.2%  2.1%  0.0%  0.0%    skip:48.6%
[libx264 @ 0x559283ec5680] mb B  I16..4:  0.3%  0.0%  0.0%  B16..8: 28.3%  1.9%  0.0%  direct: 0.1%  skip:69.3%  L0:40.1% L1:59.5% BI: 0.4%
[libx264 @ 0x559283ec5680] coded y,u,v intra: 1.9% 0.0% 0.0% inter: 1.4% 0.0% 0.0%
[libx264 @ 0x559283ec5680] i16 v,h,dc,p: 61% 23% 12%  4%
[libx264 @ 0x559283ec5680] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 25% 34%  1%  1%  1%  1%  0%  0%
[libx264 @ 0x559283ec5680] Weighted P-Frames: Y:0.8% UV:0.0%
[libx264 @ 0x559283ec5680] ref P L0: 75.7%  4.3% 14.4%  5.5%  0.1%
[libx264 @ 0x559283ec5680] ref B L0: 88.6% 10.5%  0.9%
[libx264 @ 0x559283ec5680] ref B L1: 99.4%  0.6%
[libx264 @ 0x559283ec5680] kb/s:313.09

4.4 图片序列与视频的互相转换

  • ffmpeg -i %04d.jpg output.mp4     把0001.jpg、0002.jpg、0003.jpg等编码成output.mp4
  • ffmpeg -i input.mp4 %04d.jpg       把input.mp4变成0001.jpg等,%04d.jpg表示从1开始用0补全的4位整数为文件名的jpg文件序列

5,视频filter

5.1 视频加水印overlay

  • ffmpeg -i xizong.mp4 -i fleight.jpg -filter_complex "overlay=W-w-5:5" -codec:a copy xizong_fleight.mp4
  • 在右上角加水印,边距为5像素
  • 将一张图片作为水印 添加在 右上角

5.2 视频旋转transpose

  • 顺时针旋转90度
    • ffmpeg -i input -vf transpose=1 output
  • 顺时针旋转180度
    • ffmpeg -i in.mp4 -vf "transpose=1,transpose=1" out.mp4

5.3 调色3DLutFilter

  • 应用颜色查找表Lut,有‘nearest’、‘trilinear’、‘tetrahedral’三种插值算法
  • 命令行调用如下: ffmpeg -i log.mp4 -vf lut3d="file=DK79.cube"  out.mp4 
  • 存在问题 找不到 DK79.cube

5.4 图像/视频转换成黑白的

  • 图像转换成黑白的
    • ffmpeg -i sample.png -vf hue=s=0 output.png
  • 把视频转换为黑白的
    • ffmpeg -i julin_5s.mp4 -vf hue=s=0 -c:a copy julin_monochrome.mp4 

5.5 裁剪视频crop

  • 使用-crop选项,语法如下
  • crop=ow[:oh[:x[:y[:keep_aspect]]]]
    • ow、oh表示裁减之后输出视频的宽和高
    •  x、y表示在输入视频上开始裁减的横坐标和纵坐标
    • keep_aspect: 1表示保持裁剪后输出的纵横比与输入一致,0表示不保持
  • 裁剪输入视频的左三分之一
    • ffmpeg -i input -vf crop=iw/3:ih :0:0 output
  • 裁剪输入视频的中间三分之一
    • ffmpeg -i input -vf crop=iw/3:ih :iw/3:0 output
  • 裁剪输入视频的右三分之一:
    • ffmpeg -i input -vf crop=iw/3:ih :iw/3*2:0 output
  • 裁剪中间一半区域:
    • ffmpeg -i input -vf crop=iw/2:ih/2 output 

5.6 视频尺寸缩放scale

  • 将输入的1920*1080 缩小到 960*540 输出
  • ffmpeg -i input.mp4 -vf scale=960:540 output.mp4
  • 如果540不写,写成-1,即scale=960:-1, 那也是可以的,ffmpeg会通知缩放滤镜在输出时保持原始的宽高比。

5.7 视频中去水印delogo

  • 使用delogo filter
  • 它对logo周围像素的简单插值来实现。只需设置一个覆盖logo的矩形。在每个方向上,紧靠矩形外的下一个像素的值将用于计算矩形内的插值像素值。
  • 语法:-vf delogo=x:y:w:h[:t[:show]]
    • x:y 离左上角的坐标
    • w:h logo的宽和高
    • show:默认值0,若设置为1,指定区域的边界会绘制一个绿色的矩形框用于找到合适的x、y、w、h参数
  • 例子:ffmpeg -i pic_video.mp4 -filter_complex "delogo=x=1800:y=20:w=80:h=80:show=1" dellogo.mp4
  • 使用ffmpeg视频去水印__sleeping的博客-CSDN博客_ffmpeg去除视频水印

5.8 给视频或图像加上黑边pad

  • 比如一个输入视频尺寸是1280x534,想加上黑边变成1280x720,使用下面的命令可以实现
  • ffmpeg -i input.mp4 -vf pad=1280:720:0:93:black output.mp4
  • 按照从左到右的顺序依次为:“宽”、“高”、“X坐标”和“Y坐标”,宽和高指的是输入视频尺寸(包含加黑边的尺寸),X、Y指的是视频所在位置
  •  默认是加黑色的边,black可以不写。 上面的命令中93是根据(720-534) / 2计算得到
  • 如果视频原始1920x800的话,完整的语法应该是
  •  ffmpeg -i input.mp4 -vf 'scale=1280:534,pad=1280:720:0:93:black' 先将视频缩小到1280x534,然后在加入黑边变成1280x720,将1280x534的视频放置在x=0,y=93的地方。
  • 例子:ffmpeg -i pic_video.mp4 -vf 'scale=1280:534,pad=1280:720:0:93:red' red_dellogo.mp4 

5.9 计算psnr/ssim

  • 分析 psnr 主要是针对转码前的视频和转码后的视频的对比
  • 如果转码是降分辨率,对比的时候,还需要对源视频加 -s widthxhigh,保证分辨率一致再做 psnr 和 ssim 的计算
  • psnr
  • ffmpeg -i src.mp4  -i dst.mp4  -lavfi psnr="stats_file=psnr.log" -f null -
  • ssim
  • ffmpeg -i src.mp4  -i dst.mp4  -lavfi ssim="stats_file=ssim.log" -f null -
  • 同时计算psnr和ssim
  • ffmpeg -i main.mpg -i ref.mpg -lavfi  "ssim;[0:v][1:v]psnr" -f null - 

实际操作

  • 计算psnr和ssim主要目的是  视频转码前后的对比
  • 因此,第一步  将avi格式的视频转换为MP4格式的视频
  • ffmpeg -i test_avi.avi -c:a copy -c:v copy avi_2_mp4.mp4
  • 计算 psnr
  • ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi psnr="stats_file=psnr.log" -f null -
chy-cpabe@ubuntu:~/Videos$ ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi psnr="stats_file=psnr.log" -f null -
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, avi, from 'test_avi.avi':
  Metadata:
    software        : Lavf54.59.106
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1640 kb/s
  Stream #0:0: Video: mpeg4 (Simple Profile) (FMP4 / 0x34504D46), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1501 kb/s, 24 fps, 24 tbr, 24 tbn
  Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp, 128 kb/s
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'avi_2_mp4.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf59.23.100
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1632 kb/s
  Stream #1:0[0x1](und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1500 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #1:1[0x2](und): Audio: mp3 (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 (mpeg4) -> psnr (graph 0)
  Stream #1:0 (mpeg4) -> psnr (graph 0)
  psnr:default (graph 0) -> Stream #0:0 (wrapped_avframe)
  Stream #0:1 -> #0:1 (mp3 (mp3float) -> pcm_s16le (native))
Press [q] to stop, [?] for help
[Parsed_psnr_0 @ 0x55b9216da140] not matching timebases found between first input: 1/24 and second input 1/12288, results may be incorrect!
Output #0, null, to 'pipe:':
  Metadata:
    software        : Lavf54.59.106
    encoder         : Lavf59.23.100
  Stream #0:0: Video: wrapped_avframe, yuv420p(progressive), 480x360 [SAR 1:1 DAR 4:3], q=2-31, 200 kb/s, 24 fps, 24 tbn
    Metadata:
      encoder         : Lavc59.27.100 wrapped_avframe
  Stream #0:1: Audio: pcm_s16le, 44100 Hz, stereo, s16, 1411 kb/s
    Metadata:
      encoder         : Lavc59.27.100 pcm_s16le
frame= 1082 fps=0.0 q=-0.0 Lsize=N/A time=00:00:45.12 bitrate=N/A speed=54.4x    
  • 计算 ssim
  • ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi ssim="stats_file=ssim.log" -f null -
chy-cpabe@ubuntu:~/Videos$ ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi ssim="stats_file=ssim.log" -f null -
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, avi, from 'test_avi.avi':
  Metadata:
    software        : Lavf54.59.106
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1640 kb/s
  Stream #0:0: Video: mpeg4 (Simple Profile) (FMP4 / 0x34504D46), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1501 kb/s, 24 fps, 24 tbr, 24 tbn
  Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp, 128 kb/s
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'avi_2_mp4.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf59.23.100
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1632 kb/s
  Stream #1:0[0x1](und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1500 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #1:1[0x2](und): Audio: mp3 (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 (mpeg4) -> ssim (graph 0)
  Stream #1:0 (mpeg4) -> ssim (graph 0)
  ssim:default (graph 0) -> Stream #0:0 (wrapped_avframe)
  Stream #0:1 -> #0:1 (mp3 (mp3float) -> pcm_s16le (native))
Press [q] to stop, [?] for help
[Parsed_ssim_0 @ 0x5588afcef640] not matching timebases found between first input: 1/24 and second input 1/12288, results may be incorrect!
Output #0, null, to 'pipe:':
  Metadata:
    software        : Lavf54.59.106
    encoder         : Lavf59.23.100
  Stream #0:0: Video: wrapped_avframe, yuv420p(progressive), 480x360 [SAR 1:1 DAR 4:3], q=2-31, 200 kb/s, 24 fps, 24 tbn
    Metadata:
      encoder         : Lavc59.27.100 wrapped_avframe
  Stream #0:1: Audio: pcm_s16le, 44100 Hz, stereo, s16, 1411 kb/s
    Metadata:
      encoder         : Lavc59.27.100 pcm_s16le
frame= 1082 fps=0.0 q=-0.0 Lsize=N/A time=00:00:45.12 bitrate=N/A speed=  49x    
video:499kB audio:7758kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
[Parsed_ssim_0 @ 0x5588afcef640] SSIM Y:1.000000 (inf) U:1.000000 (inf) V:1.000000 (inf) All:1.000000 (inf)
  •  同时计算 psnr 和 ssim
  • ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi "ssim;[0:v][1:v]psnr" -f null -
chy-cpabe@ubuntu:~/Videos$ ffmpeg -i test_avi.avi -i avi_2_mp4.mp4 -lavfi "ssim;[0:v][1:v]psnr" -f null -
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, avi, from 'test_avi.avi':
  Metadata:
    software        : Lavf54.59.106
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1640 kb/s
  Stream #0:0: Video: mpeg4 (Simple Profile) (FMP4 / 0x34504D46), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1501 kb/s, 24 fps, 24 tbr, 24 tbn
  Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 44100 Hz, stereo, fltp, 128 kb/s
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'avi_2_mp4.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf59.23.100
  Duration: 00:00:45.13, start: 0.000000, bitrate: 1632 kb/s
  Stream #1:0[0x1](und): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 480x360 [SAR 1:1 DAR 4:3], 1500 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #1:1[0x2](und): Audio: mp3 (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 (mpeg4) -> ssim (graph 0)
  Stream #0:0 (mpeg4) -> psnr (graph 0)
  Stream #1:0 (mpeg4) -> ssim (graph 0)
  Stream #1:0 (mpeg4) -> psnr (graph 0)
  ssim:default (graph 0) -> Stream #0:0 (wrapped_avframe)
  psnr:default (graph 0) -> Stream #0:1 (wrapped_avframe)
  Stream #0:1 -> #0:2 (mp3 (mp3float) -> pcm_s16le (native))
Press [q] to stop, [?] for help
[Parsed_ssim_0 @ 0x564524f58100] not matching timebases found between first input: 1/24 and second input 1/12288, results may be incorrect!
[Parsed_psnr_1 @ 0x564524f58540] not matching timebases found between first input: 1/24 and second input 1/12288, results may be incorrect!
Output #0, null, to 'pipe:':
  Metadata:
    software        : Lavf54.59.106
    encoder         : Lavf59.23.100
  Stream #0:0: Video: wrapped_avframe, yuv420p(progressive), 480x360 [SAR 1:1 DAR 4:3], q=2-31, 200 kb/s, 24 fps, 24 tbn (default)
    Metadata:
      encoder         : Lavc59.27.100 wrapped_avframe
  Stream #0:1: Video: wrapped_avframe, yuv420p(progressive), 480x360 [SAR 1:1 DAR 4:3], q=2-31, 200 kb/s, 24 fps, 24 tbn
    Metadata:
      encoder         : Lavc59.27.100 wrapped_avframe
  Stream #0:2: Audio: pcm_s16le, 44100 Hz, stereo, s16, 1411 kb/s
    Metadata:
      encoder         : Lavc59.27.100 pcm_s16le
frame= 1082 fps=855 q=-0.0 Lq=-0.0 size=N/A time=00:00:45.12 bitrate=N/A speed=35.7x    
video:997kB audio:7758kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
[Parsed_ssim_0 @ 0x564524f58100] SSIM Y:1.000000 (inf) U:1.000000 (inf) V:1.000000 (inf) All:1.000000 (inf)
[Parsed_psnr_1 @ 0x564524f58540] PSNR y:inf u:inf v:inf average:inf min:inf max:inf

5.10 视频按时间拼接

  • 使用 FFmpeg 的 concat工具 进行多个视频的拼接
  • 首先创建一个文本文件,包含需要拼接的文件的列表

  • 命令:ffmpeg -f concat -i filelist.txt -c copy concat.mp4
  • 如果文件列表编码格式不一致,好像会出现问题

5.11 视频左右拼接

  • 命令
  • ffmpeg -ss 00:05:00 -i v1.mp4 -ss 00:05:00 -i v2.mp4 -filter_complex "[0:v]crop=iw/2:ih:0:0[v1];[1:v]crop=iw/2:ih:iw/2:0[v2];[v1][v2]hstack[v3];[v3]drawbox=iw/2-1:0:2:ih[v4]" -map [v4] -map 0:a -c:a copy -c:v libx264 -t 00:01:00 -y out.mp4

5.12 打印视频帧的一些信息showinfo

  • 命令 ffmpeg -hide_banner  -i  v.mp4 -vf showinfo -frames:v 1 -f null /dev/null
chy-cpabe@ubuntu:~/Videos$ ffmpeg -hide_banner -i merge_out.mp4 -vf showinfo -frames:v 1 -f null /dev/null 
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'merge_out.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.23.100
  Duration: 00:00:12.01, start: 0.000000, bitrate: 6159 kb/s
  Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], 5965 kb/s, 23.98 fps, 23.98 tbr, 24k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 159 kb/s (default)
    Metadata:
      handler_name    : ETI ISO Audio Media Handler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> wrapped_avframe (native))
  Stream #0:1 -> #0:1 (aac (native) -> pcm_s16le (native))
Press [q] to stop, [?] for help
[Parsed_showinfo_0 @ 0x55e361c8ca80] config in time_base: 1/24000, frame_rate: 24000/1001
[Parsed_showinfo_0 @ 0x55e361c8ca80] config out time_base: 0/0, frame_rate: 0/0
[Parsed_showinfo_0 @ 0x55e361c8ca80] n:   0 pts:      0 pts_time:0       pos:    39765 fmt:yuv420p sar:1/1 s:1920x1080 i:P iskey:1 type:I checksum:E0A9A036 plane_checksum:[24B5FB04 BEEA8563 06F21FC0] mean:[150 131 117] stdev:[48.8 2.5 2.7]
[Parsed_showinfo_0 @ 0x55e361c8ca80]   side data - User Data Unregistered:
[Parsed_showinfo_0 @ 0x55e361c8ca80] UUID=dc45e9bd-e6d9-48b7-962c-d820d923eeef
[Parsed_showinfo_0 @ 0x55e361c8ca80] User Data=78323634202d20636f7265203135322072323835342065396135393033202d20482e3236342f4d5045472d342041564320636f646563202d20436f70796c65667420323030332d32303137202d20687474703a2f2f7777772e766964656f6c616e2e6f72672f783236342e68746d6c202d206f7074696f6e733a2063616261633d31207265663d33206465626c6f636b3d313a303a3020616e616c7973653d3078333a3078313133206d653d686578207375626d653d37207073793d31207073795f72643d312e30303a302e3030206d697865645f7265663d31206d655f72616e67653d3136206368726f6d615f6d653d31207472656c6c69733d31203878386463743d312063716d3d3020646561647a6f6e653d32312c313120666173745f70736b69703d31206368726f6d615f71705f6f66667365743d2d3220746872656164733d3132206c6f6f6b61686561645f746872656164733d3220736c696365645f746872656164733d30206e723d3020646563696d6174653d3120696e7465726c616365643d3020626c757261795f636f6d7061743d3020636f6e73747261696e65645f696e7472613d3020626672616d65733d3320625f707972616d69643d3220625f61646170743d3120625f626961733d30206469726563743d3120776569676874623d31206f70656e5f676f703d3020776569676874703d32206b6579696e743d323530206b6579696e745f6d696e3d3233207363656e656375743d343020696e7472615f726566726573683d302072635f6c6f6f6b61686561643d34302072633d637266206d62747265653d31206372663d32332e302071636f6d703d302e36302071706d696e3d302071706d61783d3639207170737465703d342069705f726174696f3d312e34302061713d313a312e303000
[Parsed_showinfo_0 @ 0x55e361c8ca80] 
[Parsed_showinfo_0 @ 0x55e361c8ca80] color_range:unknown color_space:unknown color_primaries:unknown color_trc:unknown
Output #0, null, to '/dev/null':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.23.100
  Stream #0:0(und): Video: wrapped_avframe, yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 23.98 fps, 23.98 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.27.100 wrapped_avframe
  Stream #0:1(und): Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s (default)
    Metadata:
      handler_name    : ETI ISO Audio Media Handler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.27.100 pcm_s16le
[Parsed_showinfo_0 @ 0x55e361c8ca80] n:   1 pts:   1001 pts_time:0.0417083 pos:   226274 fmt:yuv420p sar:1/1 s:1920x1080 i:P iskey:0 type:B checksum:BEF57B91 plane_checksum:[90B31BAC 69027BD1 6593E405] mean:[149 131 117] stdev:[48.9 2.5 2.7]
[Parsed_showinfo_0 @ 0x55e361c8ca80] color_range:unknown color_space:unknown color_primaries:unknown color_trc:unknown
frame=    1 fps=0.0 q=-0.0 Lsize=N/A time=00:00:00.33 bitrate=N/A speed=3.57x    
video:0kB audio:63kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

5.13 生成纯色的图片

chy-cpabe@ubuntu:~/Videos$ ffmpeg -f lavfi -i color=blue:1920*1080 -frames:v 1 -y blue.jpg
ffmpeg version N-106797-g580fb6a8c9 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, lavfi, from 'color=blue:1920*1080':
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 tbr, 25 tbn
Stream mapping:
  Stream #0:0 -> #0:0 (rawvideo (native) -> mjpeg (native))
Press [q] to stop, [?] for help
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c59e32c0] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5a26680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5a69600] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5aaa680] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5aed600] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5b30580] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5b71600] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5bb4580] deprecated pixel format used, make sure you did set range correctly
[swscaler @ 0x55e4c59d5c40] [swscaler @ 0x55e4c5bf5600] deprecated pixel format used, make sure you did set range correctly
Output #0, image2, to 'blue.jpg':
  Metadata:
    encoder         : Lavf59.23.100
  Stream #0:0: Video: mjpeg, yuvj420p(pc, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn
    Metadata:
      encoder         : Lavc59.27.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=2.2 Lsize=N/A time=00:00:00.04 bitrate=N/A speed=1.62x    
video:12kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

5.14 打印帧序号/pts到视频帧水印drawtext

  • 打印帧序号                 缺乏msyh.ttf文件  无法执行
  • ffmpeg -i test.mp4 -vf drawtext=fontcolor=red:fontsize=40:fontfile=msyh.ttf:line_spacing=7:text=%{n}:x=50:y=50 -vsync 0  -y out.mp4
  • 打印帧pts                 缺乏msyh.ttf文件  无法执行
  • ffmpeg -i test.mp4 -vf drawtext=fontcolor=red:fontsize=30:fontfile=msyh.ttf:line_spacing=7:text=%{pts}:x=50:y=50  -vsync 0  -y out.mp4
  • 打印帧类型  ffmpeg -i test.mp4 -vf                 缺乏msyh.ttf文件  无法执行 drawtext=fontcolor=red:fontsize=20:fontfile=msyh.ttf:line_spacing=7:text=%{pict_type}:x=50:y=50 -vsync 0 -y out.mp4
  • 把视频的pts[时间戳]添加为视频水印,精度到毫秒   存在问题
  • ffmpeg -i test.mp4 -vf “drawtext=fontsize=60:text=’%{pts:hms}’” -c:v libx264 -c copy -f mp4 output.mp4 -y 
chy-cpabe@ubuntu:~/Videos$ ffmpeg -i test.mp4 -vf "drawtext=fontsize=60:text='%{pts:hms}'" -c:v libx264 -c:a copy -f mp4 out.mp4 
[Parsed_drawtext_0 @ 0x55c79b280d00] No font filename provided
[AVFilterGraph @ 0x55c79b27f9c0] Error initializing filter 'drawtext' with args 'fontsize=60:text=%{pts:hms}'
Error reinitializing filters!
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
Conversion failed!

6,音频解码编码     

PCM原始数据和WAV格式转换

  • wav格式转换为PCM裸流
  • ffmpeg -i xizong.wav -f f32le -ar 44100 -acodec pcm_f32le output_f32le.raw   
  • 参数说明:
    • -f f32le … 浮点数32为小字端的采样格式
    • -ar 44100 … 采样频率
    • -ac 2 … 声道数量
  • 使用命令 将 MP3格式的数据转化为 wav格式的数据

7,音频filter             

倍速atempo

  • 速度减半
    • ffmpeg -i input.mp3 -af atempo=0.5 output.mp3
  • 2倍速率
    • ffmpeg -i input.mp3 -af atempo=2 output.mp3

8,字幕相关

8.1 字幕文件转换

  • 字幕文件的类型有很多,常见的有 .srt 和 .ass文件等
//将.srt文件转换成.ass文件
ffmpeg -i subtitle.srt subtitle.ass

将.ass文件转换成.srt文件
ffmpeg -i subtitle.ass subtitle.srt

8.2 集成字幕到视频文件

  • ffmpeg -i input.mp4 -i subtitles.srt -c:s mov_text -c:v copy -c:a copy output.mp4
  • 出问题 

9,ffplay命令

9.1 ffplay播放yuv视频数据

ffplay -f <文件格式> -pix_fmt <像素格式> -video_size <视频尺寸> <文件名>
示例:
ffplay -f rawvideo -pix_fmt yuv420p -video_size 848x480 yuv_video

9.2 ffplay播放PCM音频数据

ffplay -f <格式名> -ac <声道数> -ar <采样率> <文件名>
示例:
ffplay -f f32le -ac 1 -ar 48000 pcm_audio
  • 例子   ffplay -f s16be -ac 1 -ar 16000 mp3_pcm.pcm 
  • 前提操作:MP3 转 PCM
    • 使用范例:
      • 大段数据格式 ffmpeg -i test.mp3 -f s16be -ar 16000 -ac 1 -acodec pcm_s16be pcm16k.pcm
      • 小端数据格式 ffmpeg -i test.mp3 -f s16le -ar 16000 -ac 1 -acodec pcm_s16le pcm16k.pcm
    • 说明:
      • -acodec pcm_s16be:输出pcm格式,采用signed 16编码,字节序为大尾端(小尾端为le)
      • -ar 16000: 采样率为16000
      • -ac 1: 声道数为1 
  • 例子 ffmpeg -i 漠河舞厅.mp3 -f s16be -ar 16000 -ac 1 -acodec pcm_s16be mp3_pcm.pcm
  • ffmpeg mp3转pcm指令_keepGoing_keepGoing的博客-CSDN博客_ffmpeg mp3转pcm

9.3 ffplay播放音频并显示波形图

  • ffplay -showmode 1 simple.mp4

9.4 ffplay指定显示宽高

  • ffplay -x 1208 -y 720 avi_2_mp4.mp4 

10,ffprobe命令

10.1 ffprobe查看媒体文件的信息

  • ffprobe target.mp4 -show_format -show_streams -print_format json -loglevel fatal
    • -print_format json: 结果以json格式呈现
    • -show_format: 打印封装格式信息,在format节点中
    •  -show_streams: 打印流信息,在streams节点中
chy-cpabe@ubuntu:~/Videos$ ffprobe test.mp4 -show_format -show_streams -print_format json -loglevel fatal
{
    "streams": [
        {
            "index": 0,
            "codec_name": "h264",
            "codec_long_name": "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10",
            "profile": "High",
            "codec_type": "video",
            "codec_tag_string": "avc1",
            "codec_tag": "0x31637661",
            "width": 1920,
            "height": 1080,
            "coded_width": 1920,
            "coded_height": 1080,
            "closed_captions": 0,
            "film_grain": 0,
            "has_b_frames": 1,
            "sample_aspect_ratio": "1:1",
            "display_aspect_ratio": "16:9",
            "pix_fmt": "yuv420p",
            "level": 40,
            "color_range": "tv",
            "color_space": "bt709",
            "color_transfer": "bt709",
            "color_primaries": "bt709",
            "chroma_location": "left",
            "field_order": "progressive",
            "refs": 1,
            "is_avc": "true",
            "nal_length_size": "4",
            "id": "0x1",
            "r_frame_rate": "24000/1001",
            "avg_frame_rate": "24000/1001",
            "time_base": "1/24000",
            "start_pts": 0,
            "start_time": "0.000000",
            "duration_ts": 560560,
            "duration": "23.356667",
            "bit_rate": "6147092",
            "bits_per_raw_sample": "8",
            "nb_frames": "560",
            "extradata_size": 60,
            "disposition": {
                "default": 1,
                "dub": 0,
                "original": 0,
                "comment": 0,
                "lyrics": 0,
                "karaoke": 0,
                "forced": 0,
                "hearing_impaired": 0,
                "visual_impaired": 0,
                "clean_effects": 0,
                "attached_pic": 0,
                "timed_thumbnails": 0,
                "captions": 0,
                "descriptions": 0,
                "metadata": 0,
                "dependent": 0,
                "still_image": 0
            },
            "tags": {
                "creation_time": "2021-02-14T02:11:02.000000Z",
                "language": "und",
                "handler_name": "ETI ISO Video Media Handler",
                "vendor_id": "[0][0][0][0]",
                "encoder": "Elemental H.264"
            }
        },
        {
            "index": 1,
            "codec_name": "aac",
            "codec_long_name": "AAC (Advanced Audio Coding)",
            "profile": "LC",
            "codec_type": "audio",
            "codec_tag_string": "mp4a",
            "codec_tag": "0x6134706d",
            "sample_fmt": "fltp",
            "sample_rate": "48000",
            "channels": 2,
            "channel_layout": "stereo",
            "bits_per_sample": 0,
            "id": "0x2",
            "r_frame_rate": "0/0",
            "avg_frame_rate": "0/0",
            "time_base": "1/48000",
            "start_pts": 0,
            "start_time": "0.000000",
            "duration_ts": 1118656,
            "duration": "23.305333",
            "bit_rate": "160137",
            "nb_frames": "1094",
            "extradata_size": 2,
            "disposition": {
                "default": 1,
                "dub": 0,
                "original": 0,
                "comment": 0,
                "lyrics": 0,
                "karaoke": 0,
                "forced": 0,
                "hearing_impaired": 0,
                "visual_impaired": 0,
                "clean_effects": 0,
                "attached_pic": 0,
                "timed_thumbnails": 0,
                "captions": 0,
                "descriptions": 0,
                "metadata": 0,
                "dependent": 0,
                "still_image": 0
            },
            "tags": {
                "creation_time": "2021-02-14T02:11:02.000000Z",
                "language": "und",
                "handler_name": "ETI ISO Audio Media Handler",
                "vendor_id": "[0][0][0][0]"
            }
        }
    ],
    "format": {
        "filename": "test.mp4",
        "nb_streams": 2,
        "nb_programs": 0,
        "format_name": "mov,mp4,m4a,3gp,3g2,mj2",
        "format_long_name": "QuickTime / MOV",
        "start_time": "0.000000",
        "duration": "23.356667",
        "size": "18431676",
        "bit_rate": "6313118",
        "probe_score": 100,
        "tags": {
            "major_brand": "M4V ",
            "minor_version": "1",
            "compatible_brands": "isomavc1mp42",
            "creation_time": "2021-02-14T02:11:02.000000Z"
        }
    }
}

10.2 ffprobe查看时间戳

  • 首先,将MP4视频数据转化为 ts数据
  • ffmpeg -i input.mp4 output.ts
  • 查看视频dts
ffprobe -show_packets -select_streams v 1.ts | grep dts_time
chy-cpabe@ubuntu:~/Videos$ ffprobe -show_packets -select_streams v test_ts.ts | grep dts_time
ffprobe version N-106797-g580fb6a8c9 Copyright (c) 2007-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, mpegts, from 'test_ts.ts':
  Duration: 00:00:23.37, start: 1.431689, bitrate: 3724 kb/s
  Program 1 
    Metadata:
      service_name    : Service01
      service_provider: FFmpeg
  Stream #0:0[0x100]: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 90k tbn
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 49152 vbv_delay: N/A
  Stream #0:1[0x101](und): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 384 kb/s
dts_time=1.400000
dts_time=1.441711
dts_time=1.483422
dts_time=1.525133
dts_time=1.566833
dts_time=1.608544
dts_time=1.650256
dts_time=1.691967
dts_time=1.733667
dts_time=1.775378
dts_time=1.817089
dts_time=1.858800
dts_time=1.900500
dts_time=1.942211
dts_time=1.983922
dts_time=2.025633
dts_time=2.067333
dts_time=2.109044
dts_time=2.150756
dts_time=2.192467
dts_time=2.234167
dts_time=2.275878
dts_time=2.317589
dts_time=2.359300
dts_time=2.401000
dts_time=2.442711
dts_time=2.484422
dts_time=2.526133
dts_time=2.567833
dts_time=2.609544
dts_time=2.651256
dts_time=2.692967
dts_time=2.734667
dts_time=2.776378
dts_time=2.818089
dts_time=2.859800
dts_time=2.901500
dts_time=2.943211
dts_time=2.984922
dts_time=3.026633
dts_time=3.068333
dts_time=3.110044
dts_time=3.151756
dts_time=3.193467
dts_time=3.235167
dts_time=3.276878
dts_time=3.318589
dts_time=3.360300
dts_time=3.402000
dts_time=3.443711
dts_time=3.485422
dts_time=3.527133
dts_time=3.568833
dts_time=3.610544
dts_time=3.652256
dts_time=3.693967
dts_time=3.735667
dts_time=3.777378
dts_time=3.819089
dts_time=3.860800
dts_time=3.902500
dts_time=3.944211
dts_time=3.985922
dts_time=4.027633
dts_time=4.069333
dts_time=4.111044
dts_time=4.152756
dts_time=4.194467
dts_time=4.236167
dts_time=4.277878
dts_time=4.319589
dts_time=4.361300
dts_time=4.403000
dts_time=4.444711
dts_time=4.486422
dts_time=4.528133
dts_time=4.569833
dts_time=4.611544
dts_time=4.653256
dts_time=4.694967
dts_time=4.736667
dts_time=4.778378
dts_time=4.820089
dts_time=4.861800
dts_time=4.903500
dts_time=4.945211
dts_time=4.986922
dts_time=5.028633
dts_time=5.070333
dts_time=5.112044
dts_time=5.153756
dts_time=5.195467
dts_time=5.237167
dts_time=5.278878
dts_time=5.320589
dts_time=5.362300
dts_time=5.404000
dts_time=5.445711
dts_time=5.487422
dts_time=5.529133
dts_time=5.570833
dts_time=5.612544
dts_time=5.654256
dts_time=5.695967
dts_time=5.737667
dts_time=5.779378
dts_time=5.821089
dts_time=5.862800
dts_time=5.904500
dts_time=5.946211
dts_time=5.987922
dts_time=6.029633
dts_time=6.071333
dts_time=6.113044
dts_time=6.154756
dts_time=6.196467
dts_time=6.238167
dts_time=6.279878
dts_time=6.321589
dts_time=6.363300
dts_time=6.405000
dts_time=6.446711
dts_time=6.488422
dts_time=6.530133
dts_time=6.571833
dts_time=6.613544
dts_time=6.655256
dts_time=6.696967
dts_time=6.738667
dts_time=6.780378
dts_time=6.822089
dts_time=6.863800
dts_time=6.905500
dts_time=6.947211
dts_time=6.988922
dts_time=7.030633
dts_time=7.072333
dts_time=7.114044
dts_time=7.155756
dts_time=7.197467
dts_time=7.239167
dts_time=7.280878
dts_time=7.322589
dts_time=7.364300
dts_time=7.406000
dts_time=7.447711
dts_time=7.489422
dts_time=7.531133
dts_time=7.572833
dts_time=7.614544
dts_time=7.656256
dts_time=7.697967
dts_time=7.739667
dts_time=7.781378
dts_time=7.823089
dts_time=7.864800
dts_time=7.906500
dts_time=7.948211
dts_time=7.989922
dts_time=8.031633
dts_time=8.073333
dts_time=8.115044
dts_time=8.156756
dts_time=8.198467
dts_time=8.240167
dts_time=8.281878
dts_time=8.323589
dts_time=8.365300
dts_time=8.407000
dts_time=8.448711
dts_time=8.490422
dts_time=8.532133
dts_time=8.573833
dts_time=8.615544
dts_time=8.657256
dts_time=8.698967
dts_time=8.740667
dts_time=8.782378
dts_time=8.824089
dts_time=8.865800
dts_time=8.907500
dts_time=8.949211
dts_time=8.990922
dts_time=9.032633
dts_time=9.074333
dts_time=9.116044
dts_time=9.157756
dts_time=9.199467
dts_time=9.241167
dts_time=9.282878
dts_time=9.324589
dts_time=9.366300
dts_time=9.408000
dts_time=9.449711
dts_time=9.491422
dts_time=9.533133
dts_time=9.574833
dts_time=9.616544
dts_time=9.658256
dts_time=9.699967
dts_time=9.741667
dts_time=9.783378
dts_time=9.825089
dts_time=9.866800
dts_time=9.908500
dts_time=9.950211
dts_time=9.991922
dts_time=10.033633
dts_time=10.075333
dts_time=10.117044
dts_time=10.158756
dts_time=10.200467
dts_time=10.242167
dts_time=10.283878
dts_time=10.325589
dts_time=10.367300
dts_time=10.409000
dts_time=10.450711
dts_time=10.492422
dts_time=10.534133
dts_time=10.575833
dts_time=10.617544
dts_time=10.659256
dts_time=10.700967
dts_time=10.742667
dts_time=10.784378
dts_time=10.826089
dts_time=10.867800
dts_time=10.909500
dts_time=10.951211
dts_time=10.992922
dts_time=11.034633
dts_time=11.076333
dts_time=11.118044
dts_time=11.159756
dts_time=11.201467
dts_time=11.243167
dts_time=11.284878
dts_time=11.326589
dts_time=11.368300
dts_time=11.410000
dts_time=11.451711
dts_time=11.493422
dts_time=11.535133
dts_time=11.576833
dts_time=11.618544
dts_time=11.660256
dts_time=11.701967
dts_time=11.743667
dts_time=11.785378
dts_time=11.827089
dts_time=11.868800
dts_time=11.910500
dts_time=11.952211
dts_time=11.993922
dts_time=12.035633
dts_time=12.077333
dts_time=12.119044
dts_time=12.160756
dts_time=12.202467
dts_time=12.244167
dts_time=12.285878
dts_time=12.327589
dts_time=12.369300
dts_time=12.411000
dts_time=12.452711
dts_time=12.494422
dts_time=12.536133
dts_time=12.577833
dts_time=12.619544
dts_time=12.661256
dts_time=12.702967
dts_time=12.744667
dts_time=12.786378
dts_time=12.828089
dts_time=12.869800
dts_time=12.911500
dts_time=12.953211
dts_time=12.994922
dts_time=13.036633
dts_time=13.078333
dts_time=13.120044
dts_time=13.161756
dts_time=13.203467
dts_time=13.245167
dts_time=13.286878
dts_time=13.328589
dts_time=13.370300
dts_time=13.412000
dts_time=13.453711
dts_time=13.495422
dts_time=13.537133
dts_time=13.578833
dts_time=13.620544
dts_time=13.662256
dts_time=13.703967
dts_time=13.745667
dts_time=13.787378
dts_time=13.829089
dts_time=13.870800
dts_time=13.912500
dts_time=13.954211
dts_time=13.995922
dts_time=14.037633
dts_time=14.079333
dts_time=14.121044
dts_time=14.162756
dts_time=14.204467
dts_time=14.246167
dts_time=14.287878
dts_time=14.329589
dts_time=14.371300
dts_time=14.413000
dts_time=14.454711
dts_time=14.496422
dts_time=14.538133
dts_time=14.579833
dts_time=14.621544
dts_time=14.663256
dts_time=14.704967
dts_time=14.746667
dts_time=14.788378
dts_time=14.830089
dts_time=14.871800
dts_time=14.913500
dts_time=14.955211
dts_time=14.996922
dts_time=15.038633
dts_time=15.080333
dts_time=15.122044
dts_time=15.163756
dts_time=15.205467
dts_time=15.247167
dts_time=15.288878
dts_time=15.330589
dts_time=15.372300
dts_time=15.414000
dts_time=15.455711
dts_time=15.497422
dts_time=15.539133
dts_time=15.580833
dts_time=15.622544
dts_time=15.664256
dts_time=15.705967
dts_time=15.747667
dts_time=15.789378
dts_time=15.831089
dts_time=15.872800
dts_time=15.914500
dts_time=15.956211
dts_time=15.997922
dts_time=16.039633
dts_time=16.081333
dts_time=16.123044
dts_time=16.164756
dts_time=16.206467
dts_time=16.248167
dts_time=16.289878
dts_time=16.331589
dts_time=16.373300
dts_time=16.415000
dts_time=16.456711
dts_time=16.498422
dts_time=16.540133
dts_time=16.581833
dts_time=16.623544
dts_time=16.665256
dts_time=16.706967
dts_time=16.748667
dts_time=16.790378
dts_time=16.832089
dts_time=16.873800
dts_time=16.915500
dts_time=16.957211
dts_time=16.998922
dts_time=17.040633
dts_time=17.082333
dts_time=17.124044
dts_time=17.165756
dts_time=17.207467
dts_time=17.249167
dts_time=17.290878
dts_time=17.332589
dts_time=17.374300
dts_time=17.416000
dts_time=17.457711
dts_time=17.499422
dts_time=17.541133
dts_time=17.582833
dts_time=17.624544
dts_time=17.666256
dts_time=17.707967
dts_time=17.749667
dts_time=17.791378
dts_time=17.833089
dts_time=17.874800
dts_time=17.916500
dts_time=17.958211
dts_time=17.999922
dts_time=18.041633
dts_time=18.083333
dts_time=18.125044
dts_time=18.166756
dts_time=18.208467
dts_time=18.250167
dts_time=18.291878
dts_time=18.333589
dts_time=18.375300
dts_time=18.417000
dts_time=18.458711
dts_time=18.500422
dts_time=18.542133
dts_time=18.583833
dts_time=18.625544
dts_time=18.667256
dts_time=18.708967
dts_time=18.750667
dts_time=18.792378
dts_time=18.834089
dts_time=18.875800
dts_time=18.917500
dts_time=18.959211
dts_time=19.000922
dts_time=19.042633
dts_time=19.084333
dts_time=19.126044
dts_time=19.167756
dts_time=19.209467
dts_time=19.251167
dts_time=19.292878
dts_time=19.334589
dts_time=19.376300
dts_time=19.418000
dts_time=19.459711
dts_time=19.501422
dts_time=19.543133
dts_time=19.584833
dts_time=19.626544
dts_time=19.668256
dts_time=19.709967
dts_time=19.751667
dts_time=19.793378
dts_time=19.835089
dts_time=19.876800
dts_time=19.918500
dts_time=19.960211
dts_time=20.001922
dts_time=20.043633
dts_time=20.085333
dts_time=20.127044
dts_time=20.168756
dts_time=20.210467
dts_time=20.252167
dts_time=20.293878
dts_time=20.335589
dts_time=20.377300
dts_time=20.419000
dts_time=20.460711
dts_time=20.502422
dts_time=20.544133
dts_time=20.585833
dts_time=20.627544
dts_time=20.669256
dts_time=20.710967
dts_time=20.752667
dts_time=20.794378
dts_time=20.836089
dts_time=20.877800
dts_time=20.919500
dts_time=20.961211
dts_time=21.002922
dts_time=21.044633
dts_time=21.086333
dts_time=21.128044
dts_time=21.169756
dts_time=21.211467
dts_time=21.253167
dts_time=21.294878
dts_time=21.336589
dts_time=21.378300
dts_time=21.420000
dts_time=21.461711
dts_time=21.503422
dts_time=21.545133
dts_time=21.586833
dts_time=21.628544
dts_time=21.670256
dts_time=21.711967
dts_time=21.753667
dts_time=21.795378
dts_time=21.837089
dts_time=21.878800
dts_time=21.920500
dts_time=21.962211
dts_time=22.003922
dts_time=22.045633
dts_time=22.087333
dts_time=22.129044
dts_time=22.170756
dts_time=22.212467
dts_time=22.254167
dts_time=22.295878
dts_time=22.337589
dts_time=22.379300
dts_time=22.421000
dts_time=22.462711
dts_time=22.504422
dts_time=22.546133
dts_time=22.587833
dts_time=22.629544
dts_time=22.671256
dts_time=22.712967
dts_time=22.754667
dts_time=22.796378
dts_time=22.838089
dts_time=22.879800
dts_time=22.921500
dts_time=22.963211
dts_time=23.004922
dts_time=23.046633
dts_time=23.088333
dts_time=23.130044
dts_time=23.171756
dts_time=23.213467
dts_time=23.255167
dts_time=23.296878
dts_time=23.338589
dts_time=23.380300
dts_time=23.422000
dts_time=23.463711
dts_time=23.505422
dts_time=23.547133
dts_time=23.588833
dts_time=23.630544
dts_time=23.672256
dts_time=23.713967
dts_time=23.755667
dts_time=23.797378
dts_time=23.839089
dts_time=23.880800
dts_time=23.922500
dts_time=23.964211
dts_time=24.005922
dts_time=24.047633
dts_time=24.089333
dts_time=24.131044
dts_time=24.172756
dts_time=24.214467
dts_time=24.256167
dts_time=24.297878
dts_time=24.339589
dts_time=24.381300
dts_time=24.423000
dts_time=24.464711
dts_time=24.506422
dts_time=24.548133
dts_time=24.589833
dts_time=24.631544
dts_time=24.673256
dts_time=24.714967
  • 查看视频pts
ffprobe -show_packets -select_streams v 1.ts | grep pts_time
chy-cpabe@ubuntu:~/Videos$ ffprobe -show_packets -select_streams v test_ts.ts | grep pts_time
ffprobe version N-106797-g580fb6a8c9 Copyright (c) 2007-2022 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/home/chy-cpabe/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/chy-cpabe/ffmpeg_build/include --extra-ldflags=-L/home/chy-cpabe/ffmpeg_build/lib --extra-libs='-lpthread -lm' --ld=g++ --bindir=/home/chy-cpabe/bin --enable-gpl --enable-gnutls --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libsvtav1 --enable-libdav1d --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  libavutil      57. 24.101 / 57. 24.101
  libavcodec     59. 27.100 / 59. 27.100
  libavformat    59. 23.100 / 59. 23.100
  libavdevice    59.  6.100 / 59.  6.100
  libavfilter     8. 37.100 /  8. 37.100
  libswscale      6.  6.100 /  6.  6.100
  libswresample   4.  6.100 /  4.  6.100
  libpostproc    56.  5.100 / 56.  5.100
Input #0, mpegts, from 'test_ts.ts':
  Duration: 00:00:23.37, start: 1.431689, bitrate: 3724 kb/s
  Program 1 
    Metadata:
      service_name    : Service01
      service_provider: FFmpeg
  Stream #0:0[0x100]: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 90k tbn
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 49152 vbv_delay: N/A
  Stream #0:1[0x101](und): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 384 kb/s
pts_time=1.441711
pts_time=1.483422
pts_time=1.525133
pts_time=1.566833
pts_time=1.608544
pts_time=1.650256
pts_time=1.691967
pts_time=1.733667
pts_time=1.775378
pts_time=1.817089
pts_time=1.858800
pts_time=1.900500
pts_time=1.942211
pts_time=1.983922
pts_time=2.025633
pts_time=2.067333
pts_time=2.109044
pts_time=2.150756
pts_time=2.192467
pts_time=2.234167
pts_time=2.275878
pts_time=2.317589
pts_time=2.359300
pts_time=2.401000
pts_time=2.442711
pts_time=2.484422
pts_time=2.526133
pts_time=2.567833
pts_time=2.609544
pts_time=2.651256
pts_time=2.692967
pts_time=2.734667
pts_time=2.776378
pts_time=2.818089
pts_time=2.859800
pts_time=2.901500
pts_time=2.943211
pts_time=2.984922
pts_time=3.026633
pts_time=3.068333
pts_time=3.110044
pts_time=3.151756
pts_time=3.193467
pts_time=3.235167
pts_time=3.276878
pts_time=3.318589
pts_time=3.360300
pts_time=3.402000
pts_time=3.443711
pts_time=3.485422
pts_time=3.527133
pts_time=3.568833
pts_time=3.610544
pts_time=3.652256
pts_time=3.693967
pts_time=3.735667
pts_time=3.777378
pts_time=3.819089
pts_time=3.860800
pts_time=3.902500
pts_time=3.944211
pts_time=3.985922
pts_time=4.027633
pts_time=4.069333
pts_time=4.111044
pts_time=4.152756
pts_time=4.194467
pts_time=4.236167
pts_time=4.277878
pts_time=4.319589
pts_time=4.361300
pts_time=4.403000
pts_time=4.444711
pts_time=4.486422
pts_time=4.528133
pts_time=4.569833
pts_time=4.611544
pts_time=4.653256
pts_time=4.694967
pts_time=4.736667
pts_time=4.778378
pts_time=4.820089
pts_time=4.861800
pts_time=4.903500
pts_time=4.945211
pts_time=4.986922
pts_time=5.028633
pts_time=5.070333
pts_time=5.112044
pts_time=5.153756
pts_time=5.195467
pts_time=5.237167
pts_time=5.278878
pts_time=5.320589
pts_time=5.362300
pts_time=5.404000
pts_time=5.445711
pts_time=5.487422
pts_time=5.529133
pts_time=5.570833
pts_time=5.612544
pts_time=5.654256
pts_time=5.695967
pts_time=5.737667
pts_time=5.779378
pts_time=5.821089
pts_time=5.862800
pts_time=5.904500
pts_time=5.946211
pts_time=5.987922
pts_time=6.029633
pts_time=6.071333
pts_time=6.113044
pts_time=6.154756
pts_time=6.196467
pts_time=6.238167
pts_time=6.279878
pts_time=6.321589
pts_time=6.363300
pts_time=6.405000
pts_time=6.446711
pts_time=6.488422
pts_time=6.530133
pts_time=6.571833
pts_time=6.613544
pts_time=6.655256
pts_time=6.696967
pts_time=6.738667
pts_time=6.780378
pts_time=6.822089
pts_time=6.863800
pts_time=6.905500
pts_time=6.947211
pts_time=6.988922
pts_time=7.030633
pts_time=7.072333
pts_time=7.114044
pts_time=7.155756
pts_time=7.197467
pts_time=7.239167
pts_time=7.280878
pts_time=7.322589
pts_time=7.364300
pts_time=7.406000
pts_time=7.447711
pts_time=7.489422
pts_time=7.531133
pts_time=7.572833
pts_time=7.614544
pts_time=7.656256
pts_time=7.697967
pts_time=7.739667
pts_time=7.781378
pts_time=7.823089
pts_time=7.864800
pts_time=7.906500
pts_time=7.948211
pts_time=7.989922
pts_time=8.031633
pts_time=8.073333
pts_time=8.115044
pts_time=8.156756
pts_time=8.198467
pts_time=8.240167
pts_time=8.281878
pts_time=8.323589
pts_time=8.365300
pts_time=8.407000
pts_time=8.448711
pts_time=8.490422
pts_time=8.532133
pts_time=8.573833
pts_time=8.615544
pts_time=8.657256
pts_time=8.698967
pts_time=8.740667
pts_time=8.782378
pts_time=8.824089
pts_time=8.865800
pts_time=8.907500
pts_time=8.949211
pts_time=8.990922
pts_time=9.032633
pts_time=9.074333
pts_time=9.116044
pts_time=9.157756
pts_time=9.199467
pts_time=9.241167
pts_time=9.282878
pts_time=9.324589
pts_time=9.366300
pts_time=9.408000
pts_time=9.449711
pts_time=9.491422
pts_time=9.533133
pts_time=9.574833
pts_time=9.616544
pts_time=9.658256
pts_time=9.699967
pts_time=9.741667
pts_time=9.783378
pts_time=9.825089
pts_time=9.866800
pts_time=9.908500
pts_time=9.950211
pts_time=9.991922
pts_time=10.033633
pts_time=10.075333
pts_time=10.117044
pts_time=10.158756
pts_time=10.200467
pts_time=10.242167
pts_time=10.283878
pts_time=10.325589
pts_time=10.367300
pts_time=10.409000
pts_time=10.450711
pts_time=10.492422
pts_time=10.534133
pts_time=10.575833
pts_time=10.617544
pts_time=10.659256
pts_time=10.700967
pts_time=10.742667
pts_time=10.784378
pts_time=10.826089
pts_time=10.867800
pts_time=10.909500
pts_time=10.951211
pts_time=10.992922
pts_time=11.034633
pts_time=11.076333
pts_time=11.118044
pts_time=11.159756
pts_time=11.201467
pts_time=11.243167
pts_time=11.284878
pts_time=11.326589
pts_time=11.368300
pts_time=11.410000
pts_time=11.451711
pts_time=11.493422
pts_time=11.535133
pts_time=11.576833
pts_time=11.618544
pts_time=11.660256
pts_time=11.701967
pts_time=11.743667
pts_time=11.785378
pts_time=11.827089
pts_time=11.868800
pts_time=11.910500
pts_time=11.952211
pts_time=11.993922
pts_time=12.035633
pts_time=12.077333
pts_time=12.119044
pts_time=12.160756
pts_time=12.202467
pts_time=12.244167
pts_time=12.285878
pts_time=12.327589
pts_time=12.369300
pts_time=12.411000
pts_time=12.452711
pts_time=12.494422
pts_time=12.536133
pts_time=12.577833
pts_time=12.619544
pts_time=12.661256
pts_time=12.702967
pts_time=12.744667
pts_time=12.786378
pts_time=12.828089
pts_time=12.869800
pts_time=12.911500
pts_time=12.953211
pts_time=12.994922
pts_time=13.036633
pts_time=13.078333
pts_time=13.120044
pts_time=13.161756
pts_time=13.203467
pts_time=13.245167
pts_time=13.286878
pts_time=13.328589
pts_time=13.370300
pts_time=13.412000
pts_time=13.453711
pts_time=13.495422
pts_time=13.537133
pts_time=13.578833
pts_time=13.620544
pts_time=13.662256
pts_time=13.703967
pts_time=13.745667
pts_time=13.787378
pts_time=13.829089
pts_time=13.870800
pts_time=13.912500
pts_time=13.954211
pts_time=13.995922
pts_time=14.037633
pts_time=14.079333
pts_time=14.121044
pts_time=14.162756
pts_time=14.204467
pts_time=14.246167
pts_time=14.287878
pts_time=14.329589
pts_time=14.371300
pts_time=14.413000
pts_time=14.454711
pts_time=14.496422
pts_time=14.538133
pts_time=14.579833
pts_time=14.621544
pts_time=14.663256
pts_time=14.704967
pts_time=14.746667
pts_time=14.788378
pts_time=14.830089
pts_time=14.871800
pts_time=14.913500
pts_time=14.955211
pts_time=14.996922
pts_time=15.038633
pts_time=15.080333
pts_time=15.122044
pts_time=15.163756
pts_time=15.205467
pts_time=15.247167
pts_time=15.288878
pts_time=15.330589
pts_time=15.372300
pts_time=15.414000
pts_time=15.455711
pts_time=15.497422
pts_time=15.539133
pts_time=15.580833
pts_time=15.622544
pts_time=15.664256
pts_time=15.705967
pts_time=15.747667
pts_time=15.789378
pts_time=15.831089
pts_time=15.872800
pts_time=15.914500
pts_time=15.956211
pts_time=15.997922
pts_time=16.039633
pts_time=16.081333
pts_time=16.123044
pts_time=16.164756
pts_time=16.206467
pts_time=16.248167
pts_time=16.289878
pts_time=16.331589
pts_time=16.373300
pts_time=16.415000
pts_time=16.456711
pts_time=16.498422
pts_time=16.540133
pts_time=16.581833
pts_time=16.623544
pts_time=16.665256
pts_time=16.706967
pts_time=16.748667
pts_time=16.790378
pts_time=16.832089
pts_time=16.873800
pts_time=16.915500
pts_time=16.957211
pts_time=16.998922
pts_time=17.040633
pts_time=17.082333
pts_time=17.124044
pts_time=17.165756
pts_time=17.207467
pts_time=17.249167
pts_time=17.290878
pts_time=17.332589
pts_time=17.374300
pts_time=17.416000
pts_time=17.457711
pts_time=17.499422
pts_time=17.541133
pts_time=17.582833
pts_time=17.624544
pts_time=17.666256
pts_time=17.707967
pts_time=17.749667
pts_time=17.791378
pts_time=17.833089
pts_time=17.874800
pts_time=17.916500
pts_time=17.958211
pts_time=17.999922
pts_time=18.041633
pts_time=18.083333
pts_time=18.125044
pts_time=18.166756
pts_time=18.208467
pts_time=18.250167
pts_time=18.291878
pts_time=18.333589
pts_time=18.375300
pts_time=18.417000
pts_time=18.458711
pts_time=18.500422
pts_time=18.542133
pts_time=18.583833
pts_time=18.625544
pts_time=18.667256
pts_time=18.708967
pts_time=18.750667
pts_time=18.792378
pts_time=18.834089
pts_time=18.875800
pts_time=18.917500
pts_time=18.959211
pts_time=19.000922
pts_time=19.042633
pts_time=19.084333
pts_time=19.126044
pts_time=19.167756
pts_time=19.209467
pts_time=19.251167
pts_time=19.292878
pts_time=19.334589
pts_time=19.376300
pts_time=19.418000
pts_time=19.459711
pts_time=19.501422
pts_time=19.543133
pts_time=19.584833
pts_time=19.626544
pts_time=19.668256
pts_time=19.709967
pts_time=19.751667
pts_time=19.793378
pts_time=19.835089
pts_time=19.876800
pts_time=19.918500
pts_time=19.960211
pts_time=20.001922
pts_time=20.043633
pts_time=20.085333
pts_time=20.127044
pts_time=20.168756
pts_time=20.210467
pts_time=20.252167
pts_time=20.293878
pts_time=20.335589
pts_time=20.377300
pts_time=20.419000
pts_time=20.460711
pts_time=20.502422
pts_time=20.544133
pts_time=20.585833
pts_time=20.627544
pts_time=20.669256
pts_time=20.710967
pts_time=20.752667
pts_time=20.794378
pts_time=20.836089
pts_time=20.877800
pts_time=20.919500
pts_time=20.961211
pts_time=21.002922
pts_time=21.044633
pts_time=21.086333
pts_time=21.128044
pts_time=21.169756
pts_time=21.211467
pts_time=21.253167
pts_time=21.294878
pts_time=21.336589
pts_time=21.378300
pts_time=21.420000
pts_time=21.461711
pts_time=21.503422
pts_time=21.545133
pts_time=21.586833
pts_time=21.628544
pts_time=21.670256
pts_time=21.711967
pts_time=21.753667
pts_time=21.795378
pts_time=21.837089
pts_time=21.878800
pts_time=21.920500
pts_time=21.962211
pts_time=22.003922
pts_time=22.045633
pts_time=22.087333
pts_time=22.129044
pts_time=22.170756
pts_time=22.212467
pts_time=22.254167
pts_time=22.295878
pts_time=22.337589
pts_time=22.379300
pts_time=22.421000
pts_time=22.462711
pts_time=22.504422
pts_time=22.546133
pts_time=22.587833
pts_time=22.629544
pts_time=22.671256
pts_time=22.712967
pts_time=22.754667
pts_time=22.796378
pts_time=22.838089
pts_time=22.879800
pts_time=22.921500
pts_time=22.963211
pts_time=23.004922
pts_time=23.046633
pts_time=23.088333
pts_time=23.130044
pts_time=23.171756
pts_time=23.213467
pts_time=23.255167
pts_time=23.296878
pts_time=23.338589
pts_time=23.380300
pts_time=23.422000
pts_time=23.463711
pts_time=23.505422
pts_time=23.547133
pts_time=23.588833
pts_time=23.630544
pts_time=23.672256
pts_time=23.713967
pts_time=23.755667
pts_time=23.797378
pts_time=23.839089
pts_time=23.880800
pts_time=23.922500
pts_time=23.964211
pts_time=24.005922
pts_time=24.047633
pts_time=24.089333
pts_time=24.131044
pts_time=24.172756
pts_time=24.214467
pts_time=24.256167
pts_time=24.297878
pts_time=24.339589
pts_time=24.381300
pts_time=24.423000
pts_time=24.464711
pts_time=24.506422
pts_time=24.548133
pts_time=24.589833
pts_time=24.631544
pts_time=24.673256
pts_time=24.714967
pts_time=24.756667
  • 查看视频流前几帧的pts
ffprobe -v error -of compact -read_intervals  %+#10 -show_packets -select_streams v 1.ts
chy-cpabe@ubuntu:~/Videos$ ffprobe -v error -of compact -read_intervals %+#10 -show_packets -select_streams v test_ts.ts 
packet|codec_type=video|stream_index=0|pts=129754|pts_time=1.441711|dts=126000|dts_time=1.400000|duration=3753|duration_time=0.041700|size=111660|pos=564|flags=K_|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=133508|pts_time=1.483422|dts=129754|dts_time=1.441711|duration=3753|duration_time=0.041700|size=146109|pos=114680|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=137262|pts_time=1.525133|dts=133508|dts_time=1.483422|duration=3753|duration_time=0.041700|size=108658|pos=266584|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=141015|pts_time=1.566833|dts=137262|dts_time=1.525133|duration=3753|duration_time=0.041700|size=56978|pos=378068|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=144769|pts_time=1.608544|dts=141015|dts_time=1.566833|duration=3753|duration_time=0.041700|size=32869|pos=438792|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=148523|pts_time=1.650256|dts=144769|dts_time=1.608544|duration=3753|duration_time=0.041700|size=20103|pos=474888|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=152277|pts_time=1.691967|dts=148523|dts_time=1.650256|duration=3753|duration_time=0.041700|size=16245|pos=498388|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=156030|pts_time=1.733667|dts=152277|dts_time=1.691967|duration=3753|duration_time=0.041700|size=9676|pos=517564|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=159784|pts_time=1.775378|dts=156030|dts_time=1.733667|duration=3753|duration_time=0.041700|size=7591|pos=529972|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224

packet|codec_type=video|stream_index=0|pts=163538|pts_time=1.817089|dts=159784|dts_time=1.775378|duration=3753|duration_time=0.041700|size=6535|pos=540688|flags=__|side_data|side_data_type=MPEGTS Stream ID|id=224
  •  查看关键帧的pts
ffprobe -v error -select_streams v:0 -show_entries packet=pts_time,flags -of csv=print_section=0 input.mp4 | awk -F',' '/K/ {print $1}'
  • 查看关键帧 帧间 的间隔
./ffprobe -of compact -select_streams v -show_packets  'test.mp4'| grep K_ | awk 'BEGIN{FS="|";last=-1}{split($5,a,"="); if(last != -1) {print "Keframe pos: " a[2] ", Interval: " a[2]-last " seconds"} else {print "Keyframe: " a[2]}; last=a[2]}'

11,其他

11.1 ffmpeg或ffplay 打开 DEBUG 日志输出

  • ffplay -v debug $URL
  • API中开启debug日志
    • av_log_set_level(AV_LOG_DEBUG);

11.2 FFmpeg命令日志输出到文件

  • 执行ffmpeg或者ffprobe输出重定向到文件的时候发现文件是空的。 可以采用下面的方式。
  • ffprobe xxx > file 2>&1
  • shell输出分好多种,
  • 0表示键盘输出,1表示屏幕输出,2表示错误输出。
  • cmd > file,只是把屏幕输出重定向到文件中。
  • 调用ffmpeg相关命令,打印信息都被终端认为是错误输出,但是一般情况下这种信息也会输出到屏幕上,所以我们可以在屏幕上看到它。但是,当我们想重定向到文件中,却被系统认为是错误输出而忽略。
  • 2>&1表示错误输出重定向到屏幕输出。
  • &标明其后面跟的是一个文件描述符,而不是一个文件名。

11.3 打印支持DirectShow的设备列表

  • 打印支持DirectShow的设备列表
    • ffmpeg -list_devices true -f dshow -i dummy
  • 打开名称为“Lenovo EasyCamera”的摄像头
    • ffmpeg -f dshow -i video="Lenovo EasyCamera" 
  • 2
    点赞
  • 9
    收藏
    觉得还不错? 一键收藏
  • 1
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值