前言
一直都是用的opencv.安卓里用的opencv4Android,如果要处理rtsp等流媒体,以前是编译ffmpeg,并编写底层jni代码.现在发现javacv,非常方便,javacv的作用类似opencv4Android,不过集成opencv和ffmpeg so的方式更简洁,而且对于流媒体等天然支持.
正文
1.AndroidStudio中配置javacv
仅用gradle配置即可完成
编辑app的build.gradle,添加以下内容
android {
...
packagingOptions {
exclude 'META-INF/services/javax.annotation.processing.Processor'
pickFirst 'META-INF/maven/org.bytedeco.javacpp-presets/opencv/pom.properties'
pickFirst 'META-INF/maven/org.bytedeco.javacpp-presets/opencv/pom.xml'
pickFirst 'META-INF/maven/org.bytedeco.javacpp-presets/ffmpeg/pom.properties'
pickFirst 'META-INF/maven/org.bytedeco.javacpp-presets/ffmpeg/pom.xml'
}
...
}
dependencies {
...
//JavaCV
def javacvVersion = '1.4.2'
def ffmpegVersion = '4.0.1'
def opencvVersion = '3.4.2'
implementation(group: 'org.bytedeco', name: 'javacv-platform', version: javacvVersion) {
exclude group: 'org.bytedeco.javacpp-presets'
}
implementation group: 'org.bytedeco.javacpp-presets', name: 'ffmpeg', version: "${ffmpegVersion}-${javacvVersion}"
implementation group: 'org.bytedeco.javacpp-presets', name: 'ffmpeg', version: "${ffmpegVersion}-${javacvVersion}", classifier: 'android-arm' // for 'armeabi-v7a'
implementation group: 'org.bytedeco.javacpp-presets', name: 'ffmpeg', version: "${ffmpegVersion}-${javacvVersion}", classifier: 'android-arm64' // for 'arm64-v8a'
implementation group: 'org.bytedeco.javacpp-presets', name: 'opencv', version: "${opencvVersion}-${javacvVersion}"
implementation group: 'org.bytedeco.javacpp-presets', name: 'opencv', version: "${opencvVersion}-${javacvVersion}", classifier: 'android-arm' // for 'armeabi-v7a'
implementation group: 'org.bytedeco.javacpp-presets', name: 'opencv', version: "${opencvVersion}-${javacvVersion}", classifier: 'android-arm64' // for 'arm64-v8a'
}
注意:javacv opencv ffmpeg的对应版本号不能乱写,需要到maven仓库查阅
https://mvnrepository.com
搜索javacv opencv / javacv ffmpeg 分别查阅对应版本
2.javacv解码rtsp视频流
try {
String file = "rtsp://10.0.230.11:554/live/0/main";
FFmpegFrameGrabber grabber = FFmpegFrameGrabber.createDefault(file);
grabber.setOption("rtsp_transport", "tcp"); // 使用tcp的方式,不然会丢包很严重
grabber.setImageWidth(1920);
grabber.setImageHeight(1080);
//为了加快转bitmap这句一定要写
grabber.setPixelFormat(AV_PIX_FMT_RGBA);
System.out.println("grabber start");
grabber.start();
AndroidFrameConverter converter = new AndroidFrameConverter();
while (isRunning) {
Frame frame = grabber.grabImage();
bmp = converter.convert(frame);
}
}catch (FrameGrabber.Exception e){
}
ps:经过测试以上是拿到bitmap的最快方式