系统状态:
1, Windows10 1909(内部版本 18363.778)
2,Visual Studio Community 2017 (Version 15.9.16)
3,已安装Windows 10 SDK
网上介绍有几个方法:Nuget的WPFMediaKit、MediaCaptureWPF以及.Net自带的MediaCapture、CameraCaptureUI
WPFMediaKit好像默认只能将camera的画面保存成为image file不能直接读取当前帧的数据;MediaCaptureWPF无法build成为any cpu platform;CameraCaptureUI会使用默认的UWP UI。。。
所以我们只能用MediaCapture,官方教程:https://docs.microsoft.com/en-us/windows/uwp/audio-video-camera/basic-photo-video-and-audio-capture-with-mediacapture
因为我们的是WPF App,所以无法直接调用UWP API。
有三个方法可以让WPF程序,调用UWP API:
1,NuGet下载UwpDesktop(强烈不建议!它支持的API太久没更新,实际使用的时候经常有各种问题)
2,在安装Windows10 SDK之后,手动在project references里添加以下两个文件的引用:
C:\Program Files (x86)\Windows Kits\10\UnionMetadata\Windows.winmd
C:\Program Files (x86)\Reference Assemblies\Microsoft\Framework\.NETCore\v4.5\System.Runtime.WindowsRuntime.dll
3,.Net 4.6+或者.Net Core3.0+,并且Windows10是1803版本之后,可以NuGet下载Microsoft.Windows.SDK.Contracts
以上方式,最好都自动将 NuGet 包的引用方式从 packages.config 升级为 PackageReference。否则运行时可能会出错。
准备好让WPF调用WinRT API之后,为了让WPF显示摄像头画面,我们还需要在NuGet下载MMaitre.MediaCaptureWPF。
但是这玩意不能编译成为any CPU,所以只能将项目转为x64。
准备妥当,代码就很容易了:
using MediaCaptureWPF;
using System;
using System.Windows;
using Windows.Media.Capture;
------------------------------------
private MediaCapture captureManager;
private async void Window_Loaded(object sender, RoutedEventArgs e)
{
captureManager = new MediaCapture();
await captureManager.InitializeAsync();
var preview = new CapturePreview(captureManager);
this.webCamImage.Source = preview; //XAML页面的一个Image控件
await preview.StartAsync();
}
这样,当程序跑起来,就能在UI界面看到摄像头的实时画面了。
如果想获取摄像头某一时刻的byte data,就有点麻烦:
var lowLagCapture = await captureManager.PrepareLowLagPhotoCaptureAsync(ImageEncodingProperties.CreateUncompressed(MediaPixelFormat.Bgra8));
var capturedPhoto = await lowLagCapture.CaptureAsync();
using (var softwareBitmap = capturedPhoto.Frame.SoftwareBitmap)
{
Task<byte[]> bytes = await GetPixelBytesFromSoftwareBitmapAsync(softwareBitmap));
}
await lowLagCapture.FinishAsync();
------------------------------------------------------
public static async Task<byte[]> GetPixelBytesFromSoftwareBitmapAsync(SoftwareBitmap softwareBitmap)
{
using (InMemoryRandomAccessStream stream = new InMemoryRandomAccessStream())
{
Windows.Graphics.Imaging.BitmapEncoder encoder = await Windows.Graphics.Imaging.BitmapEncoder.CreateAsync(Windows.Graphics.Imaging.BitmapEncoder.JpegEncoderId, stream);
encoder.SetSoftwareBitmap(softwareBitmap);
await encoder.FlushAsync();
// Read the pixel bytes from the memory stream
using (var reader = new DataReader(stream.GetInputStreamAt(0)))
{
var bytes = new byte[stream.Size];
await reader.LoadAsync((uint)stream.Size);
reader.ReadBytes(bytes);
return bytes;
}
}
}