修改后发送给服务器,ios - 如何修改（添加过滤器）WebRTC发送给其他对等/服务器的摄像机流 - 堆栈内存溢出...

范围

我正在使用RTCCameraPreviewView来显示本地相机流

let videoSource = self.pcFactory.avFoundationVideoSource(with: nil)

let videoTrack = self.pcFactory.videoTrack(with: sVideoSource, trackId: "video0")

//setting the capture session to my RTCCameraPreviewView:

(self.previewView as! RTCCameraPreviewView).captureSession = (videoTrack.source as! RTCAVFoundationVideoSource).captureSession

stream = self.pcFactory.mediaStream(withStreamId: "unique_label")

audioTrack = self.pcFactory.audioTrack(withTrackId: "audio0")

stream.addAudioTrack(audioTrack)

var device: AVCaptureDevice?

for captureDevice in AVCaptureDevice.devices(withMediaType: AVMediaTypeVideo) {

if (captureDevice as AnyObject).position == AVCaptureDevicePosition.front {

device = captureDevice as? AVCaptureDevice

break

}

}

if device != nil && videoTrack != nil {

stream.addVideoTrack(videoTrack)

}

configuration = RTCConfiguration()

configuration.iceServers = iceServers

peerConnection = self.pcFactory.peerConnection(with: configuration, constraints: RTCMediaConstraints(mandatoryConstraints: nil, optionalConstraints: ["DtlsSrtpKeyAgreement": "true"]), delegate: self)

peerConnection.add(stream)

事情正如预期的那样正常。

问题

现在我想抓住相机中的帧并预处理它们以添加一些滤波器(棕褐色，黑白等)，然后将帧中继到WebRTC。 在通过webrtc文档挣扎之后，我仍然无法找到从哪里开始和做什么。

任何形式的抬头都将受到高度赞赏！