webrtc 视频流分析

webrtc 是google开源的web端流媒体通讯框架，通过客户端调用堆栈可以快速了解webrtc视频流通讯原理，特提供以下调用堆栈，仅供参考：

接收流调用堆栈(rtcp)

> peerconnection_client.exe!webrtc::RTCPReceiver::TriggerCallbacksFromRtcpPacket(const webrtc::RTCPReceiver::PacketInformation & packet_information) 行 912 C++

peerconnection_client.exe!webrtc::RTCPReceiver::IncomingPacket(const unsigned char * packet, unsigned __int64 packet_size) 行 147 C++

peerconnection_client.exe!webrtc::ModuleRtpRtcpImpl::IncomingRtcpPacket(const unsigned char * rtcp_packet, unsigned __int64 length) 行 275 C++

peerconnection_client.exe!webrtc::voe::Channel::ReceivedRTCPPacket(const unsigned char * data, unsigned __int64 length) 行 1823 C++

peerconnection_client.exe!webrtc::voe::ChannelProxy::ReceivedRTCPPacket(const unsigned char * packet, unsigned __int64 length) 行 236 C++

peerconnection_client.exe!webrtc::internal::AudioReceiveStream::DeliverRtcp(const unsigned char * packet, unsigned __int64 length) 行 313 C++

peerconnection_client.exe!webrtc::internal::Call::DeliverRtcp(webrtc::MediaType media_type, const unsigned char * packet, unsigned __int64 length) 行 1274 C++

peerconnection_client.exe!webrtc::internal::Call::DeliverPacket(webrtc::MediaType media_type, const unsigned char * packet, unsigned __int64 length, const webrtc::PacketTime & packet_time) 行 1377 C++

peerconnection_client.exe!cricket::WebRtcVoiceMediaChannel::OnRtcpReceived(rtc::CopyOnWriteBuffer * packet, const rtc::PacketTime & packet_time) 行 2173 C++

peerconnection_client.exe!cricket::BaseChannel::ProcessPacket(bool rtcp, const rtc::CopyOnWriteBuffer & packet, const rtc::PacketTime & packet_time) 行 826 C++

peerconnection_client.exe!rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &>::CallMethod<0,1,2>(rtc::sequence<0, 1, 2>) 行 164 C++

peerconnection_client.exe!rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &>::operator()() 行 155 C++

peerconnection_client.exe!rtc::FireAndForgetAsyncClosure<rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &> >::Execute() 行 49 C++

peerconnection_client.exe!rtc::AsyncInvoker::OnMessage(rtc::Message * msg) 行 43 C++

peerconnection_client.exe!rtc::MessageQueue::Dispatch(rtc::Message * pmsg) 行 531 C++

peerconnection_client.exe!rtc::Thread::ProcessMessages(int cmsLoop) 行 489 C++

peerconnection_client.exe!rtc::Thread::Run() 行 318 C++

peerconnection_client.exe!rtc::Thread::PreRun() 行 307 C++

队列任务入队调用堆栈（本地采集部分）

> peerconnection_client.exe!rtc::TaskQueue::PostTask(std::unique_ptr<rtc::QueuedTask, std::default_delete<rtc::QueuedTask> > task) 行 233 C++

peerconnection_client.exe!webrtc::ViEEncoder::OnFrame(const webrtc::VideoFrame & video_frame) 行 721 C++

peerconnection_client.exe!rtc::VideoBroadcaster::OnFrame(const webrtc::VideoFrame & frame) 行 56 C++

peerconnection_client.exe!cricket::VideoCapturer::OnFrame(const webrtc::VideoFrame & frame, int orig_width, int orig_height) 行 223 C++

peerconnection_client.exe!cricket::WebRtcVideoCapturer::OnFrame(const webrtc::VideoFrame & sample) 行 351 C++

peerconnection_client.exe!webrtc::videocapturemodule::VideoCaptureImpl::DeliverCapturedFrame(webrtc::VideoFrame & captureFrame) 行 120 C++

peerconnection_client.exe!webrtc::videocapturemodule::VideoCaptureImpl::IncomingFrame(unsigned char * videoFrame, unsigned __int64 videoFrameLength, const webrtc::VideoCaptureCapability & frameInfo, __int64 captureTime) 行 182 C++

peerconnection_client.exe!webrtc::videocapturemodule::CaptureSinkFilter::ProcessCapturedFrame(unsigned char * pBuffer, unsigned __int64 length, const webrtc::VideoCaptureCapability & frameInfo) 行 478 C++

peerconnection_client.exe!webrtc::videocapturemodule::CaptureInputPin::Receive(IMediaSample * pIMediaSample) 行 348 C++

流媒体帧渲染堆栈（本地，由以上部分唤醒，事件变量名in_queue_）

> peerconnection_client.exe!MainWnd::VideoRenderer::OnFrame(const webrtc::VideoFrame & video_frame) 行 609 C++

peerconnection_client.exe!rtc::VideoBroadcaster::OnFrame(const webrtc::VideoFrame & frame) 行 56 C++

peerconnection_client.exe!cricket::VideoCapturer::OnFrame(const webrtc::VideoFrame & frame, int orig_width, int orig_height) 行 223 C++

peerconnection_client.exe!cricket::WebRtcVideoCapturer::OnFrame(const webrtc::VideoFrame & sample) 行 351 C++

peerconnection_client.exe!webrtc::videocapturemodule::VideoCaptureImpl::DeliverCapturedFrame(webrtc::VideoFrame & captureFrame) 行 120 C++

peerconnection_client.exe!webrtc::videocapturemodule::VideoCaptureImpl::IncomingFrame(unsigned char * videoFrame, unsigned __int64 videoFrameLength, const webrtc::VideoCaptureCapability & frameInfo, __int64 captureTime) 行 182 C++

peerconnection_client.exe!webrtc::videocapturemodule::CaptureSinkFilter::ProcessCapturedFrame(unsigned char * pBuffer, unsigned __int64 length, const webrtc::VideoCaptureCapability & frameInfo) 行 478 C++

peerconnection_client.exe!webrtc::videocapturemodule::CaptureInputPin::Receive(IMediaSample * pIMediaSample) 行 348 C++

接收流调用堆栈(rtp，通过new_continuous_frame_event_唤醒解码线程)

> peerconnection_client.exe!webrtc::video_coding::FrameBuffer::InsertFrame(std::unique_ptr<webrtc::video_coding::FrameObject, std::default_delete<webrtc::video_coding::FrameObject> > frame) 行 359 C++

peerconnection_client.exe!webrtc::internal::VideoReceiveStream::OnCompleteFrame(std::unique_ptr<webrtc::video_coding::FrameObject, std::default_delete<webrtc::video_coding::FrameObject> > frame) 行 441 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::OnCompleteFrame(std::unique_ptr<webrtc::video_coding::FrameObject, std::default_delete<webrtc::video_coding::FrameObject> > frame) 行 425 C++

peerconnection_client.exe!webrtc::video_coding::RtpFrameReferenceFinder::ManageFrame(std::unique_ptr<webrtc::video_coding::RtpFrameObject, std::default_delete<webrtc::video_coding::RtpFrameObject> > frame) 行 52 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::OnReceivedFrame(std::unique_ptr<webrtc::video_coding::RtpFrameObject, std::default_delete<webrtc::video_coding::RtpFrameObject> > frame) 行 414 C++

peerconnection_client.exe!webrtc::video_coding::PacketBuffer::InsertPacket(webrtc::VCMPacket * packet) 行 122 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::OnReceivedPayloadData(const unsigned char * payload_data, unsigned __int64 payload_size, const webrtc::WebRtcRTPHeader * rtp_header) 行 283 C++

peerconnection_client.exe!webrtc::RTPReceiverVideo::ParseRtpPacket(webrtc::WebRtcRTPHeader * rtp_header, const webrtc::PayloadUnion & specific_payload, bool is_red, const unsigned char * payload, unsigned __int64 payload_length, __int64 timestamp_ms, bool is_first_packet) 行 116 C++

peerconnection_client.exe!webrtc::RtpReceiverImpl::IncomingRtpPacket(const webrtc::RTPHeader & rtp_header, const unsigned char * payload, unsigned __int64 payload_length, webrtc::PayloadUnion payload_specific, bool in_order) 行 182 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::ReceivePacket(const unsigned char * packet, unsigned __int64 packet_length, const webrtc::RTPHeader & header, bool in_order) 行 481 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::OnRecoveredPacket(const unsigned char * rtp_packet, unsigned __int64 rtp_packet_length) 行 298 C++

peerconnection_client.exe!webrtc::UlpfecReceiverImpl::ProcessReceivedFec() 行 228 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::ParseAndHandleEncapsulatingHeader(const unsigned char * packet, unsigned __int64 packet_length, const webrtc::RTPHeader & header) 行 500 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::ReceivePacket(const unsigned char * packet, unsigned __int64 packet_length, const webrtc::RTPHeader & header, bool in_order) 行 471 C++

peerconnection_client.exe!webrtc::RtpVideoStreamReceiver::OnRtpPacket(const webrtc::RtpPacketReceived & packet) 行 365 C++

peerconnection_client.exe!webrtc::RtpDemuxer::OnRtpPacket(const webrtc::RtpPacketReceived & packet) 行 68 C++

peerconnection_client.exe!webrtc::RtpStreamReceiverController::OnRtpPacket(const webrtc::RtpPacketReceived & packet) 行 43 C++

peerconnection_client.exe!webrtc::internal::Call::DeliverRtp(webrtc::MediaType media_type, const unsigned char * packet, unsigned __int64 length, const webrtc::PacketTime & packet_time) 行 1352 C++

peerconnection_client.exe!webrtc::internal::Call::DeliverPacket(webrtc::MediaType media_type, const unsigned char * packet, unsigned __int64 length, const webrtc::PacketTime & packet_time) 行 1379 C++

peerconnection_client.exe!cricket::WebRtcVideoChannel::OnPacketReceived(rtc::CopyOnWriteBuffer * packet, const rtc::PacketTime & packet_time) 行 1362 C++

peerconnection_client.exe!cricket::BaseChannel::ProcessPacket(bool rtcp, const rtc::CopyOnWriteBuffer & packet, const rtc::PacketTime & packet_time) 行 829 C++

peerconnection_client.exe!rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &>::CallMethod<0,1,2>(rtc::sequence<0, 1, 2>) 行 164 C++

peerconnection_client.exe!rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &>::operator()() 行 155 C++

peerconnection_client.exe!rtc::FireAndForgetAsyncClosure<rtc::MethodFunctor<cricket::BaseChannel, void (cricket::BaseChannel::*)(bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &), void, bool, const rtc::CopyOnWriteBuffer &, const rtc::PacketTime &> >::Execute() 行 49 C++

peerconnection_client.exe!rtc::AsyncInvoker::OnMessage(rtc::Message * msg) 行 43 C++

peerconnection_client.exe!rtc::MessageQueue::Dispatch(rtc::Message * pmsg) 行 531 C++

peerconnection_client.exe!rtc::Thread::ProcessMessages(int cmsLoop) 行 489 C++

peerconnection_client.exe!rtc::Thread::Run() 行 318 C++

peerconnection_client.exe!rtc::Thread::PreRun() 行 307 C++

流媒体入队，通知任务调用堆栈（远程媒体流部分，由以上部分唤醒，事件变量名new_continuous_frame_event_，通过in_queue_唤醒渲染线程）

> peerconnection_client.exe!rtc::TaskQueue::PostTask(std::unique_ptr<rtc::QueuedTask, std::default_delete<rtc::QueuedTask> > task) 行 233 C++

peerconnection_client.exe!webrtc::IncomingVideoStream::OnFrame(const webrtc::VideoFrame & video_frame) 行 66 C++

peerconnection_client.exe!webrtc::VideoStreamDecoder::FrameToRender(webrtc::VideoFrame & video_frame, rtc::Optional<unsigned char> qp, webrtc::VideoContentType content_type) 行 84 C++

peerconnection_client.exe!webrtc::VCMDecodedFrameCallback::Decoded(webrtc::VideoFrame & decodedImage, rtc::Optional<int> decode_time_ms, rtc::Optional<unsigned char> qp) 行 148 C++

peerconnection_client.exe!webrtc::VP8DecoderImpl::ReturnFrame(const vpx_image * img, unsigned int timestamp, __int64 ntp_time_ms, int qp) 行 1129 C++

peerconnection_client.exe!webrtc::VP8DecoderImpl::Decode(const webrtc::EncodedImage & input_image, bool missing_frames, const webrtc::RTPFragmentationHeader * fragmentation, const webrtc::CodecSpecificInfo * codec_specific_info, __int64) 行 1083 C++

peerconnection_client.exe!webrtc::VCMGenericDecoder::Decode(const webrtc::VCMEncodedFrame & frame, __int64 nowMs) 行 230 C++

peerconnection_client.exe!webrtc::vcm::VideoReceiver::Decode(const webrtc::VCMEncodedFrame & frame) 行 324 C++

peerconnection_client.exe!webrtc::vcm::VideoReceiver::Decode(const webrtc::VCMEncodedFrame * frame) 行 291 C++

peerconnection_client.exe!webrtc::internal::VideoReceiveStream::Decode() 行 505 C++

peerconnection_client.exe!webrtc::internal::VideoReceiveStream::DecodeThreadFunction() 行 487 C++

peerconnection_client.exe!rtc::PlatformThread::Run() 行 223 C++

peerconnection_client.exe!rtc::PlatformThread::StartThread() 行 135 C++

流媒体帧渲染调用堆栈（出队动作，由以上部分唤醒，事件变量名：in_queue_）

> peerconnection_client.exe!MainWnd::VideoRenderer::OnFrame(const webrtc::VideoFrame & video_frame) 行 609 C++

peerconnection_client.exe!rtc::VideoBroadcaster::OnFrame(const webrtc::VideoFrame & frame) 行 56 C++

peerconnection_client.exe!cricket::WebRtcVideoChannel::WebRtcVideoReceiveStream::OnFrame(const webrtc::VideoFrame & frame) 行 2409 C++

peerconnection_client.exe!webrtc::internal::VideoReceiveStream::OnFrame(const webrtc::VideoFrame & video_frame) 行 398 C++

peerconnection_client.exe!webrtc::IncomingVideoStream::Dequeue() 行 77 C++

peerconnection_client.exe!webrtc::IncomingVideoStream::Dequeue::<unnamed-tag>::operator()() 行 79 C++

peerconnection_client.exe!rtc::ClosureTask<(lambda at ../../webrtc/common_video/incoming_video_stream.cc:79:44)>::Run() 行 66 C++

peerconnection_client.exe!rtc::`anonymous namespace'::DelayedTaskInfo::Run() 行 101 C++

peerconnection_client.exe!rtc::TaskQueue::ThreadState::RunDueTasks() 行 391 C++

peerconnection_client.exe!rtc::TaskQueue::ThreadState::RunThreadMain() 行 319 C++

peerconnection_client.exe!rtc::TaskQueue::ThreadMain() 行 296 C++

peerconnection_client.exe!rtc::PlatformThread::Run() 行 223 C++

peerconnection_client.exe!rtc::PlatformThread::StartThread() 行 135 C++