1. 网络协议
RTSP (RTP, SDP)
HTTP/HTTPS progressive streaming
HTTP/HTTPS live streaming draft protocol:
MPEG-2 TS media files only
Protocol version 3 (Android 4.0 and above)
Protocol version 2 (Android 3.x)
Not supported before Android 3.0
Android 3.1之前的版本不支持HTTPS
以上协议支持音频和视频
2. Media Format
| Type | Format / Codec | Encoder | Decoder | Details | Supported File Type(s) / Container Formats |
| Audio | AAC LC | • | • | Support for mono/stereo/5.0/5.1 content with standard sampling rates from 8 to 48 kHz. | • 3GPP (.3gp) |
| HE-AACv1 (AAC+) | • | • | |||
| HE-AACv2 (enhanced AAC+) |
| • | Support for stereo/5.0/5.1 content with standard sampling rates from 8 to 48 kHz. | ||
| AAC ELD (enhanced low delay AAC) | • | • | Support for mono/stereo content with standard sampling rates from 16 to 48 kHz | ||
| AMR-NB | • | • | 4.75 to 12.2 kbps sampled @ 8kHz | 3GPP (.3gp) | |
| AMR-WB | • | • | 9 rates from 6.60 kbit/s to 23.85 kbit/s sampled @ 16kHz | 3GPP (.3gp) | |
| FLAC |
| • | Mono/Stereo (no multichannel). Sample rates up to 48 kHz (but up to 44.1 kHz is recommended on devices with 44.1 kHz output, as the 48 to 44.1 kHz downsampler does not include a low-pass filter). 16-bit recommended; no dither applied for 24-bit. | FLAC (.flac) only | |
| MP3 |
| • | Mono/Stereo 8-320Kbps constant (CBR) or variable bit-rate (VBR) | MP3 (.mp3) | |
| MIDI |
| • | MIDI Type 0 and 1. DLS Version 1 and 2. XMF and Mobile XMF. Support for ringtone formats RTTTL/RTX, OTA, and iMelody | • Type 0 and 1 (.mid, .xmf, .mxmf) | |
| Vorbis |
| • |
| • Ogg (.ogg) | |
| PCM/WAVE | • | • | 8- and 16-bit linear PCM (rates up to limit of hardware). Sampling rates for raw PCM recordings at 8000, 16000 and 44100 Hz. | WAVE (.wav) | |
| Image | JPEG | • | • | Base+progressive | JPEG (.jpg) |
| GIF |
| • |
| GIF (.gif) | |
| PNG | • | • |
| PNG (.png) | |
| BMP |
| • |
| BMP (.bmp) | |
| WebP | • | • |
| WebP (.webp) | |
| Video | H.263 | • | • |
| • 3GPP (.3gp) |
| H.264 AVC | • | • | Baseline Profile (BP) | • 3GPP (.3gp) | |
| MPEG-4 SP |
| • |
| 3GPP (.3gp) | |
| VP8 | • | • | Streamable only in Android 4.0 and above | • WebM (.webm) |

本文深入探讨了音视频技术的核心组件,包括网络协议、媒体格式、编码算法等,并详细介绍了从编码到直播的流程。主要内容涵盖RTSP、HTTP/HTTPS、MPEG-2TS等协议,以及AAC、HE-AAC、MP3等音频格式;同时,对Android不同版本对HTTPS的支持变化进行了说明。此外,文章还列举了支持的音频、视频文件类型及容器格式,如.mp4、.aac、.wav等。最后,对图像处理、AR特效、AI音视频处理等前沿技术进行了简要介绍。
1089

被折叠的 条评论
为什么被折叠?



