IOS--阅读AVFoundation Programming Guide文档

本文链接：https://blog.csdn.net/qq_30185503/article/details/103954515

AVFoundation Programming Guide（超链接）

About AVFoundation

Figure I-1 AVFoundation stack on iOS

On iOS, to record video when you need only minimal control over format, use the UIKit framework (UIImagePickerController)

只是想最简单地单纯地记录视频，那么用UIKit的UIImagePickerController就够了

--Note, however, that some of the primitive data structures that you use in AV Foundation—including time-related data structures and opaque objects to carry and describe media data—are declared in the Core Media framework.

注意，AV Foundation使用的 “与时间关联的数据结构” 和 “描述多媒体数据的透明对象”，都是来自Core Media framework框架的。

At a Glance -- 初见

--There are two facets to the AVFoundation framework—APIs related to video and APIs related just to audio.

--You can also configure the audio behavior of your application using AVAudioSession; this is described in Audio Session Programming Guide.

播放音频文件使用AVAudioPlayer，记录音频文件用AVAudioRecorder，使用指南看Audio Session Programming Guide。

Representing and Using Media with AVFoundation -- 借AVFoundation来表示和使用多媒体

--The primary class that the AV Foundation framework uses to represent media is AVAsset.An AVAsset instance is an aggregated representation of a collection of one or more pieces of media data (audio and video tracks). It provides information about the collection as a whole, such as its title, duration, natural presentation size, and so on. AVAsset is not tied to particular data format. AVAsset is the superclass of other classes used to create asset instances from media at a URL (see Using Assets) and to create new compositions (see Editing).

AVAsset是多媒体的超类，用于表示各种多媒体的数据片段的集合，例如视频，音频的数据、标题、时间等等。就是audio、vedio的Asset，资产。 Using Assets教你怎么创建网络多媒体数据对象，Editing教你创建多媒体数据对象

--Each of the individual pieces of media data in the asset is of a uniform type and called a track. In a typical simple case, one track represents the audio component, and another represents the video component; in a complex composition, however, there may be multiple overlapping tracks of audio and video. Assets may also have metadata.

在AVAsset中的每一条多媒体信息都是统一的类型，被称之为track。

--A vital concept in AV Foundation is that initializing an asset or a track does not necessarily mean that it is ready for use. It may require some time to calculate even the duration of an item (an MP3 file, for example, may not contain summary information). Rather than blocking the current thread while a value is being calculated, you ask for values and get an answer back asynchronously through a callback that you define using a block.

初始化AVAsset或者track的数据需要时间去计算，计算是异步进行的。

Relevant Chapters: Using Assets, Time and Media Representations

Playback -- 录音，回播

--AVFoundation allows you to manage the playback of asset in sophisticated ways. To support this, it separates the presentation state of an asset from the asset itself. This allows you to, for example, play two different segments of the same asset at the same time rendered at different resolutions. The presentation state for an asset is managed by a player item object; the presentation state for each track within an asset is managed by a player item track object. Using the player item and player item tracks you can, for example, set the size at which the visual portion of the item is presented by the player, set the audio mix parameters and video composition settings to be applied during playback, or disable components of the asset during playback.

Asset对象的状态和数据是分离的，所以你可以对Asset对象的不同分段用不同的player同时进行操作，player item object用于管理Asset的状态

--You play player items using a player object, and direct the output of a player to the Core Animation layer. You can use a player queue to schedule playback of a collection of player items in sequence.

Relevant Chapter: Playback

Reading, Writing, and Reencoding Assets -- 读写、重编码Assets

--AVFoundation allows you to create new representations of an asset in several ways. You can simply reencode an existing asset, or—in iOS 4.1 and later—you can perform operations on the contents of an asset and save the result as a new asset.

--You use an export session to reencode an existing asset into a format defined by one of a small number of commonly-used presets. If you need more control over the transformation, in iOS 4.1 and later you can use an asset reader and asset writer object in tandem to convert an asset from one representation to another. Using these objects you can, for example, choose which of the tracks you want to be represented in the output file, specify your own output format, or modify the asset during the conversion process.

你可以使用asset reader and asset writer object来修改Asset中的track以达到修改Asset状态的目的。

--To produce a visual representation of the waveform, you use an asset reader to read the audio track of an asset.

Relevant Chapter: Using Assets

Thumbnails -- 视频缩略图

--To create thumbnail images of video presentations, you initialize an instance of AVAssetImageGenerator using the asset from which you want to generate thumbnails. AVAssetImageGenerator uses the default enabled video tracks to generate images.

Relevant Chapter: Using Assets

Editing -- 编辑多媒体

--AVFoundation uses compositions to create new assets from existing pieces of media (typically, one or more video and audio tracks). You use a mutable composition to add and remove tracks, and adjust their temporal orderings. You can also set the relative volumes and ramping of audio tracks; and set the opacity, and opacity ramps, of video tracks. A composition is an assemblage of pieces of media held in memory. When you export a composition using an export session, it’s collapsed to a file.

使用export session导出组合件的话，会导出为一个文件

--You can also create an asset from media such as sample buffers or still images using an asset writer.

Relevant Chapter: Editing

Still and Video Media Capture -- 静止和视频媒体捕获

Recording input from cameras and microphones is managed by a capture session. A capture session coordinates the flow of data from input devices to outputs such as a movie file. You can configure multiple inputs and outputs for a single session, even when the session is running. You send messages to the session to start and stop data flow.

capture session用来管理相机和麦克风捕获的输入

In addition, you can use an instance of a preview layer to show the user what a camera is recording.

Relevant Chapter: Still and Video Media Capture

Concurrent Programming with AVFoundation -- AVFoundation的并行编程

--Callbacks from AVFoundation—invocations of blocks, key-value observers, and notification handlers—are not guaranteed to be made on any particular thread or queue. Instead, AVFoundation invokes these handlers on threads or queues on which it performs its internal tasks.

AVFoundation在内部任务的线程或者队列中调用blocks、键值对、通知的处理者。

There are two general guidelines as far as notifications and threading:

UI related notifications occur on the main thread.
Classes or methods that require you create and/or specify a queue will return notifications on that queue.

--Beyond those two guidelines (and there are exceptions, which are noted in the reference documentation) you should not assume that a notification will be returned on any specific thread.

--If you’re writing a multithreaded application, you can use the NSThread method isMainThread or [[NSThread currentThread] isEqual:<#A stored thread reference#>] to test whether the invocation thread is a thread you expect to perform your work on. You can redirect messages to appropriate threads using methods such as performSelectorOnMainThread:withObject:waitUntilDone: and performSelector:onThread:withObject:waitUntilDone:modes:. You could also use dispatch_async to “bounce” to your blocks on an appropriate queue, either the main queue for UI tasks or a queue you have up for concurrent operations. For more about concurrent operations, see Concurrency Programming Guide; for more about blocks, see Blocks Programming Topics. The AVCam-iOS: Using AVFoundation to Capture Images and Movies sample code is considered the primary example for all AVFoundation functionality and can be consulted for examples of thread and queue usage with AVFoundation.

Prerequisites -- 前提知识准备

AVFoundation is an advanced Cocoa framework. To use it effectively, you must have:

A solid understanding of fundamental Cocoa development tools and techniques
A basic grasp of blocks
A basic understanding of key-value coding and key-value observing
For playback, a basic understanding of Core Animation (see Core Animation Programming Guide or, for basic playback, the AVKit Framework Reference.