5.1. Media Codecs

Device implementations—

  • MUST support the core media formats specified in the Android SDK documentation, except where explicitly permitted in this document.

  • MUST support the media formats, encoders, decoders, file types, and container formats defined in the tables below and reported via MediaCodecList.

  • MUST also be able to decode all profiles reported in its CamcorderProfile

  • MUST be able to decode all formats it can encode. This includes all bitstreams that its encoders generate.

Codecs SHOULD aim for minimum codec latency, in other words, codecs—

  • SHOULD NOT consume and store input buffers and return input buffers only once processed
  • SHOULD NOT hold onto decoded buffers for longer than as specified by the standard (e.g. SPS).
  • SHOULD NOT hold onto encoded buffers longer than required by the GOP structure.

All of the codecs listed in the table below are provided as software implementations in the preferred Android implementation from the Android Open Source Project.

Please note that neither Google nor the Open Handset Alliance make any representation that these codecs are free from third-party patents. Those intending to use this source code in hardware or software products are advised that implementations of this code, including in open source software or shareware, may require patent licenses from the relevant patent holders.

5.1.1. Audio Codecs

(AAC LC) REQUIRED1 REQUIRED Support for mono/stereo/5.0/5.12 content with standard sampling rates from 8 to 48 kHz. 3GPP (.3gp) MPEG-4 (.mp4, .m4a) ADTS raw AAC (.aac, decode in Android 3.1+, encode in Android 4.0+, ADIF not supported) MPEG-TS (.ts, not seekable, Android 3.0+)

Profile (enhanced AAC+) REQUIRED Support for mono/stereo/5.0/5.12 content with standard sampling rates from 16 to 48 kHz.

(Android 4.1+) REQUIRED

(Android 4.1+) Support for mono/stereo content with standard sampling rates from 16 to 48 kHz.

5.1.2. Image Codecs

  • Codecs advertising HDR profile support MUST support HDR static metadata parsing and handling.

  • If a media codec advertises intra refresh support, then it MUST support the refresh periods in the range of 10 - 60 frames and accurately operate within 20% of configured refresh period.

  • Video codecs MUST support output and input bytebuffer sizes that accommodate the largest feasible compressed and uncompressed frame as dictated by the standard and configuration but also not overallocate.

  • Video encoders and decoders MUST support YUV420 flexible color format (COLOR_FormatYUV420Flexible).

(Android 4.3+) REQUIRED2

(Android 2.3.3+) See section 5.2 and 5.3 for details WebM (.webm) Matroska (.mkv, Android 4.0+)4