NTT Develops World’s First Real-time 4K High Frame Rate HEVC Codec—Enabling Live Transmission of High Frame Rate Video, Resulting in Smoother and Sharper Video Quality
NTT has developed a real-time 4K*1 high frame rate (HFR) High Efficiency Video Coding (HEVC)*2 codec that enables live transmission of HFR video. HFR enhances video smoothness and sharpness by doubling the frame rate*3 of the standard video frame rate (SFR) from 50/60 p to 100/120 p. HFR video is especially effective for fast-moving video content such as sports.
By developing this codec, NTT will contribute to enhancing the quality of broadcasts and public viewing of sporting events. NTT will also develop opportunities to use HFR transmission in virtual reality and surveillance applications.
Ultra-high-definition (UHD) services have been launched recently by many satellite operators and OTT (over-the-top) platforms throughout the world. In March 2015, NTT announced a real-time 4K/60 p HEVC video encoder LSI (large-scale integrated circuit) called NARA (Next-generation Encoder Architecture for Real-time HEVC Applications) , which has contributed to the rapid acceptance of UHD services.
Live sports programs are the main drivers of UHD services, so HFR video technology, which is especially beneficial for sports content, has attracted strong interest from UHD service providers. NTT’s real-time 4K HFR HEVC codec enables UHD service operators to conduct live broadcasts of HFR sports content.
3. Technical overview
Both the 4K HFR HEVC encoder appliance and the 4K HFR HEVC decoder appliance, key components of the real-time 4K HFR HEVC codec, are a compact 1U (1 rack unit: 44.45 mm height) size (Fig. 1). The 4K HFR HEVC encoder appliance provides backward compatibility by supporting temporal scalable coding*4, meaning the output stream can be decoded by a conventional SFR decoder to yield 4K SFR video.
Moreover, our codec supports the MPEG Media Transport (MMT) protocol*5 which enables hierarchical transmission. Two independent transmission routes can be used to transfer the base-layer data, which is used for decoding 4K SFR video, and the enhancement-layer data, which is used together with base-layer data for decoding 4K HFR video.
4. Technical features
(1) Multichip encoding
The encoder uses two NARA chips in parallel to achieve the high-speed processing demanded by HFR encoding, while maintaining visual quality by carrying out mutual data transfers between the chips.
(2) Hierarchical transmission by MMT protocol
The MMT protocol enables the base-layer data and enhancement-layer data to be transmitted over different IP (Internet protocol) streams. Using two different transmission routes creates a timing offset in the arrival of the data streams. MMT can reconfigure the order of data by using timestamps based on UTC (coordinated universal time).
NTT Service Innovation Laboratory Group