zycoo

bing.com
For viewers to take pleasure in content such as motion pictures, sports games and live events to the fullest, home TVs not just need excellent image quality however remarkable sound quality also. Understanding this, market leaders are pursuing 3D audio development to include a deeper level of immersion to entertainment experiences - bringing to life thrilling action scenes and catching the quietest details of ambient noise.

Put just, 3D audio makes listeners feel as if they're truly in the middle of the action. Typically only supported at particular locations such as theater or taping studios, 3D audio is making its method into homes to provide audiences a brand-new way to experience their preferred material.

Samsung Electronics' advanced research institute Samsung Research has been aiming to popularize 3D audio since 2020. To this end, Samsung dealt with Google to collectively establish Immersive Audio Model and Formats (IAMF) - an innovative 3D spatial audio innovation that was adopted by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom took a seat with the group that established IAMF to hear the story of how the technology came to life.

▲ The Visual Technology Team at Samsung Research led the advancement of a standard for audio technology. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam

A New Way To Enjoy 3D Audio in your home

Ambient noise exists all over - from the noise of shoes scraping on the pathway to the gentle hum of automobiles driving down the road. While this sound may appear unneeded in media, it's vital in including depth and a sense of realness. 3D audio works to flawlessly blend ambient sound with conversations and other sound effects to develop a more dynamic and authentic home entertainment experience.

"3D audio makes you feel as if you're truly in the heart of the action by adjusting the strength, movement and vibrance of the sound," stated WooHyun Nam from the Visual Technology Team at Samsung Research. "In this way, viewers have the ability to enjoy a more full-bodied sound that catches the 3D elements of the world around us."

▲ SungHee Hwang from Samsung Research's Visual Technology Team

Despite the benefits of 3D audio, it has been difficult to apply the innovation to home audio gadgets due to technological limitations. "3D sound info from content can not be analyzed appropriately by home audio systems such as TV speakers or sound bars, leading to a slightly restricted audio experience that lacks detail from the original content," stated SungHee Hwang from the Visual Technology Team at Samsung Research.

To solve this, Samsung worked diligently with Google to develop an audio option that would permit viewers to experience material audio as meant. "If the 3D audio data can be checked out by device producers, they can change the sound in audio gadgets - enabling for immersive audio experiences with basic TV speakers or sound bars in your home," stated Nam. "By adjusting the audio to match the home gadget environment, listeners can experience audio just as the developer planned without any distortions or loss in quality."

An uniform requirement is needed to send and receive audio data smoothly in between developers and gadget manufacturers. "Samsung and Google's respective proficiency in devices and material made the business ideal partners to produce IAMF innovation," said JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to develop this unmatched technology, we are leading the way for consumers to delight in 3D audio in their homes."

Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio

IAMF technology offers three unique features that boost the audio experience.

▲ WooHyun Nam from Samsung Research's Visual Technology Team

1. Ability To Express Sound Vertically

Previous open-source audio codecs only supported horizontal sound expression. With IAMF innovation, audio can now be revealed vertically so that sound is progressively multi-directional. "IAMF makes sound more sensible, by allowing listeners to hear audio in front, behind or to either side and also above or below them," stated Nam. "As such, when IAMF technology is applied to home TV speakers and sound bars, it enables listeners to hear sounds such as birds flying over their head on their TVs in your home."

2. AI-Based Scene Analysis and 3D Audio Effects

IAMF uses AI and deep-learning innovation to analyze scenes and stress specific aspects of the material - changing audio levels for more improved sound throughout the seeing experience. "In TV and film, there are particular scenes where the soundtrack or background music is the main focus," stated Nam. "IAMF will stabilize the sound in these instances. Similarly, the technology will tweak audio when there is character discussion to allow the listener to focus on the conversation."

In addition, IAMF innovation supplies optimal sound despite changes in the gadget environment. "By adjusting the scene analysis audio information according to the device environment, IAMF innovation enables listeners to enjoy the material's initial sound quality on standard home TVs," Hwang included.

3. Highly Customized Audio

Users will have the ability to easily adjust sound according to their choices with IAMF technology. Whether audiences are wanting to magnify sound impacts from an action scene or boost discussion, IAMF offers them the versatility to tailor content audio for a more customized experience.

▲ IAMF evaluates information from material and permits audiences to change and customize audio settings. When seeing a sports video game, users can directly choose whether to highlight the commentator's voice or the noises of the game itself.

3D Audio Across the Industry With Open-Source IAMF

Open source is vital to producing a unified standard across the market. IAMF is the first open source-based audio innovation basic adopted by AOM - meaning both business and independent content creators across the market can access the technology and expand its use.

"In order to permit people to freely create content with 3D audio technology, related technology needs to be open to all," stated Nam. "Providing a total open-source structure for 3D audio, from creation to shipment and playback, will permit even more diverse audio material experiences in the future."

Similarly, Park highlighted how IAMF technology will have a big effect on the audio landscape moving forward. "Because we live in a period dominated by content creation, IAMF will assist lead, broaden and change the 3D audio environment," he said.

Success Accomplished Through Cooperation

Research on IAMF began in 2020 and took almost 4 years to complete. Through a mix of perseverance and tough work, the group was able to accomplish success.

"The project included numerous days of continuously work, and there were times when we required to operate at night due to the time distinction between our workplace and Google's," stated Hwang. "Despite these challenges, I was proud in the end. It was a terrific opportunity to work with developers from other nations."

The a sense of friendship along the way and constructed a solid structure of trust and understanding. "A Google staff member pointed out how this collaboration with Samsung has actually been the most pleasurable cooperation he had completed so far," Park remembered. "We were able to achieve this task because our teams trusted each other. I'm really happy of and glad for our employee' efforts and their cooperation."

▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research

Additionally, Park praised each team member's distinct skills and expertise which assisted add to the creation of IAMF. "WooHyun Nam contributed in proposing the technology development ideas while SungHee Hwang arranged and recorded our group's ideas in a clear-cut manner," he said.

A Vision for 'Samsung Sound'

Upon its release, the Samsung Research team realized that the standardization of 3D spatial audio marked a new era of sound innovation.

"Thanks to IAMF, we can begin looking into technologies that will open a world of audio possibilities," stated Nam. In line with this, the Samsung Research team is currently developing an innovative variation of IAMF innovation that can be used to various sectors such as mobile devices, the metaverse, computer game and more.

▲ With their combined efforts and unrelenting persistence, the Visual Technology Team at Samsung Research had the ability to effectively develop a brand-new requirement for 3D audio.

Given the success of IAMF, the Samsung Research group is motivated to develop much better audio technology for consumers. Each of the employee shared their goals for the future of 3D audio.

Nam touched on his desire to create audio technology that is more immersive. "I wish to develop an advanced 3D audio innovation that makes users seem like they are genuinely in the scene of a film, TV show or live event," he said. "I also intend to continue this research until 3D audio is applied to Samsung's smart devices."

More broadly, Hwang went over how he hopes Samsung will be able to develop unrivaled audio technology that will place it among the ranks of other leading audio companies. "My goal is to develop a technology that customers will be able to quickly identify as 'Samsung Sound' when they hear it," he said. "I am optimistic that the IAMF standard is a stepping stone toward this dream. "

"My hope is that Samsung's sound innovation will enable consumers to take pleasure in an upgraded audio experience that is on par with that of present visual experiences," stated Park. "I hope that material developers will utilize Samsung's audio technology to make 3D audio content accessible. Additionally, we aim to create a supportive environment that makes it possible for scientists to handle strong and exciting difficulties such as broadening Samsung's audio technology."
base-search.net
Technological standards such as IAMF will make entertainment more immersive for viewers across the board. The Samsung Research team is paving the method for innovations that will change the future of audio.

1 A non-profit market consortium formed to develop and share innovation for multimedia delivery, permitting developers to use the innovation without stressing over cost. It is run by an alliance of 38 companies consisting of Samsung Electronics, Google, Amazon, Apple and Meta.