For audiences to enjoy content such as motion pictures, sports video games and live events to the max, home TVs not only require excellent image quality however impressive sound quality too. Understanding this, industry leaders are pursuing 3D audio advancement to add a deeper level of immersion to home entertainment experiences - bringing to life thrilling action scenes and recording the quietest information of ambient noise.
In other words, 3D audio makes listeners feel as if they're really in the middle of the action. Typically just supported at particular locations such as theater or tape-recording studios, 3D audio is making its method into homes to provide viewers a brand-new method to experience their favorite material.
Samsung Electronics' advanced research institute Samsung Research has actually been striving to promote 3D audio because 2020. To this end, Samsung dealt with Google to collectively establish Immersive Audio Model and Formats (IAMF) - an advanced 3D spatial audio innovation that was adopted by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom sat down with the team that established IAMF to hear the story of how the innovation came to life.
▲ The Visual Technology Team at Samsung Research led the development of a standard for audio technology. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam
A New Way To Enjoy 3D Audio at Home
Ambient sound exists everywhere - from the noise of shoes scraping on the pathway to the mild hum of automobiles driving down the roadway. While this noise might seem unneeded in media, it's essential in adding depth and a sense of realness. 3D audio works to flawlessly mix ambient sound with discussions and other sound effects to create a more dynamic and genuine entertainment experience.
"3D audio makes you feel as if you're actually in the heart of the action by changing the strength, motion and vibrance of the sound," stated WooHyun Nam from the Visual Technology Team at Samsung Research. "In this way, viewers have the ability to enjoy a more full-bodied noise that records the 3D aspects of the world around us."
▲ SungHee Hwang from Samsung Research's Visual Technology Team
Despite the benefits of 3D audio, it has been challenging to use the innovation to home audio devices due to technological constraints. "3D sound details from material can not be interpreted appropriately by home audio systems such as TV speakers or sound bars, resulting in a somewhat minimal audio experience that does not have information from the initial material," stated SungHee Hwang from the Visual Technology Team at Samsung Research.
To fix this, Samsung worked vigilantly with Google to establish an audio option that would permit audiences to experience material audio as planned. "If the 3D audio data can be checked out by device producers, they can change the noise in audio gadgets - permitting immersive audio experiences with basic TV speakers or sound bars at home," said Nam. "By changing the audio to match the home device environment, listeners can experience audio just as the creator meant with no distortions or loss in quality."
A consistent requirement is required to send and get audio data efficiently in between creators and gadget manufacturers. "Samsung and Google's particular competence in devices and material made the companies ideal partners to produce IAMF technology," stated JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to develop this unmatched innovation, we are leading the way for customers to enjoy 3D audio in their homes."
Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio
IAMF technology uses 3 distinct functions that boost the audio experience.
▲ WooHyun Nam from Samsung Research's Visual Technology Team
1. Ability To Express Sound Vertically
Previous open-source audio codecs only supported horizontal sound expression. With IAMF technology, audio can now be revealed vertically so that sound is significantly multi-directional. "IAMF makes sound more sensible, by allowing listeners to hear audio in front, behind or to either side and likewise above or listed below them," said Nam. "As such, when IAMF innovation is used to home TV speakers and sound bars, it allows listeners to hear noises such as birds flying over their head on their TVs in the house."
2. AI-Based Scene Analysis and 3D Audio Effects
IAMF uses AI and deep-learning technology to analyze scenes and stress certain elements of the content - changing audio levels for more enhanced sound throughout the viewing experience. "In TV and film, there are particular scenes where the soundtrack or background music is the primary focus," stated Nam. "IAMF will stabilize the sound in these instances. Similarly, the innovation will fine-tune audio when there is character dialogue to enable the listener to concentrate on the conversation."
In addition, IAMF technology supplies optimal noise regardless of modifications in the device environment. "By changing the scene analysis audio information according to the gadget environment, IAMF technology enables listeners to enjoy the material's initial sound quality on basic home TVs," Hwang included.
3. Highly Customized Audio
Users will be able to freely change sound according to their choices with IAMF technology. Whether audiences are looking to amplify sound effects from an action scene or improve discussion, IAMF provides the versatility to tailor content audio for a more individualized experience.
▲ IAMF analyzes information from material and enables viewers to adjust and tailor audio settings. When watching a sports video game, users can directly pick whether to highlight the commentator's voice or the sounds of the game itself.
3D Audio Across the Industry With Open-Source IAMF
Open source is important to creating a unified standard across the industry. IAMF is the first open source-based audio innovation standard embraced by AOM - implying both business and independent content developers throughout the can access the innovation and expand its use.
"In order to allow people to freely develop material with 3D audio technology, related technology requires to be open to all," said Nam. "Providing a total open-source structure for 3D audio, from development to delivery and playback, will permit a lot more varied audio content experiences in the future."
Similarly, Park highlighted how IAMF innovation will have a big impact on the audio landscape moving on. "Because we live in an era controlled by material creation, IAMF will assist lead, expand and transform the 3D audio environment," he said.
Success Accomplished Through Cooperation
Research on IAMF began in 2020 and took nearly four years to complete. Through a combination of perseverance and hard work, the team had the ability to attain success.
"The project involved many days of nonstop work, and there were times when we needed to operate at night due to the time distinction in between our office and Google's," stated Hwang. "Despite these obstacles, I was proud in the end. It was a terrific opportunity to deal with developers from other nations."
The groups developed a sense of sociability along the method and built a strong foundation of trust and understanding. "A Google employee discussed how this partnership with Samsung has been the most enjoyable partnership he had actually finished so far," Park recalled. "We had the ability to accomplish this job due to the fact that our teams relied on each other. I'm very proud of and thankful for our employee' efforts and their cooperation."
▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research
Additionally, Park applauded each staff member's unique skills and know-how which helped add to the creation of IAMF. "WooHyun Nam contributed in proposing the technology development ideas while SungHee Hwang arranged and documented our team's ideas in a well-defined way," he said.
A Vision for 'Samsung Sound'
Upon its release, the Samsung Research team recognized that the standardization of 3D spatial audio marked a brand-new age of sound innovation.
"Thanks to IAMF, we can start investigating innovations that will open a world of audio possibilities," stated Nam. In line with this, the Samsung Research group is currently developing a sophisticated version of IAMF innovation that can be used to various sectors such as mobile phones, the metaverse, video games and more.
▲ With their combined efforts and relentless determination, the Visual Technology Team at Samsung Research had the ability to successfully produce a new requirement for 3D audio.
Given the success of IAMF, the Samsung Research group is encouraged to develop much better audio innovation for customers. Each of the group members shared their aspirations for the future of 3D audio.
Nam discussed his desire to develop audio technology that is more immersive. "I wish to produce a more advanced 3D audio technology that makes users seem like they are really in the scene of a film, TV show or live event," he stated. "I also intend to continue this research study up until 3D audio is applied to Samsung's mobile phones."
More broadly, Hwang discussed how he hopes Samsung will have the ability to create unequaled audio technology that will position it among the ranks of other leading audio companies. "My objective is to establish a technology that customers will have the ability to quickly distinguish as 'Samsung Sound' when they hear it," he said. "I am optimistic that the IAMF requirement is a stepping stone toward this dream. "
"My hope is that Samsung's sound technology will make it possible for consumers to take pleasure in an updated audio experience that is on par with that of present visual experiences," said Park. "I hope that content developers will use Samsung's audio innovation to make 3D audio material available. Additionally, we aim to create a helpful environment that enables researchers to take on vibrant and exciting obstacles such as expanding Samsung's audio innovation."
Technological requirements such as IAMF will make home entertainment more immersive for audiences across the board. The Samsung Research team is paving the method for developments that will alter the future of audio.
1 A non-profit market consortium formed to develop and share innovation for multimedia shipment, permitting creators to utilize the innovation without stressing over expense. It is operated by an alliance of 38 companies including Samsung Electronics, Google, Amazon, Apple and Meta.
