Skip to main content

Brainstorm participates in EMERALD, a project funded by the European Commission

Brainstorm, a company specializing in real-time 3D graphics, virtual sets, and augmented reality solutions, is participating in the European Project EMERALD “AI and Process Automation for Sustainable Entertainment and Media” funded by the European Commission under the Horizon Europe Programme. The interdisciplinary Consortium of seven partners includes leading companies from the movie, broadcast, streaming and live entertainment technology sectors (British Broadcasting Corporation, Brainstorm Multimedia SL, Disguise Systems Ltd, Filmlight Gmbh and MOG Technologies SA) supported by two major European universities (Universidad Pompeu Fabra and The Provost, Fellows, Foundation Scholars & The Other Members Of Board Of The College Of The Holy & Undivided Trinity Of Queen Elizabeth Near Dublin).

"EMERALD strives to pioneer ground-breaking tools for the digital entertainment and media sectors by harnessing the potential of AI, Machine Learning, and Big Data technologies. The overarching goal is to revolutionize processing, enhance production efficiency, minimize energy consumption, and elevate content quality through cutting-edge innovations", says Francisco Ibáñez, R&D Project Manager at Brainstorm. "Currently, there is a massive increase in the volume of video-based and extended reality content, with an unsustainable demand for skilled human resources, data processing and energy. This project aims to address this challenge through the development of process automation for sustainable media creation.”

EMERALD aims to apply ML to automate some of the most labor-intensive tasks involved in video content production, which have considerable implications for both time and energy use. Javier Montesa, R&D Technical Coordinator at Brainstorm, says that Brainstorm in collaboration with University Pompeu Fabra (UPF) will develop DL-based methods and tools for video matting. “The main objective is to produce high-quality results for the automated real-time integration of remote presenters or performers into virtual scenes and sets for broadcast/streaming media using DL without the need of a trimap. With the AI enhancement of BRA’s InfinitySet, we will bring the quality of green-screen methods to simpler configurations.”

Javier explains that Brainstorm plans to integrate InfinitySet with UPF Deep Learning systems for the estimation of the head and body pose that will allow the operator to trigger content that will be displayed automatically on different parts of the scene, virtual screens, 3D graphics place holders, or simply in front of the presenter as he or she moves around. Francisco adds that “we will explore new ways to improve the presenter insertion, to billboard and twist its silhouette, or to calculate its shadow with more precision and realism”.

Furthermore, Brainstorm will be involved in the creation of tools designed for automated color balancing and matching shots. Color manipulations are required in post-production, in VP and in broadcast virtual studios. Javier states that automating the color grading of the presenter to match the virtual scene will be particularly valuable for broadcast virtual studios that do not have colorists. “The integration of this automated color correction in InfinitySet will simplify the use of the tool and improve the presenter-scene integration when lighting conditions are not controlled or when virtual scene lighting conditions are meant to vary during a programme”.

The progress of the project and the results obtained can be followed on https://www.upf.edu/web/emerald as well as on the project's social networks.

This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101119800.

Labels:

Comments

Post a Comment

Comments will appear after approval, which may take time :)

Popular posts from this blog

e-interview with Cuebric

1. For the readers of TVTechTR, I kindly request a brief introduction to Cuebric. Cuebric is an elegant, intuitive tool that helps users create, segment, and dimensionalize scenes, allowing them to go From Concept to CameraTM in minutes. Through the power of artificial intelligence, Cuebric creates an entirely new way of working, one that transcends what was once possible, allowing storytellers to achieve new levels of productivity while maintaining cinematic quality. Cuebric has been welcomed and used by creators from all backgrounds, including filmmakers at prominent studios and leading VFX companies. More information online at www.cuebric.com 2. Could you please elaborate on the innovations that the collaboration between Cuebric and Disguise will bring to the industry? Additionally, is it possible to integrate Cuebric with native game engines? Plug & Play 3D uses advanced algorithms and machine learning techniques to turn image layers into near-3D assets, automatically mapped to...
Post a Comment
click to read more...

e-interview with Media Distillery

Q1. Could you kindly provide a succinct overview of your company and the solutions  showcased during IBC 2023? Amsterdam-based Media Distillery is an acknowledged leader in AI-driven video analysis solutions for the worldwide entertainment Industry. The cloud-based Deep Content Understanding™ solution provides fully automated real-time content analysis which empowers broadcasters and pay-TV service providers to optimise viewer engagement through accelerated and accurate content discovery and enhanced user experience. Media Distillery’s customer base includes major operators and broadcasters located around the globe including Liberty Global, Vodafone, Deutsche Telekom and ClaroVTR in Chile, delivering enriched viewing experiences in over 30 million homes.  The solutions showcased during IBC 2023: 1. Topic Distillery Topic Distillery ™ enables topic-based discovery for any live broadcast content, allowing viewers to find content impossible to discover before and access it faste...
Post a Comment
click to read more...

e-interview with farmerswife

Q1. Could you kindly provide a succinct overview of your company and the solutions showcased during IBC 2023? farmerswife , a leading software provider in the media industry, specializes in resource scheduling, project management, and team collaboration. During IBC, we showcased the latest release of farmerswife 7.0, which takes project management to new heights with its exciting new features. One of the standout features is the Dark mode, which not only creates a visually appealing interface but also ensures a comfortable user experience. We have also introduced QR Codes to enhance reports, making it easier to access additional details quickly. Additionally, the improved synchronization between farmerswife 7.0 and Cirkus greatly enhances collaboration, offering streamlined work allocation and resource management capabilities. At our booth, we also highlighted Cirkus's impressive range of new features designed to improve team collaboration, including role scheduling, project reques...
Post a Comment
click to read more...