Skip to main content

Brainstorm participates in EMERALD, a project funded by the European Commission

Brainstorm, a company specializing in real-time 3D graphics, virtual sets, and augmented reality solutions, is participating in the European Project EMERALD “AI and Process Automation for Sustainable Entertainment and Media” funded by the European Commission under the Horizon Europe Programme. The interdisciplinary Consortium of seven partners includes leading companies from the movie, broadcast, streaming and live entertainment technology sectors (British Broadcasting Corporation, Brainstorm Multimedia SL, Disguise Systems Ltd, Filmlight Gmbh and MOG Technologies SA) supported by two major European universities (Universidad Pompeu Fabra and The Provost, Fellows, Foundation Scholars & The Other Members Of Board Of The College Of The Holy & Undivided Trinity Of Queen Elizabeth Near Dublin).

"EMERALD strives to pioneer ground-breaking tools for the digital entertainment and media sectors by harnessing the potential of AI, Machine Learning, and Big Data technologies. The overarching goal is to revolutionize processing, enhance production efficiency, minimize energy consumption, and elevate content quality through cutting-edge innovations", says Francisco Ibáñez, R&D Project Manager at Brainstorm. "Currently, there is a massive increase in the volume of video-based and extended reality content, with an unsustainable demand for skilled human resources, data processing and energy. This project aims to address this challenge through the development of process automation for sustainable media creation.”

EMERALD aims to apply ML to automate some of the most labor-intensive tasks involved in video content production, which have considerable implications for both time and energy use. Javier Montesa, R&D Technical Coordinator at Brainstorm, says that Brainstorm in collaboration with University Pompeu Fabra (UPF) will develop DL-based methods and tools for video matting. “The main objective is to produce high-quality results for the automated real-time integration of remote presenters or performers into virtual scenes and sets for broadcast/streaming media using DL without the need of a trimap. With the AI enhancement of BRA’s InfinitySet, we will bring the quality of green-screen methods to simpler configurations.”

Javier explains that Brainstorm plans to integrate InfinitySet with UPF Deep Learning systems for the estimation of the head and body pose that will allow the operator to trigger content that will be displayed automatically on different parts of the scene, virtual screens, 3D graphics place holders, or simply in front of the presenter as he or she moves around. Francisco adds that “we will explore new ways to improve the presenter insertion, to billboard and twist its silhouette, or to calculate its shadow with more precision and realism”.

Furthermore, Brainstorm will be involved in the creation of tools designed for automated color balancing and matching shots. Color manipulations are required in post-production, in VP and in broadcast virtual studios. Javier states that automating the color grading of the presenter to match the virtual scene will be particularly valuable for broadcast virtual studios that do not have colorists. “The integration of this automated color correction in InfinitySet will simplify the use of the tool and improve the presenter-scene integration when lighting conditions are not controlled or when virtual scene lighting conditions are meant to vary during a programme”.

The progress of the project and the results obtained can be followed on https://www.upf.edu/web/emerald as well as on the project's social networks.

This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101119800.

Labels:

Comments

Post a Comment

Comments will appear after approval, which may take time :)

Popular posts from this blog

Disguise and Cuebric Launch AI-Driven Content Generator for Virtual Production

Disguise  — a world leader in virtual production technology used for  Top Gun: Maverick ,  The Joker  and more — has partnered with AI platform  Cuebric  to make virtual environments faster, easier and more cost-effective to build than ever before.  As part of the partnership, Cuebric has been integrated with the Disguise platform. This means creatives can now use AI to create the shape and depth of 2.5D environments, then import them into Disguise. The result is a plug-and-play scene that can be executed on an LED stage in only two minutes. This allows anyone to tell immersive stories, no matter the production environment or virtual art capabilities they have, saving weeks of pre-production work. “Real-time environments look spectacular on-camera, yet often require many hours of artistic and technical build,” said Addy Ghani, VP of Virtual Production at Disguise. “Thanks to our partnership with Cuebric, there’s now another option. Using generative AI,...
Post a Comment
click to read more...

8th Annual Digital TV Central and Eastern Europe Event

I attended to IP & TV World Forum and TV Connect events in Istanbul, which of both was organized by Informa. Having attended to these events, I am glad to say that I will have chance to follow the Digital TV Central & Eastern Europe Event on 25-27 June at Krakow, Poland.  Actually I have to thank to Informa, for their support in attending the event.  Main topics that will be covered in the event are OTT (Over The Top) TV and Pay TV. There will be a one day event dedicated to Over The Top Television. I will try to attend this event also, which will be on 25 June. In fact I think that OTT will replace classic IPTV offers, with the increase in smart tv, connected tv sales figures, need for a set top box will diminish. Therefore, this one day event is really important for the sector professionals.  When we look at the speakers of the event, one can easily understand the importance of the event. Some of the speakers are: Ian McDonough, Senior Vice Pres...
4 comments
click to read more...

Shall we not build DTT, after WRC 2015

According to the news in the web site of EBU, 470 - 694 MHz will be reserved for DTT & radio microphones not only till WRC 2019, but also till WRC 2023. At the WRC 2023, 470 - 960 MHz band will be reconsidered. It is good news for the DTT business in Europe. But is it a good news for Turkey? As you may well know, Turkey has not yet spend any money on DTT. There is no DTT network, nor a finished frequency allocation tender. Hence, we can say that there is nothing, just NOTHING regarding DTT.  So, in best circumstances, the tender for DTT frequencies can be finished by 2016 & the network would be ready by 2017. Well, the picture becomes interesting from that point. The frequency allocation would be for 10 years, which covers 2016-2026. But, during the WRC 2023, the frequency usage will be reconsidered again. It may be more meaningful to think not to build DTT at all, and start thinking to work on xG mobile networks. I would appreciate for your comment...
2 comments
click to read more...