SINEMA: Social and Immersive Networked MediA

Starting date
October 1, 2009
Duration (months)
Computer Science, Department of Engineering for Innovation Medicine
Managers or local contacts
Giachetti Andrea

SINEMA intends to bring networked 2D / 3D audiovisual content to a new social and immersive dimension where the users “view”, “act” and “share” with other connected users an audiovisual experience where they are both fans and protagonists, critics and creators, viewers and actors, all this in a seamless / natural way.
SINEMA intends to make part of Woody Allen’s dream in his film The Purple Rose of Cairo come true, with the viewer entering the screen and becoming an immersive actor in the movie and with the fiction expanding into the viewer’s physical surround through ambient effects.
SINEMA will make it happen by developing advanced capture, immersion and ambient technology for networked 2D / 3D environments. User Acting (UA) in front of capture devices that film the user performance and sense the user movements and emotions, extracting relevant audiovisual elements (head, face, eyes, mouth, body, arms, legs, voice, etc.), processing captured movements and emotions, blending multiple sources of processed user acting (UA) video sequences into professional audiovisual (AV) video content, rendering the mixed UA and AV content, reaching out to the users’ physical surrounding by advanced 3D and ambient effects with wall projections, contextual lighting, spatialised sound, directional winds, contextual aroma.


Funds: requested
Syllabus: EUROPA - Progetti Europei

Project participants


Research facilities