-
Tuesday, August 11, 2020
Home Technology This room-sized LED egg captures amazing 3D models of the people inside...

This room-sized LED egg captures amazing 3D models of the people inside it

Capturing human performances in high-definition 3D is a complicated proposition, and among the many challenges is getting the lighting right. This impressive new project from Google researchers puts the subject in the center of what can only be described as an prismatic LED egg, but the resulting 3D models are remarkable — and more importantly, re-lightable.

What’s called volumetric capture uses multiple cameras in a 360-degree setup to capture what can look like a photo-realistic representation of a subject, including all the little details like clothing deformation, hair movement, and so on.

Two Serious Weaknesses

First, it’s more like a 3D movie than a model, since you can’t pose the person or change their attributes or clothing; The second is an extension of the first, in that you can’t change the way the person is lit — whatever lighting they had when you captured them, that’s what you get.

“The Relightables” is an attempt by a team at Google AI to address this second issue, since the first is pretty much baked in. Their system not only produces a highly detailed 3D model of a person in motion, but allows that model to be lit realistically by virtual light sources, making it possible to place it in games, movies, and other situations where lighting can change.

Images from the Google AI paper that show the capture process and resulting 3D model alone and in a lighted virtual environment.

It’s all thanks to the aforementioned prismatic egg (and a couple lines of code, of course). The egg is lined with 331 LED lights that can produce any color, and as the person is being captured, those LEDs shift in a special structured pattern that produces a lighting-agnostic model.

The resulting models can be placed in any virtual environment and will reflect not the lighting they were captured in but the lighting of that little world. The examples in the video below aren’t exactly Hollywood-level quality, but you can see the general idea of what they’re going for.

The limitations of volumetric capture make it unsuitable for many uses in film, but being relightable brings these performances a lot closer to ordinary 3D models than they were before. Of course, you still have to do all your acting inside a giant egg.

“The Relightables” will be presented by the team at SIGGRAPH Asia.

Avatar
Chaitanya Kayandehttp://vyapaarJagat.com
Chaitanya is a weird combination of Engineering, Journalism and Poetry. Out of everything in the world, he loves chai (tea), monsoon, trekking, travelling and writing the most! Read and enjoy his raw and authentic writing 🙂

Stay Connected

5,728FansLike
249FollowersFollow
2FollowersFollow
13,989FollowersFollow
95FollowersFollow
0SubscribersSubscribe

Must Read

Why Exporter should avail the benefits under the Government Incentive Scheme

Government provides financial assistance to the exporters in the form of Government Incentive to help them secure market in the global market and to make Domestic Product competitive in the global market and these are the reason they should avail the benefits given by the Governments in the form of incentives. Export Incentives includes following –   Export SubsidiesDirect paymentsLow cost loansTax exemption etc. The...

Jerry Jones Biography: Success Story of Dallas Cowboys CEO

In this success post, we are going to share the story of Jerry Jones, the man who single handled enabled ‘Dallas Cowboys’...

LEGALWIZ.IN launches essential business agreements kit

Ready to Use Kit of Essential Legal DocumentsSubstantial Cost Benefit For StartupsCrafted by Experienced Lawyers Ahmedabad, India, July 30,...

Determination is a Journey to the Destination

A journey to the destination depends on your determination. To be more defined, we would like to share the experience and about...

Related News

Why Exporter should avail the benefits under the Government Incentive Scheme

Government provides financial assistance to the exporters in the form of Government Incentive to help them secure market in the global market and to make Domestic Product competitive in the global market and these are the reason they should avail the benefits given by the Governments in the form of incentives. Export Incentives includes following –   Export SubsidiesDirect paymentsLow cost loansTax exemption etc. The...

Jerry Jones Biography: Success Story of Dallas Cowboys CEO

In this success post, we are going to share the story of Jerry Jones, the man who single handled enabled ‘Dallas Cowboys’...

LEGALWIZ.IN launches essential business agreements kit

Ready to Use Kit of Essential Legal DocumentsSubstantial Cost Benefit For StartupsCrafted by Experienced Lawyers Ahmedabad, India, July 30,...

Determination is a Journey to the Destination

A journey to the destination depends on your determination. To be more defined, we would like to share the experience and about...

George Soros Biography: Success Story of Qualcomm Fund CEO

In this success post we are going to share the story of George Soros, the astute businessman who founded the highly profitable...

Language »
×

Hello!

Click one of our representatives below to chat on WhatsApp or send us an email to [email protected]

×