Gadgets
Amazing Magic Mirror Changes Fabrics On the Fly
Posted by Jesus Diaz at 3:11 AM on September 2, 2008
The Fraunhofer Institute--the guys who invented MP3 and screwed the music labels as a result, which is why we like them so much--have a booth at IFA with their latest inventions. The best one is this stunning magic mirror, an augmented reality display that gets any piece of clothing and transforms its fabric in real time. Live, the effect was absolutely amazing, indistinguishable from a real mirror. I just couldn't tell the difference. I think she's a witch. [More IFA 2008 Coverage]

The Fraunhofer Institute--the guys who invented MP3 and screwed the music labels as a result, which is why we like them so much--have a booth at IFA with their latest inventions. The best one is this stunning magic mirror, an augmented reality display that gets any piece of clothing and transforms its fabric in real time. Live, the effect was absolutely amazing, indistinguishable from a real mirror. I just couldn't tell the difference. I think she's a witch. [
Comments (AU Comments · US Comments)
Blair MacIntyre
Posted September 3, 2008 6:18 AM
It looks very cool, but the technology looks pretty trivial. Notice the big black square with the pattern inside it on the front of the shirt (hey, it's a fiducial marker!) that is replaced by the image on the "mirror" ... notice also that the shirt is bright chroma green, which makes it easy to substitute in.
It's a slick demo, though!
isfaq
Posted October 26, 2008 3:54 AM
this inevitable stuff of future ....which can be used in pubs,malls and even in saloon
Erzengel
Posted 3:43 AM 2/9/08
does she weighs the same as a duck?
Erzengel
Shub-Niggurath
Posted 3:41 AM 2/9/08
I can think of something else I'd like that mirror to do with her shirt. :D Aw snap!
Shub-Niggurath
BanMeAgainBrianLam
Posted 3:40 AM 2/9/08
Well with the bright green shirt it looks like they're just doing a real time chroma-key replacement. Still a neat effect though.
How about we just dip the witch in a vat of green paint and then we can make her wear whatever we want :)
BanMeAgainBrianLam
dhekke
Posted 3:29 AM 2/9/08
@Whisssper: And we would see a lot more overweight people in tight clothes...
Kidding aside, if they could expand this to more materials, this could revolutionize the way we shop.
dhekke
NicleT
Posted 3:26 AM 2/9/08
Industrial Light and Magic mall.
NicleT
Whisssper
Posted 3:21 AM 2/9/08
if this mirror could take a few inches off the waist while at it every mall in the world would buy it
Whisssper
The Magnificen7
Posted 3:16 AM 2/9/08
Wow. 'It's magic ... It's MAGIC!'
The Magnificen7
Vitamin_G
Posted 3:15 AM 2/9/08
She a witch!!! Burn her!!!!
Vitamin_G
Jing_ta
Posted 3:56 AM 2/9/08
yeh that's wonderful. Now, let's see you wrinkle the shirt. Logo doesn't look so good NOW does it?
Great idea, I'd just be surprised to see it work well with clothes on a person without serious lag.
Jing_ta
Knirfie
Posted 3:54 AM 2/9/08
@BanMeAgainBrianLam: Except that the shirt in the mirror also has a different logo on it. But yeah, it makes you wonder wether it would also work on a differently colored shirt...
Knirfie
Kid-A
Posted 3:54 AM 2/9/08
"She weighs less! Shes a duck!"
@vasha: and she turned me into a newt! I got better though...
Kid-A
dysthymia
Posted 3:51 AM 2/9/08
she is definitely amazed.
dysthymia
vasha
Posted 3:49 AM 2/9/08
She weighs less! Shes a duck!
vasha
daftrok
Posted 4:21 AM 2/9/08
There are countless applications for this. Now you can just carry a plain white shirt to the mirror and see the different styles in a store. Keep everything packed in the back and just push a button and change the style. No more off the rack shirts! BRILLIANT!
daftrok
Tarv
Posted 4:09 AM 2/9/08
practical!
Tarv
samuelk
Posted 4:29 AM 2/9/08
Just after the halfway point in the video, you can briefly see the bottom of the original t-shirt logo appear "underneath" the superimposed logo as drops the shirt downward at a speed greater than the tracking rate of the mirror.
It's a pretty incredible demo, though.
samuelk
The Magnificen7
Posted 4:24 AM 2/9/08
@Kid-A: WITCH!!!
The Magnificen7
bosskev
Posted 5:00 AM 2/9/08
Two seemingly identical shirts yet somehow different? I think this trick mirror effect is based on Patty Duke technology.
+ Watch video
bosskev
yogibimbi
Posted 4:53 AM 2/9/08
@Shub-Niggurath: if you are thinking the same as me (which is absolutely impossible, but let's just suppose;-) - heck, that would be great if a mirror could show a wearer in various degrees of undress. However, come to think of it, that's what IR is for, isn't it? And, since the mirror does just surfaces, he has no way of knowing how it's underneath...
yogibimbi
TVGenius
Posted 5:36 AM 2/9/08
@Knirfie: A lot of real-time chroma key virtual set systems use patterns of a different color to do the motion tracking as well. Take the following for example, it knows what pattern to look for and keys it out as well. Nowadays with faster processing power for less $$$ it's easier to use this method of motion tracking than to try to use a hardware-based system that can be flaky and must be recalibrated. Sets like this can also be used with handheld cameras.
[www.oreillynet.com]
TVGenius
screenshot
Posted 5:26 AM 2/9/08
The women are going to love this one...try on different outfits without the "on" part...
screenshot
ab3
Posted 6:03 AM 2/9/08
Now we just need the shirt to change
ab3
Curves
Posted 6:47 AM 2/9/08
Now I can finally see what I would look like in the nice designer stuff I cant afford.
Curves
crazy0000
Posted 7:11 AM 2/9/08
Anything that is "real" magic is going to seem lame compared to modern technology hahaha
crazy0000
Rob C
Posted 9:01 AM 2/9/08
@Shub-Niggurath:
Thank you giz folks for finally using the disemvowel function.
On topic now, I can see the use for this is fashion design and such, but it's really not that complicated of a technology, looks like the shirt is just acting as a green screen.
Although it does do an amazing job of covering for the shadows and creases on the shirt.
Rob C
Cagleicious
Posted 9:09 AM 2/9/08
i'm with Shub.. it's just simpley keying, especially with that lime green shirt.
Cagleicious
Bueller
Posted 9:41 AM 2/9/08
@Rob C: Not entirely sure why that comment was disemvoweled though, unless the remains there are not from the original comment... I've certainly seen much worse commentary hereabouts.
Bueller
wenderson
Posted 11:35 AM 2/9/08
@crazy0000: Probably, in the not far future, technology I'll be indistinguishable from "real" magic.
wenderson
Shub-Niggurath
Posted 11:43 AM 2/9/08
@Bueller: I can see Giz's point, I'm a big ol' perv... so let me make it up with a "mature" comment:
An amazing piece of tech! Imagine if it were made into a storefront that automatically superimposed clothing on passers-by... basically using the customers themselves as manikins.
srr(y?) Gzmd!
Shub-Niggurath
BiZarRroBALlmeR
Posted 12:21 PM 2/9/08
We must build a bridge out of her.
BiZarRroBALlmeR
Trowble (XBL/PSN)
Posted 12:43 PM 2/9/08
Does it have something to do with the shirt being green? Like the same trick films use for the "Green Screen" in order to use special effects.
Trowble (XBL/PSN)
bosskev
Posted 1:17 PM 2/9/08
@Trowble (XBL/PSN): "Does it have something to do with the shirt being green? Like...the "Green Screen" in order to use special effects."
Intriguing concept. You'd think somebody in this short and easy-to-read thread would have mentioned your idea before now. What are your thoughts, TVGenius and BanMeAgainBrianLam?
In any case, the answer is "no". The woman is a witch.
bosskev
Forrestgumby
Posted 1:11 PM 2/9/08
If she weighs the same as a duck, then she is made of wood. And therefore...
Forrestgumby
alin0steglinski
Posted 1:40 PM 2/9/08
awesome mirror system...
possibly green shirt effect :P
alin0steglinski
mferrari
Posted 1:30 PM 2/9/08
Jesus whispering "magic" like an excited little kid with a Spanish accent made my day.
mferrari
Set to evil
Posted 2:04 PM 2/9/08
@Trowble (XBL/PSN): @bosskev: It has less to do with with the shirt being green. I think it will work any solid color. The computer can be set to recognize a specific value and then display a different color on the fly. This tech has be around for about 15-20 years for broadcast finishing. It uses a 3d tracking software to replace the logo. there are web cam that can do that.But of course, This look better. I want to see it do Plaid!
Set to evil
Jesus Diaz
Posted 7:12 PM 2/9/08
@alin0steglinski: @Set to evil: No, this is not a simple chroma keying with a logo replacement. This is full tracking of the whole shirt in real time, actually replacing the fabric, deformed like the original, and make it look like a completely different t-shirt in the mirror.
You can't make any distinction from reality. The technique you are talking about looks like shit. There's nothing like this in broadcast or anywhere else.
Jesus Diaz
Curves
Posted 10:20 PM 2/9/08
I am reminded of the old story "The Emperors New Clothes". They could have pulled it off if it hadnt been for that meddling kid....
Curves
benbennibenben
Posted 7:52 AM 2/9/08
I'll try to translate what the Mirror guy is saying. It's very noisy but I'll try to do my best:
Guy: Dont understand the first thing he says.
Girl:
Echt?
Really?
Guy:
Kannste mal höher halten, damit er das Grün vom T-Shirt nutzt?
Can you lift it higher so that it (the Mirror) can use the green color of the t-shirt?
Es muss ne zusammenhängende Fläche sein, ja genau... wenn es als zusammenhängende Grüne Fläche erkannt wird, dann...
It has to be a connected/coherent area, that's it... if it's recognized as a connected/coherent green Area, then...
He doesn't finish the last sentence, I guess he would have said "then it's working" or something like that. Chroma key or not, it's plain awesome
benbennibenben
benbennibenben
Posted 7:48 AM 2/9/08
I'll try to translate what the Mirror guy is saying. It's very noisy but I'll try to do my best:
Guy: Dont understand the first thing he says.
Girl:
Echt?
Really?
Guy:
Kannste mal höher halten, damit er das Grün vom T-Shirt nutzt?
Can you lift it higher so that it (the Mirror) can use the green color of the t-shirt?
Es muss ne zusammenhängende Fläche sein, ja genau... wenn es als zusammenhängende grüne Fläche erkannt wird, dann...
It has to be a connected/coherent area, that's right... when it's a connected/coherent green area, then... (it's working, i guess, but he doesn't finish his sentence)
Chroma key or not, it looks plain awesome!
benbennibenben
ikillbears
Posted 3:52 AM 2/9/08
@BanMeAgainBrianLam:
But it also changes the pattern on the t-shirt. This could be great for shops as mentioned above. You could just stroll into a shop and stand in front of the mirror and select different things you want to 'try on' without having to do it.
ikillbears
munkyhed
Posted 2:42 AM 3/9/08
it seems ever-so-plausible that it could just be a type of green-screen tech.
but still, i would wear a green shirt to the mall if it let me try on different ensembles in different sizes.
hooray for the FUTURE!
munkyhed
toyotaboy02
Posted 3:54 AM 3/9/08
need a few of these in a dance club, play tricks on people.. Change their shirt to say "I'm with stupid"
toyotaboy02
Human Bomb Committed Solaricide
Posted 7:25 AM 3/9/08
I love how the IFA logo is a mirror image. This is some sexy tech. When we start walking by advertisements that are altering the way we look by putting on their products, then I'll be living in the future.
Human Bomb Committed Solaricide
Hamslicer
Posted 4:52 AM 5/9/08
You think the shirt is something?
She's really a 90 year old Chinese body builder with no teeth and purple hair holding a corn dog in his teeth.
Hamslicer