OT: Nvidia Instant NeRF

Ghosty12Ghosty12 Posts: 2,065
edited April 2022 in The Commons

Well came across this video of something that Nvidia are working on called, Nvidia Instant NeRF and it does look very interesting.. It allows the converting 2D photos into a 3D model / scene using AI, this could be a game changer indeed..

https://blogs.nvidia.com/blog/2022/03/25/instant-nerf-research-3d-ai/

 

Post edited by Ghosty12 on

Comments

  • WendyLuvsCatzWendyLuvsCatz Posts: 38,526

    does my bum/nose etc look big in this?

    no dear, it's just the algorithm cheeky

    all those influencers who get the right angle to hide flaws are going to hate it!

  • Ghosty12Ghosty12 Posts: 2,065

    WendyLuvsCatz said:

    does my bum/nose etc look big in this?

    no dear, it's just the algorithm cheeky

    all those influencers who get the right angle to hide flaws are going to hate it!

    I had a chuckle at that first bit.. But one can only imagine the possibilities, if this thing works as intended being able to create real life scenes and or people, in 3D from just photos..

  • TorquinoxTorquinox Posts: 3,589

    Andrew Price (YT Blender Guru) made a predictive presentation about this sort of thing in 2018.

  • Gator_2236745Gator_2236745 Posts: 1,312

    Whoa, that's pretty cool.  Yes, it's been done before, but it's amazing how fast they did that scene, in milliseconds not minutes or hours.

  • WendyLuvsCatzWendyLuvsCatz Posts: 38,526

    only sad thing is it will end up a subscription app like everything else these days.

    All those styleGAN deep fake apps people use on their phones, mining their data

    I would prefer a pay per use website which doesn't keep your data afterwards but am dreaming

  • hacsarthacsart Posts: 2,027

    Anyone else remember Metacreations Canoma - from 1999?  I still have a my copy.. 

    WendyLuvsCatz said:

    does my bum/nose etc look big in this?

    no dear, it's just the algorithm cheeky

    all those influencers who get the right angle to hide flaws are going to hate it!

  • McGyverMcGyver Posts: 7,066

    Looking at Nvidia's video, the most pressing question I have, is will it make that cool whooshing sound as it outputs the model and will that super groovy background music be included in the process...?

    Without that I'm not at all interested.

    This is pretty cool and very good for capturing real world stuff, but fantasy and sci-fi stuff will still require 3D model making or at least really good physical props. 

  • McGyverMcGyver Posts: 7,066

    hacsart said:

    Anyone else remember Metacreations Canoma - from 1999?  I still have a my copy.. 

    WendyLuvsCatz said:

    does my bum/nose etc look big in this?

    no dear, it's just the algorithm cheeky

    all those influencers who get the right angle to hide flaws are going to hate it!

    I regretted not buying that when I first saw it in MircroCenter, but years later when I saw it being used, I regretted it less.

  • hacsarthacsart Posts: 2,027

    I can understand why :)

    I regretted not buying that when I first saw it in MircroCenter, but years later when I saw it being used, I regretted it less.

  • McGyverMcGyver Posts: 7,066

    hacsart said:

    I can understand why :)

    I regretted not buying that when I first saw it in MircroCenter, but years later when I saw it being used, I regretted it less.

    It was still pretty cool for its time... What I really regret is not downloading Autodesk's 123D Catch before they discontinued it... that was an interesting program to mess around with.

    One can still do the same, but it involves two programs and a different workflow. (Unless 123D  Catch wasn't as simple as I remember)

     

  • evacynevacyn Posts: 975

    Don't forget Epic's RealityScan app that will let you create 3D models of things with your phone - super cool.

    https://www.theverge.com/2022/4/4/23010382/epic-games-realityscan-app-3d-models-smartphone-photos

  • Now, I hope all the people who don't appreciate the nature of technology will stop saying "I don't think AI will ever be able to [fill in the blank]". It will.

    If it's not dependent on a natural impossibility, like the velocity of light, I think we have enough evidence to have to assume that mere engineering feats will always be resolved given sufficient time. I can imagine the series of luddites from prehistoric times until now, starting with a caveman telling his friend that in order to have fire, they'll always have to wait for a lightning strike. I see no difference when people today say the time-corrected equivalents.

  • solissolis Posts: 124
  • kyoto kidkyoto kid Posts: 41,211

    ... whilesome  interesting topics, I sort was amused by the fact that the narrator sounds like he's attempting to do an impression of Peter Lorrie.

    Wonder if the technology can be used for creating 3D clothing content.

    Ugh, yet another bad gateway error when I tried to submit this (requiring 6 refreshes and 8 minutes to fix).  Now with MM over maybe Daz could finally turn their attention to these decrepit servers we've been dealing with.

  • marblemarble Posts: 7,500

    Seems to me that this kind of software would be good for studios but not for the home hobbyist. I don't have people I can call on to pose from several different angles so that I can take pictures of them - my guess is that if I asked anyone to do that I would get some strange looks and curt responses to say the least. But then I'm an old man living alone so taking pictures of real people is not on the cards - which is precisely one of the reasons I use 3D software to create stories with computer generated characters.

    On the other hand, for those commercial studios, it might lead to more realistic models available to those of us who purchase ready-made characters.

  • LeatherGryphonLeatherGryphon Posts: 11,651
    edited April 2022

    TheMysteryIsThePoint said:

    Now, I hope all the people who don't appreciate the nature of technology will stop saying "I don't think AI will ever be able to [fill in the blank]". It will.

    If it's not dependent on a natural impossibility, like the velocity of light, I think we have enough evidence to have to assume that mere engineering feats will always be resolved given sufficient time. I can imagine the series of luddites from prehistoric times until now, starting with a caveman telling his friend that in order to have fire, they'll always have to wait for a lightning strike. I see no difference when people today say the time-corrected equivalents.

     Well, they were right!  It's just that we learned how to manipulate the lightning by building on their ephipany.smiley

    Post edited by LeatherGryphon on
  • HaruchaiHaruchai Posts: 1,978

    The latest version of Meshroom is really good too

    AliceVision | Photogrammetric Computer Vision Framework

  • PerttiAPerttiA Posts: 10,024

    TheMysteryIsThePoint said:

    Now, I hope all the people who don't appreciate the nature of technology will stop saying "I don't think AI will ever be able to [fill in the blank]". It will.

    Depends on what is meant with "AI", marketing slogans or actual intelligence. 

  • WendyLuvsCatzWendyLuvsCatz Posts: 38,526

    oh we know,

    we all grew up watching The Terminator and fearing Skynet surprise

Sign In or Register to comment.