Loading...
> >

Anyone interested in importing camera-tracking data to DAZ Studio? [Commercial]

3D Universe3D Universe Posts: 328
edited March 2022 in The Commons

We have created a HitFilm Composite Shot (.hfcs) importer for DAZ Studio and we wanted to gauge the interest level in making it available as a product.
Using the CamTrackAR app on an iPhone, we filmed a quick sequence in our studio and then used our importer to recreate the scene and camera in DAZ Studio. 

Here is an example of a 3d figure added to our mobile phone video footage: https://youtu.be/ba4FIJ52Yzw
 

Post edited by 3D Universe on

Comments

  • algovincianalgovincian Posts: 2,610

    Definitely interested - cheers!

    - Greg

  • Sci Fi FunkSci Fi Funk Posts: 1,198

    Also interested. Thanks.

  • benniewoodellbenniewoodell Posts: 1,969

    Yeah, I'd be interested. 

  • IvyIvy Posts: 7,165

    I'd definitely be interested if it will work for android phones also

  • nonesuch00nonesuch00 Posts: 18,120

    yep, I would too

  • pjwhoopie@yandex.compjwhoopie@yandex.com Posts: 793

    Can anyone explain to me... what this does... and what I just saw on the Youtube video?

    Does this "daz-ify" the video you shoot with your camera, or does it just simulate the movement of the camera.

     

    Color me confused... but be gentle please.

  • GordigGordig Posts: 10,053

    Camera tracking involves placing markers throughout video footage in order to determine where those markers sit in 3D space. This lets the 3D camera follow the same motion as the physical camera. In other words, the camera in 3DU's demo video is exactly following the motion of the camera they used to film that footage, so any 3D objects placed in that scene will look like they fit in the footage.

  • 3D Universe3D Universe Posts: 328
    edited March 2022

    Chumly said:

    Can anyone explain to me... what this does... and what I just saw on the Youtube video?

    Does this "daz-ify" the video you shoot with your camera, or does it just simulate the movement of the camera.

     

    Color me confused... but be gentle please.

    Normal camera tracking applications (like SynthEyes) will take a video and track the way items move in the video to calculate the actual camera's movement. This is time-consuming as the tracking process is complex and often doesn't give the best results.
    The CamTrackAR app on iOS uses Apple's built-in Augmented Reality features to track the camera's motion live while the video recording it taking place. This does away with the complex tracking process normally required, and generates a HitFilm Composite Shot (.hfcs) file that can then be imported into programs like Blender.

    The script that we've created can bring that .hfcs file directly into DAZ Studio and recreate the exact camera properties (position, focal length, resolution, etc.) as an animation so that a 3D item can be placed in the DAZ "scene" and will appear to be part of the original video when rendered out.

    Here's a more detailed video showing the process: https://youtu.be/fubuDFiYCq0

    Post edited by 3D Universe on
  • PhatmartinoPhatmartino Posts: 287

    Yes, also very interested!!

  • Sun2xSun2x Posts: 13

    Hi, I'm interested for an Android version or better for an Alembic importer...

    Thanks!

  • Doc AcmeDoc Acme Posts: 1,153

    I'm "interested", but I'd be sold if it was a two way street.

    At present Daz is in it's own realm camera-wise. Specifically, what Daz needs is a means to export it's own camera data out to agnostic format that can be imported w/ subpixel accuracy into anything that accepts FBX.

    But to be abe to import or convert as well?  Can you imagine what that would mean to an UltraScenery scene?

     

  • thedoctorthedoctor Posts: 197

    Seriously interested in this.

  • 3D Universe3D Universe Posts: 328

    thedoctor said:

    Seriously interested in this.

     https://www.daz3d.com/camera-tracking-importer-for-daz-studio--hitfilm-composite-shot

  • JeanGabJeanGab Posts: 5

    I was looking for how adding a movie in background of DAZ and I see this post   !!  This has been posted since a long time .. is it possible to obtain that ? it would be wonderful . thank you .. .. 

  • 3D Universe3D Universe Posts: 328
    edited May 2023

    It's not possible to have a movie set as a background in DAZ Studio, but we have a video walkthrough on how to use our tracking conversion utility and various programs to composite rendered frames over the original video. 
    click on the product link above to find out how. 

    Post edited by 3D Universe on
  • WayOfTheSwordWayOfTheSword Posts: 32

    I3D Universe said:

    We have created a HitFilm Composite Shot (.hfcs) importer for DAZ Studio and we wanted to gauge the interest level in making it available as a product.
    Using the CamTrackAR app on an iPhone, we filmed a quick sequence in our studio and then used our importer to recreate the scene and camera in DAZ Studio. 

    Here is an example of a 3d figure added to our mobile phone video footage: https:/I /youtu.be/ba4FIJ52Yz

    I bought this and it works great.  But I'm wondering if you have any plans to add in support for Mocha Pro?  Mocha Pro can also save files in the .hfcs format, but it doesn't seem to jive with your importer for some reason.  Even when I try to make it look like the output that CamTrackAR produces.  It just freezes the plugin.  I feel like there must be some essential thing your plugin is looking for that the Mocha Pro file doesn't have.  It would be a huge leap for me to be able to bring in high quality/Hollywood level planar tracking camera solves to Daz.  Being limited to only a phone camera's footage running at 30fps really limits the usability of the plugin.  But I think with a few tweaks, it could get a camera solve from a Mocha generated file pretty easily.

    * Mocha Pro is the Academy Award-winning  software essential to VFX artists for motion tracking, rotoscoping, object removal, image stabilization, and new PowerMesh tracking.

Sign In or Register to comment.