ipisoft.com
https://forum.ipisoft.com/

Struggling with 4 Sony PS Eye cameras
https://forum.ipisoft.com/viewtopic.php?f=6&t=9233		 Page 1 of 1
Author:  MarcoMeter [ Fri Dec 05, 2014 7:25 am ]
Post subject:  Struggling with 4 Sony PS Eye cameras
Hello everybody!

Currently, I'm trying to get a mocap setup running with 4 Sony PS Eye cameras.
Images of my setup:

http://www.louisendorf.de/marco/mocap/01.png
http://www.louisendorf.de/marco/mocap/02.png

I calibrated the setup with a Mini Maglite and the iPi Studio said that it is perfectly calibrated. So I recroded some motion and tried to get the tracking done. During the calibration process, I roughly positioned the cameras to there position within the scene in iPi Studio.

http://www.louisendorf.de/marco/mocap/03.png
http://www.louisendorf.de/marco/mocap/04.png

So in terms of the tracking there are several things which don't seem good to me. First of all, I can't get the actor to match character's size in the video. Even if I extend all values to the max, the actor is way too small.

http://www.louisendorf.de/marco/mocap/05.png

This is what happens if I refit the pose:

http://www.louisendorf.de/marco/mocap/06.png


There is some behavior which I don't understand. If I move the actor on the direciton of the video, the plane holding the video is getting affected by moving the the actor towards it. I also can't match the t-pose for all 4 cameras. So I believe I didn't do the camera positioning in the calibration project wrong.



What do you think, did I do wrong? Any advices? Is the setup problematic?


Thanks in advance!

Marco
Author:  vmaslov [ Sun Dec 07, 2014 7:03 am ]
Post subject:  Re: Struggling with 4 Sony PS Eye cameras
Hi

MarcoMeter wrote:
So in terms of the tracking there are several things which don't seem good to me. First of all, I can't get the actor to match character's size in the video. Even if I extend all values to the max, the actor is way too small.

You should match model with video only when looking directly from the camera POV. The idea is that camera sees the model the same way as he saw the actor while recording.
The process goes as follows.
  • Adjust the model's height. If the scene scale was set after the calibration - camera heights over ground correspond to actual values - then it can be simply set to an actor's height.
  • Select a camera - press a number on the toolbar or on the keyboard. Position the model using the Move tool. Note that you can also rotate the model around Y axis using this tool.
  • Then select another camera and correct the position to match the second camera also.
  • Repeat for the remaining cameras, watching that the model remains about aligned in the previous cameras. Do not do any adjustments after manually moving/rotating the scene's view. Always reset to POV of some camera before touching the model.
  • When the model is more or less aligned in all cameras, adjust clothing parameters (short/long sleeves etc) and press 'Analyze Colors' button. You can also adjust the light settings on the 'Scene' tab to better correspond to your scene.
  • And then press the Refit Pose and start tracking.

MarcoMeter wrote:
There is some behavior which I don't understand. If I move the actor on the direciton of the video, the plane holding the video is getting affected by moving the the actor towards it.

The video plane moves intentionally so that it does not intersect with model. The plane's size is adjusted accordingly so it look the same from the camera's POV.

You may share your calibration video if you feel that the problem is in calibration.
Author:  MarcoMeter [ Tue Dec 16, 2014 3:37 am ]
Post subject:  Re: Struggling with 4 Sony PS Eye cameras
Thanks for your reply. I actually got it working one week ago. I tried to position the cameras more accurate within the calibration project.


But today, I tried 10 different calibrations (with the same video) and I couldn't get a good result on refitting the pose on an actual recorded motion video.
Each try, the legs got totally distorted.


I will post some pictures as soon as possible.
Page 1 of 1 All times are UTC - 8 hours [ DST ]
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/