|
...
Just to be clear, the YouTube video referenced is very old, with use of iPi V2 it looks like, from July 2, 2014, v3 came out in Nov. 2014, but v4 has resolved a lot of issues in tracking problems from v3 and is much better IMO, but if using PS Eyes and the user doesn't want to follow the strict requirements for recording and tracking, that would be the users fault, not due to the programs capabilities.
(See any of my v3 or v4 sample videos in the videos index, some recorded right from iPi Studio view port and some recorded after importing into Autodesk FBX Review program).
These were achieved with very little work inside iPi Studio, basically only tracking them, then using the integral auto-clean tools provided, the v4 tracking is much more accurate now, especially the feet being more solidly tracked to the floor planting, done with use of 6 PS Eye cams, ever since 6 cams were added for Basic version anyway, some older posts videos were done "with less quality" with 4 cams, when I was learning with version 2 Studio.
With iPi, PS EYE cams can only record at 60 fps max., and your system MUST maintain very close to 60 fps on each cam during recording to not cause issues later with dropped frame skipping in the tracking, so the smoothness you would get from 100, or 120 fps higher end programs recording will be diminished a bit, but the iPi resulting animations are still quite good and very usable...
There is a specific process that should be followed to achieve better quality tracking and the WHOLE power of the iPi Studio MUST be used for best results, if you want fast error free captures from a single pass, that is not even achievable with the highest end real time programs, so compare apples to apples with any other lower cost mocap solution and you will see how well iPi actually works, "when used correctly".
Although it isn't "real time" tracking, (which causes more headaches in clean up than to simply wait for iPi to do it's thing within itself), simply keeping the performance takes shorter, 1 minute or less, (even if the entire recording is much longer), and by spending a bit more time using the post processing capabilities within iPi Studio v4, which means reviewing your tracking several times and fixing areas you feel need improvement prior to exporting, which is very easy once you understand the system and the process, which can be isolated to specific areas of the ROI and should blend back into the prior tracking seamlessly, if done correctly and with care, and eventually you will understand the benefits of doing so and get more experienced and faster with it, but this should be only in limited areas, or in some extreme motions, most should track fairly well on the first pass, or there is something not quite right in the camera set up, or lighting, or clothing colors, or clothing fit, the requirements for PS Eyes usage must conform to the proper specifications, not expect the program to conform to the users wants.
As a reference, we can now track a 1 minute recording, or part of a recording take, at 2.5-2.7 fps tracking speed using low res option speed setting, (all we can get from our GTX 970 FTW card), all options for head, shoulders and spine set to max capability, in under 1 hour, fully refined, jitter free and exported and with limited post cleaning needed, but you will always have something to clean up a bit and depending on how accurately the performance was done to match the characters used on, this is a point that many mocap performers ignore, but is very important for outcomes later.
If it is possible to mount your cameras in solidly mounted fixed positions correctly, and never move them, (though not required), then the program is basically plug N play after that, no real need for tedious pre session calibration each time, (takes me about 5 mins from plugging in my 6 cams, to actually recording a performance), as long as you understand the cameras were never moved, they will always fall within acceptable calibration per recording session day, but you can re-calibrate at any time after also, if something seems off, as the calibration per day is calculated to what the cameras see during that days performances, and can be done even after the recording was made, AS LONG as it is done before any cameras were moved, move the cameras first after a performance session and it will loose any possibility of proper calibration for the prior recorded videos, so be highly aware of this. (Best for safeguard to do a calibration before and after a session, if you have any concerns).
There are some advantages for some users with the Kinect v2 sensors, but to me better quality of captures isn't one of them, and 30 fps max. recording, it's more of an ease of set up and use, as has been explained above.
One IMPORTANT note to mention: iPi specifically uses a directional light inside the program which the real world studio illumination must match this directional lighting set up and be brighter, but not extremely brighter, from one direction lighting the performer from that position, (usually from the side, rather than straight on the front of the performer we find), and the scene light in iPi MUST be positioned, either by clicking set to cam position button if acceptable, or manually moving the scene light by click hold and drag the blue light text position box to make it close in space to that light also, or you can get worse results during tracking than could be achieved than if this is set up correctly.
Try not to allow too much scene shadowing in the far reaches of the cameras background vision, best to have more lights of less brightness, then fewer very bright ones, this comes into play more when trying to get the maximum capture volume use of 7 x 7 m (20 x 20 ft) and light the area and performer correctly for better results.
Direct down-shining ceiling lights will not give the best achievable results either, especially if directly over the center point of the capture volume, extremely bright lighting isn't required and actually degrades the tracking quality of the system, another aspect to keep in mind when using PS Eyes, is to never allow the lights to shine directly into the lenses of the cameras, place them higher and pointing downward and shield them if needed, as PS Eyes are very sensitive to bright light and will wash the recording color out and give poor tracking results.
As to the higher resolution cameras, they are only really higher resolution closer to the camera, and iPi tracking doesn't need that really, meaning if you would ever be 30 ft away from a higher resolution camera, the size of the performer and quality of the recording will diminish, which will still diminish the tracking ability, the iPi trackers have a hard time in long distance smaller actor tracking, especially in the feet and arms, so it is better to just remain in a smaller confined capture volume for better results, but a 15 x 15 ft. area using 6 PS Eyes should work well, if all other aspects of the set up are followed, just depends on how many cams are required to fulfill the users required recording properly.
Hope this addresses some of your questions.
...
|
