Thanks for reminding, and sorry for delay. I almost forgot about this among other things.
First I want to note is a huge flicker on the image, caused either by the frequency of the light sources, or by electric power. This is not that for important for calibration, but surely will bring you much trouble for tracking of action videos. Try to switch the cameras to 50fps mode.
Second, the cameras seem to be too close to the actor, so in many areas he is not fully visible to all the cameras. It will greatly reduce the accuracy of tracking. You should think of finding the larger capture space.
I've processed the calibration video. At first, after the calibration has completed, there were indeed that wrong heights you mentioned. But there are two other things you should do manually to get the final scene:
- Mark the ground points
- Scale the scene based on either the real height of one of the cameras, or the distance between 2 cameras.
So, after I've marked the ground points and scaled the scene down to the height 1.28m for the camera #1, I've got 1.36m and 1.85m for other 2 cameras.
The project file is attached.