detecting the pallet in forklift

I'm using a kinect and having depth map and Ir image of a fork lift.

I would like to detect the pallet of the forklift. providing having the point cloud of the forklift and having the ir image. What algorithmic steps are needed to detect only the pallet which is should be the rectangular shape.