The use of tools to assist in the recovery of people with special needs is very important. In this paper, the development of a system that provides support to physiotherapy by using computer vision is presented. In this system, images are captured by a depth sensor and then are processed to obtain a simplified description of the user's shape. The shape is then interpreted by an Artificial Neural Network in order to extract the user's pose, which is finally used to orient physical exercises. The achieved results have shown the effectiveness of the proposal on the orientation of physiotherapy through the computer.