Finite element models of crack with different direction angle were established to analyse the cracks detection using the pulsed eddy current thermography in ferromagnetic and nonferromagnetic metal materials. It was discussed the impact of different direction angle of cracks to the distribution of eddy field and temperature field. Extracting the maximum value of the surface temperature of the specimen as the feature, the relationship between the orientation angles and the geometric dimensions of the different crack was analyzed. In ferromagnetic materials, cracks can be detected in any directions angle. But it is difficult to achieve detection to the small direction in nonferromagnetic material. According to the symmetric characteristics of the surface temperature distribution of the specimen, crack orientation can be initially judged. The surface maximum temperature value along the crack direction angle increases linearly with the increase of crack direction angle. It can be used for further identification.