Abstract Through overlapping the stresses at the end region of a crack,the total stress at the end region of tensile and shearing crack is obtained,which is then introduced into D-P failure criterion. The relation between coefficient of D-P failure criterion and rock fracture toughness KIc,KIIc is deduced. The validity of deduced relation is proved by an example of slope rock masses in Three Gorges Project.