When a stone is going around a circular path, the instantaneous velocity of stone is acting as tangent to the circle. When the string breaks, the centripetal force stops to act. Due to inertia, the stone continues to move along the tangent to circular path. So, the stone flies off tangentially to the circular path