make oneself scarce

Depart quickly, go away, as in The children saw Mrs. Frost coming and made themselves scarce. This idiom applies scarce in the sense of “seldom seen” to removing one's presence. [c. 1800]