Leviticus 16 gives the account of the Day of Atonement.

.........................On that day there were two goats brought before the Lord.

..................Lots were cast upon them.

............................One of the goats was a scape goat; having had the sins of the congregation confessed over it by Aaron, was sent away into the wilderness to some uninhabitable place and let go never to return.