Sack is a slang for scrotum, which also goes to explain the expression for getting fired as, "You're sacked."
In backwoods country, a potato sack is a form of clothing.