Can a man carry fire next to his chest and his clothes not be burned?
#proverbs 6:27

"Clothes" are a metaphor of a man's authority and position in his family and community. Destroying another man's house through adultery is just as likely to destroy his own.