Something I don't understand about people against same sex marriage

As we all know, so many people use God and religion as an excuse to be against same sex marriage. However, those very same people have no problem with adulterers getting remarried. For example, a man or a woman cheat on their husband/wife and they go through a divorce and then end up marrying the person they were cheating with. How come those against same sex marriage don't try to take away the marriage rights from adulterers like they do people who want to marry someone of the same sex? The Ten Commandments clearly states that people should not commit adultery, but it says nothing about same sex marriage or even homosexuality in general. Talk about complete hypocrisy with those who use God and religion as an excuse to be against same sex marriage.