God told Moses that He, the LORD, would drive out the people that were occupying the land which had been promised to the children of Israel. Moses and the Israelites were to destroy everything left behind that had been used to worship foreign gods. God knew that his people were inclined to worship gods other than himself, so he makes the point that he is a jealous God, whose name is Jealous.
We tend to think of jealousy as envious resentment, but in this passage the term means vigilant in maintaining or guarding something [His holiness], and intolerant of unfaithfulness or rivalry. The LORD is holy and righteous, and he will not share his glory with another. When mere man puts anything ahead of God or even equal to him, the LORD is jealous. Thank God that he is also merciful. Take a moment and ask the LORD if there are any “altars” or “sacred stones” in your life that are robbing God of the worship he is due. Then by faith smash them and return the LORD to the proper place of honor in your life.