Shouldn't the church get out of marriage, and not the government?

I don't think you understand how marriage works, it doesn't matter even if God almighty came down and said you and your woman were married if you don't get a marriage contract from the government your marriage isn't legitimate. The Church, at least in the US can only perform the ceremony, but to be legally bound as a couple you need get a marriage contract from the government.