Then have kids , live together and just don't get married. Seems like you are missing the point of marriage.
What's the point of marriage and if it is something other than a legally binding contract with the government, why is the core distinction between being married and unmarried the existence of a contract with the government?