“So long as it remains true that Paul represents the Church of the Living God to be one, founded on one covenant (which the law could not set aside) from Abraham to to-day, so long it remains true that the promise is to us and our children and that the members of the visible Church consist of believers and their children — all of whom have a right to all the ordinances of the visible Church, each in its appointed season. The argument in a nutshell is simply this: God established His Church in the days of Abraham and put children into it. They must remain there until He puts them out. He has nowhere put them out. They are still then members of His Church and as such entitled to its ordinances. Among these ordinances is baptism, which standing in similar place in the New Dispensation to circumcision in the Old, is like it to be given to children.” BB Warfield
After spending many hours over the years reading, studying, and praying on the subject of baptism, I finally made the decision to pull my family from our Baptist church and join the OPC. I could no longer withhold the waters from our children. From the very beginning children of believers have been members of God’s visible church and at no point has He revoked their membership. Instead, He reaffirms. Continuation is evident throughout the New Testament and disregarding (or explaining away) the obvious was no longer an option.
While I believe Covenant Household Baptism (paedobaptist, oikobaptist) to be the correct biblical understanding of the sacrament, below is a list of 3 resources (defending both sides) that I found extremely helpful while studying the subject.
Baptism of Disciples Alone, Fred Malone
Believer’s Baptism: Sign of the New Covenant in Christ, Thomas R. Schreiner, Shawn Wright
The Church of Christ, James Bannerman
William: The Baptist, James M Chaney
The Church has always included infants among its members, the proof, after what has already been said, need not demand a lengthened illustration. If the Church of God, made up of His professing people, be one and the same society at all times, and under all its different dispensations, then the proof that infants were members of it at one period must be a proof that they are competent to be members of it at any subsequent period; unless, indeed, some express and positive enactment can be produced, altering the charter of the society, and excluding, as incompetent to be admitted by the new and altered terms of the deed, those formerly comprehended within it. If no such proof of alteration in the charter or constitution of the society can be produced,—if the society itself remains the same in character and terms of admission as before,—then the proof that infants were once its members may suffice for proof that they are still competent to be so. James Bannerman
In the Bible they found also the mighty doctrine of the sovereignty of God, which taught them not to approach their problems in a subjective manner as you and I are prone to do. Their concern was not, how can I get a bit of help, how can I get some physical healing, how can I get guidance, how can I get happiness and peace, how can I get a friend who will help me in my loneliness? No, they saw themselves before this almighty, sovereign God and the one question was, How can a man be just with God? They bowed before him! They were godly men; they were God-fearing men. God was at the center of their thoughts, the controller of their activities and their lives. The sovereignty of God! They did not talk much about free will, as I read them, but they knew that God was over all, and he was to be worshipped and to be feared.
The Sovereignty of God is an expression that once was generally understood. It was a phrase commonly used in religious literature. It was a theme frequently expounded in the pulpit. It was a truth which brought comfort to many hearts, and gave virility and stability to Christian character. But, today, to make mention of God’s Sovereignty is, in many quarters, to speak in an unknown tongue. Were we to announce from the average pulpit that the subject of our discourse would be the Sovereignty of God, it would sound very much as though we had borrowed a phrase from one of the dead languages. Alas! that it should be so. Alas! that the doctrine which is the key to history, the interpreter of Providence, the warp and woof of Scripture, and the foundation of Christian theology should be so sadly neglected and so little understood.
A.W. Pink, The Sovereignty of God, pg 23
Courtesy of my ESV Literary Study Bible.