In a Nutshell

But now, having run through these various arguments, to what conclusion do we come? Are they sufficient to set aside our reasoned conviction, derived from some such argument as Dr. Hodge’s, that infants are to be baptized? A thousand times no. So long as it remains true that Paul represents the Church of the Living God to be one, founded on one covenant (which the law could not set aside) from Abraham to to-day, so long it remains true that the promise is to us and our children and that the members of the visible Church consist of believers and their children—all of whom have a right to all the ordinances of the visible Church, each in its appointed season. The argument in a nutshell is simply this: God established His Church in the days of Abraham and put children into it. They must remain there until He puts them out. He has nowhere put them out. They are still then members of His Church and as such entitled to its ordinances. Among these ordinances is baptism, which standing in similar place in the New Dispensation to circumcision in the Old, is like it to be given to children.

Benjamin B. Warfield, The Works of Benjamin B. Warfield: Studies in Theology, vol. 9 (Bellingham, WA: Logos Bible Software, 2008), 408.