What, then, is the bearing of Scripture, doctrine, and practice on the question of the lawfulness or unlawfulness of infant baptism?
The following five propositions, I shall endeavor to establish in connection with this subject; and the discussion of these will very nearly exhaust the question.
First, the Covenant of Grace, as revealed by God at different periods for the salvation of his people, has been essentially the same in former and later times, and has always comprehended infants within it.
Second, the Church of God, made up of his professing people, has been essentially the same in character in former and in later times, and has always included infants among its members.
Third, the ordinance of outward admission into the Church has, in it’s essential character and meaning, been the same in former and in later times, and has always been administered to infants.
Fourth, the principle on which the initiatory ordinance of admission into the Church has been administered has been the same in former and in later times, and has always applied to the case of infants.
And fifth, the practice in regard to the administration of the initiatory rite has been the same in former and in later times, and has always included the case of infants.
James Bannerman ‘The Church of Christ’ pgs 578-579
Acts 2:39