Two goals from Frannie Collin sent the non-league side through in the first ever fixture to be played in the FA Cup proper on a 3G pitch.
Graham Westley and his Stevenage side will be back in action at Sixfields on Saturday after a request to Northampton to push the game back one day was turned down.
The Cobblers have rightly said that the request came too late for them to change plans for the fixture with 3,00 tickets having been sold and local clubs and teams invited along to watch.
Their opponents have been in good form in the league, however, and were 5-1 winners at home to Cheltenham last weekend.