There's actually references to its usage that take it back to at least 1903 and to 1905.
Reid cited James T. Lightwood’s 1928 history of the Cyclists’ Touring Club, “The Romance of the Cyclists’ Touring Club”, which suggested that the term “push bike” was first used by Joseph Pennell...