In case of the violation of the conditions laid down for his conduct, custody and employment, any person placed at outside labor or for study, may then be required to serve the balance of the sentence in ordinary confinement and may thereupon cancel any earned diminution of his term.
N.J.S. § 30:8-51