Four children were hospitalized Monday afternoon after the rear engine of a Durham charter school bus overheated.