The Franklin County Health Department was shut down Wednesday afternoon after mold was discovered, according to a department spokeswoman.