Decatur Utilities will close a section of Hoover Avenue on Tuesday for wastewater construction.