Cumberland, Edgecombe, Franklin, Halifax, Harnett, Hoke, Johnston, Nash, Sampson, Scotland, Warren, Wayne and Wilson counties are also under the advisory, which expires at 8 p.m.
According to the National Weather Service, although temperatures will reach the upper 90s on Tuesday, heat indexes will be as high as 110 degrees, and the heat and humidity may cause stress during outdoor activities or extended exposure.
To protect yourself from the heat, drink plenty of water, stay in air-conditioned rooms, stay out of the sun and check in on relatives and neighbors.
"It's really not a good day to be outside, unless you're in a pool," said WRAL meteorologist Elizabeth Gardner. "There's not a very good chance of a storm today, which would cool things down."
According to Gardner, the heat will last through Thursday at least.
Wednesday and Thursday will also be sweltering, with highs in the upper 90s. There is an increased chance for afternoon storms both days before temperatures drop back into the 80s for Friday.