I’m not familiar with southern turf problems but it sounds like you might have Digger Wasps. HERE’S a link to more on them. If they are Digger Wasps then you’ll want them to do their thing since they are actually helping your lawn. If you can identify the wasp, that woud be a great help since many of the are helper and not hurters.