No need to replace it.  I’ll remove any root balls from last year’s annuals and add a little new soil as needed and mix a little Espoma Bio-Tone to the soil.  I also feed the annual flowers Jack’s Classic Blossom Booster every other week.