It depends on the flower.  Hardey perennials can be put in as soo as the ground thaws or when they become available at the garden center.  Tender annuals need to wait until the middle of May and, even they, you need to keep an eye on the forecast for cold night below 32° F