Insecticidal soap (not dish soap).  It is an organic that kills on contact but washes right off.  The black edges may be due to overwatering though.  Make sure to pinch off any flowers that try to form.  If it flowers it will stop producing fresh leaves to harvest.