Yeah, the way you remove it is to double click the plant in the garden bed, then access the option panel and set it to 'decorative' mode. That will remove the plant from the bed. If you are looking at taking a plant out without it being fully grown, and keep it vibrant, you cannot do that as far as I am aware.