Can you remove a statue without erasing the past?

What is the best thing to do with unwanted statues - and is it an option to leave a divisive statue standing?