In order to start with a blank slate I used a knife to cut the caulk around the windowsills and apron (the piece of moulding under the window sill). Then I used a pry bar to remove them from the wall.