ensure remove_directory is used instead of shutil.rmtree (#5510)

This change renames `safe_rmtree` into a more appropriate name with
relevant arguments. We ensure that the force behaviour is opt-in
and not the default to avoid ambiguity.