Definitely remove it to avoid any uncomfortable situations with future guests. Make sure to be careful, though - if the sign is old or has been on the door a while, the paint underneath might be a different color or the door material might be damaged. Good luck with the …