I turned on (Word)Press It just to check it out, but now I've deactivated it and it still shows up on the live site. Is there a way to manually remove it from the page?
It may just be your cache. The templates cache lasts for an hour (hardcoded, needs to be changed to use settings), so check back after that amount of time (or delete all *.html files in content/system/cache/ ).