Into some Safari extension that allow setting custom site-specific CSS code (as far as I know stock Safari only supports global custom CSS). A quick Googling suggests these two:
http://sobolev.us/stylish/ and
https://freestyler.ws/.
EDIT: Looks like Safari can remember custom per-site zoom levels too:
https://apple.stackexchange.com/a/304694.