OK, I think I’ve figured out what’s going on, but I still think it’s not correct behavior.
I had to “sign up” with my admin e-mail to the list of subscribers in order to see all the pages.
Weird / interesting thing, I’ve created a new admin with different e-mail address, that is not on the list of subscribers, logged in as it and I was able to see previewed posts. (I assume it somehow connects role + existence of it in the db?).
Something fishy there, anyways.