In Adventure Comics #215 (June 1955), Superboy decides to take up a “super-hobby” and collect rare and exotic minerals. To store them in, he hollows out a mountain. Later when explorers accidentally stumbles on his collection, Superboy decides to store them in a space platform orbiting Earth.
It’s not quite the “Fortress of Solitude”, but we are getting closer.