So, what is the best practice for preserving a private file that cannot be replaced?

I'd like to protect against hardware failure, theft, and service shutdown.

(Private keys, obv.)