I have extra hard drives that I house in those little plastic caddies, ready to pop into my PC if needed. Today I came across
this product, which is even simpler and doesn't require PC shutdown. Keep in mind, however, that the hard drive is left unprotected, especially the circuit board on the bottom. Still, for $20 this might be something to get for special situations.