I am a little surprised that you got the plug off without a socket wrench, but that is the way to get it back in. The rod is an aluminum or magnesium anode that protects the water heater from corrosion. If it is more than 1/3 corroded, replace it.
David
David