If a person were going to move either of those things (the caboose or the locomotive), they could be moved either on the rails pretty much as they are OR as a load.
The former is almost impossible, because the equipment would have to be "brought up to code", so to speak. And with permission of what I would think would be a vast number of large corporations and government agencies.
As a load. Nobody much cares about the condition of a load, other than it be secured, not overweight, and not leaking non-approved chemicals. You could transport it with a wheeled vehicle (a flat bed or low boy) or on rails. Either might have to be partially diassembled, mainly for clearances during transport.
For something only a few miles away, diligent effort might find a clever low-cost method. MAYBE.
FWIW, when I was just a few years older than 16, I and a buddy were offered a real live PRR gas-electric for $1. I believe the "guts" still worked, as it was owned by a trolley museum that was using it for power until they got a real utility drop.
Oh, the fantasies we had!
Of course, we had to remove it from the property at our own expense.