In 1811, an Old Fogey was a nickname for an invalid, wounded soldier; derived from the French word fougeux (fierce or fiery). The modern sense has changed the use a little, but there is still the element of invalid in the saying.