He was TINY in Dark Angel. And he's still pretty small now - maybe some people are also being confused by the fact that in SPN they generally seem to dress Dean to really bulk out his shoulders? (Lots of layers of shirts.)

But if you look at him just dressed casually, he's still pretty slim, particularly through the waist and hips.