I don't think you would have been callous. Awkwardly tactless, maybe, especially if your anxiety got the better of you.

If it were the only thing you knew about him, you'd start off thinking of him in that framework by default. That's not a comment on you, it's just...how knowledge works. And I didn't want to tell you more than that because I wanted you to form your own impressions.