I think since he asked you for food, not for money, he probably was genuinely hungry. So you simply gave food to a person who needed but could not afford it. It was a kind gesture that you should not overthink now. And look at it this way: if you ignored him, you would probably feel much worse now, wondering if you refused food to a hungry guy and trying to justify that to yourself.