It's not wrong to jealously guard your resources, including time, to help those you know you can. It's not cowardice to help who you can, how you can, when you can. This is a systemic problem that needs to be dealt with strategically. All that being said I understand the feeling.