Wow, you're a generous dude! Nice of you to be so giving when getting practically nothing in return. That's what family is all about! So I don't think you should worry about them being upset. If they get upset, something's not right. And you should dump them.