I have a very close relationship with both my mother and my sister, and I have no romantic feelings whatsoever for either. You would do well to remember incest, even if consensual, is illegal in most countries.
...except that when you grow up in the same house with someone of the opposite sex your body is basically programmed to not be attracted to them