I'm the same way. I find the majority of men sexually repugnant, but I would say that I have a dick fetish. I would have no qualms over sucking a cock or anything of that nature, but I feel that unless it's with a transsexual or an effeminate man it would seem sort of degrading.
Does it make me gay? I don't know and couldn't care less. It's not as though upon discovering that I may be anything short of heterosexual that the thoughts will simply go away, so there's no point in obsessing over it.