To me the OP sounds like he's secretly wanting a relationship.
The whole idea behind a fuck buddy/fwb, you get to have sex without the emotional attachments.
Additionally _YOU_ never defined the rules of the 'game' (as apposed to relationship).
Why should you be LESS accountable for your actions for having another partner join, yet you're unwilling to do the same, or even compromise?
Again this all leads to the fact that you've let your emotions in, YOU are the one who wants MORE.