What you are describing is very common in cuckold relationships, in my opinion. As long as you are ok with it, is what matters.
My wife has always preferred sex with her bf's instead of me. But, I'm the type of cuckold that likes denial. In fact, I like long-term denial. I love knowing that...