Maybe it's just me but alarm bells would be going off.
I'd already spoke to wife about this same situation should it occur.
I told her I'm fine with her having a regular lover, but inbetween her seeing him I'd prefer it if she meet other guys also.
I guess that's reassurance for me to show it's more about getting cock than getting attached to one particular guy.