From the described actions, I'd say 'not by definition'. Did you even touch him? Yes, (most) gay and bisexual men swallow semen, but that act itself does not make someone a gay man (consider: your wife swallows come, is she a gay or bisexual man? no? QED)
If you suck a man's dick or take it in...