[tn] Can I Have My Wife's Affair Partner Trespassed From Our House?

My wife moved out last November after having an affair for about 4 years (a whole other story). I work Friday-Sunday so she has our daughter every weekend and brings her back Sunday evenings. She often comes over before I get off work so they're waiting for me when I get there. She also keeps one of our dogs in a similar custody arrangement but often drops her off at the house earlier in the day on Sundays.

Both of our names are still on the house so I know there's nothing I can do about her coming over on her own, nor am I bothered with changing that arrangement. I am however concerned that her AP may come over as well while I'm not there, such as when she drops off the aforementioned dog. I don't have any reason to believe they're doing anything nefarious since our daughter would be with them, I just don't want him there.

Can I have him trespassed even if he's a "guest" of my wife, who is still part owner of the house?

Edit: Wow, those were fast responses. Yeah, I kind of had a feeling there's nothing I could do about it until further action is taken. I just wanted to check if there were any actual options I didn't think about.