My Clients Guardian Asked Me Off Of Their Case Because I Use A Wheelchair

I started working with a new client last week and the first day I met with them and their guardian, I told them I used a wheelchair and crutches occasionally, but that does not impact my mobility or abilities in any way. Fast forward to this week, I got a call from my boss saying that the guardian has asked me off of the case as she is concerned about my ability to “manage the client in the community” basically she thinks that because I have a wheelchair, I’m unable to do anything in the community. I know this is discrimination and so does my boss, but I’m wondering if the guardian can get away with it and pass it off as concerns for the clients care.

Edit: I’m a DSP in Minnesota. This client has no concerns of aggression or elopement. I only help with communication.