Now... some parents may have an issue with sending their daughter to spend a few hours around a man they don't know.
Pro tip'*If that's their starting point, you don't want them in your home.
However, and perhaps I should have been more generic, many parents have an issue leaving their child (regardless of gender) with an adult (regardless of gender) who they do not know.
Unless the crazy is clear (*) get to know the parents, at least casually. Eventually, they will reciprocate the invite. You want to know who you're leaving your child with, too.
(*) I had one mother who insisted my son not be in the house if her daughter came for a play date with my daughter. Yeah, that wasn't going to happen. Buh-bye!