Please help me with my sentence

If people refuse to keep me company then my own sister at least, won’t be able to refuse to do so

By this sentence I mean that if people don't want to be with me then my sister at the least won't be able to refuse Is the structure of the sentence correct as it is? If not, what should I correct? and what about using the comma? Please help me without changing the intended meaning