A man with cerebral palsy and other disabilities was attacked and robbed by a woman because she saw him as an easy target, a court heard.