You could apply a little black magic marker over the areas where the paint wouldn't come off. Or black paint. Two wrongs might make a right, in that case.
Well three lefts certainly do make a right! Might also want to take it to one of those wash bays and see if the high pressure washer can get the paint off. Those aren't strong enough to hurt rubber, but mine is.