Are some people more susceptible?
Yes. Some people are more attractive to midges (combination of body odour, temperature etc.) and some people react badly to bites.
Midges pump an anti-coagulant into the wound they create to feed from, our immune systems respond to this anticoagulant creating the itching and swelling. Our immune responses are different, which accounts for the variance seen throughout the population.