Yes. At the time of the Revolution, the states began to exempt such people from requirements of military service. They had in mind chiefly the Quakers, who are pacifists and whom it was widely thought unjust to punish for refusing military service. The alternative mentioned here was not paying for militia service, but paying someone to go into the Continental Army.
