Although numerically small, the Liberty Party exerted considerable influence in a number of northern states, and some historians attribute Henry Clay's loss of the presidency in 1844 to the Liberty Party, which took Whig votes away from Clay in New York State. In 1848, with the rise of northern concern about the expansion of slavery in the territories, most Liberty Party members joined the more moderate Free Soil Party, which appealed primarily to northern fears about the expansion of slavery.