Robert Nisbet in an essay titled “Uneasy Cousins” in the underappreciated ISI book, Freedom and Virtue: The Conservative/Libertarian Debate (ed. George W. Carey):
I believe a state of mind is developing among libertarians in which the coercions of family, church, local community, and school will seem almost as inimical to freedom as those of the political government. If so, this will most certainly widen the gulf between libertarians and conservatives.
I think Nisbet was already late to the development of this state of mind in 1984. In fact, one can find it in Mill over a hundred years earlier. Furthermore, Nisbet would have been wise to put “coercions” within quotation marks since what he was really talking about are the social pressures, mores, and approbations/disapprobations of non-state communities rather than coercion (which is properly understood as the threat or use of physical violence).
But Nisbet was right to point to the development of this view and how it separates conservatives and libertarians. One could add more than a quarter decade later that it works to prevent the revival of the fusionism that held together the opponents of modern liberalism during Nisbet’s time. The view that “social pressure of communities equals coercion” remains troubling today and something that seems more broadly held amongst libertarians than in the past. A bad sign for virtue libertarians, right-libertarians, conservative libertarians, or whatever we want to call those who don’t identify with what might be called libertine libertarianism or Millian libertarianism or lumped in with left-libertarianism or liberaltarianism.