People who like to bind others’ consciences with their own rules and restrictions sometimes defend themselves against charges of legalism with a clever diversionary tactic. True legalism, they say, is the brand of false teaching Paul condemned in Galatians 1—the error of making some prerequisite work or religious ceremony a condition of justification. By that narrow definition, a legalist is someone who believes in salvation by works. Therefore, they say, as long as you formally affirm the principle of sola fide (faith as the sole instrument of justification), you can’t legitimately be labeled a legalist, no matter how many rules you make and impose on people who are already converted.
A better definition of legalism would be one that echoes Galatians 5:1. Legalism is the error of abandoning our liberty in Christ in order to take on a yoke of legal bondage in the hope that this will earn merit or gain favor with God. There are actually two flavors of legalism expressly condemned in Scripture.
 First is the one recognized and despised even by the strict fundamentalist with his thick rule-book. It’s the legalism of the Judaizers. The Judaizers wanted to make circumcision a requirement for salvation. They had fatally corrupted the gospel by adding a human work as a requirement for salvation. That is certainly the worst variety of legalism, because it destroys the doctrine of justification by faith and thereby sets up “a gospel contrary to the one you received” (Galatians 1:8–9). According to the Apostle Paul, that kind of legalist is not an authentic Christian.
 But another kind of legalism is the legalism of the Pharisees. It’s the tendency to measure spirituality by a list of manmade rules. This kind of legalism is a common pitfall even within the household of faith. At the root of Pharisaical legalism is a belief that holiness is achieved by legal means—living one’s life by rigorous rules and restrictions: “Do not handle, Do not taste, Do not touch” (Colossians 2:20–22). This type of legalism doesn’t necessarily destroy the doctrine of justification like the legalism of the Judaizers. But it does significant damage to the doctrine of sanctification, and it is certainly appropriate to call it what is it: legalism. It is a sinful misapplication of law, an attempt to make law do work that only grace can do. Like the Judaizer’s brand of legalism, it brings people under a yoke of bondage Scripture has not placed on them.
As a matter of fact, that is exactly what Jesus said about the legalism of the Pharisees: “They tie up heavy burdens, hard to bear, and lay them on people’s shoulders” (Matthew 23:4).
– Phil Johnson, “Real Love and Real Liberty” from Law and Liberty: A Biblical Look at Legalism edited by Don Kistler
HT: Andy Naselli