What does it mean to live by faith? Paul uses this in his letter to the Romans and said as it is written… The original context is found in Habakkuk 2:4, “Look at the proud one; his soul is not upright— but the righteous will live by faith” The proud refuses to subject themselves to any authority other than their own. When we live by faith we subject ourselves to the authority of our Creator — we hear His voice and obey His instruction.