In an offended manner, angrily, as in When he left out her name, she stalked out in a huff. This idiom transfers huff in the sense of a gust of wind to a burst of anger. [Late 1600s] Also see in a snit.
