Do yourself a favor today and read Kathryn Schulz take on Waldenghazi. Ayn Rand even comes up:
The other and more damning answer to the question of why we admire him is not that we read him incompletely and inaccurately but that we read him exactly right. Although Thoreau is often regarded as a kind of cross between Emerson, John Muir, and William Lloyd Garrison, the man who emerges in “Walden” is far closer in spirit to Ayn Rand: suspicious of government, fanatical about individualism, egotistical, élitist, convinced that other people lead pathetic lives yet categorically opposed to helping them. It is not despite but because of these qualities that Thoreau makes such a convenient national hero.
Well worth your while to read the whole thing.