So, what sources would you guys and gals recommend for someone who is completely new to this Exalted thing? (And by "someone" I mean "me".)
I'm going to leave out mechanical material, here, on the basis that two editions have been mechanically crap and the third has yet to be released. In terms of background material, you can largely skip Second Edition - there are only a few books worth touching, many of which come with qualifiers.
Scroll of Kings is pretty good,
Compass: Malfeas has some fun stuff, and
Masters of Jade was a last gasp of actual quality before the edition expired. The rest you can skip.
"But Revlid", you ask, "surely you don't mean to offer conditional recommendations to three books out of an edition with more than 30 publications to its name!" In response, I only tug my cap down a little further over my eyes, to hide a single salty tear.
There's technically also
Manual: Alchemicals and
Compass: Autochthonia, but they deal with a very far-removed alternate setting.
1e has a much better spread of books, at least in part because they were still busy introducing new ideas back then, so even stupid stuff can be buried under a dozen other things or is left unfleshed enough that it's an easy fix. There are potholes, absolutely, but they can be avoided more easily. You can get a brought sweep of the setting from
Scavenger Sons (for an ant's eye view) and
Games of Divinity (for a god's eye view). I'd recommend you start there. Other excellent books include
Manacle and Coin (the older brother of Masters of Jade),
Exalted: The Dragon-blooded (everything you need to know about The Empire and why they're morally obliged to stomp on your face),
Savage Seas (perhaps overly dry maritime stuff), and
Houses of the Bull God (a marvelous snapshot of one particular corner of the setting). A lot of the
Caste Books are also good, and
The Book of Three Circles covers sorcery.
Technically you should probably also get a core book, since, y'know, it's intended as the first thing you see and will give you basic context for other mechanical stuff. I don't believe it hugely matters which you pick up, though you won't get much use out of them if you're waiting for 3e.
Oh, and to make a recommendation no-one else will...
Lord of Light, by Roger Zelazny, is just about the most Exalted thing I have ever read.