Ah, well I see the shape of why it's appealing then. I just can't stand the execution: Sheri Moon is a bad actor, the dialogue is nails on a chalkboard (Rob Zombie found out how many times you can say fuck before it becomes unbearable), and the characters are not appealing in the least (that we're apparently meant to sympathize with them later in the film makes no sense). The things you stated are good but that's really just the skeleton of the movie, all the meat on those bones. It's as pretentious as Natural Born Killers but not nearly as well made.
That said, with what you enjoyed about this movie I woukd reccomend The Texas Chainsaw Massacre 2 (a good chunk of Devil's Rejects is ripped off from this whole cloth and it's arguably what got Bill Moseley the role of Otis Driftwood.), the original When a Stranger Calls, Behind the Mask: The Rise of Leslie Vernon, and Psycho 2.