The point about reading a work of fiction simply for the story is an excellent one. However, I find it personally very hard to read what I call Era Fiction (a story loosely set in a given historical era) or "what-if" fiction. I'm not wired to just take a story on its value as a story. No matter how good the story is, if I read something that's historically inaccurate, I'll think
that's not the true, it didn't happen that way
and the spell is broken. I'll waste my time looking for inaccuracies and forget the story. I cheat myself out of a relaxing experience, but I can't help it, it's the way I'm wired.
I haven't had much experience with CW fiction. IMHO, WWII produced the best historically accurate military fiction. "The Caine Mutiny", with impeccable contextual accuracy, is one of my all time favorite works of fiction, military or otherwise. If I could find a CW work of fiction that did such a masterful job of weaving a story with period accurate historical context, I'd gobble it up.
Of course, a lot of you of a Confederate bent think much of the CW non-fiction should really be classified as fiction

Sorry, couldn't resist, it was too easy. If you want to rake me over the coals, I deserve it