I'm not surprised much at all at how hard it is to get feedback on a story... not that it doesn't happen; some stories get LOADS of feedback, but yes; there are many stories that get none.
However, I think it just comes down to subject matter.
I'm a member of a great many story boards ranging in subject from castration to poetry to TG, and I see many varying amounts of feedback, but a couple of points stand out.
First, the more 'weird', or risque, or considered-abhorent-by-the-average-joe, the less amount of feedback you will get, but that which you DO get will pobably be very pro or very against.
Second, when one gets towards the stuff society really balks at, i.e. minor stories and castration, the responses drop to near zero.... while at the same time, the HITS go up. Which tells me there are many readers for those stories, and they read them multiple times, but are far more shy to leave any trace behind (forum feedback or even email).
Over at BigCloset, a very large forum with great members and fine management and thousands of stories, the one with the most hits (by a wide margin) but fewest replies is one of the most 'scary', dirty, evil-minded stories there.
Here at the E.A., it's the same, pretty much. I've posted three stories and I think one or two got a comment on the board, but the best feedback came via email from non-members (too shy to post, I assume, which is fine).
Instead, I look at the numbers. Between those three stories, my little deposits in the archive have been read, or at least skimmed, TWENTY TWO THOUSAND TIMES....

!!!! AAAHH!!! I dunno about anybody else, but that damn near makes me feel famous! I figure if I'm really conservative and say just 10% of those 'reads' represent readers that enjoyed the stories, thats still over TWO THOUSAND happy fans. My gosh... almost makes me nervous!
So, I feel great even without much real feedback on the boards or in email.
But, that's just me.