Your best bet is to find a forumer here who is selling their bike for a steal, get a loan from a local bank, and do a fly-and-ride. Seriously. If you're going to take out a loan at the dealer to get a bike, you can take out a loan from the bank to get a bike. And if you buy from a forumer, you'll get a much better deal than any dealer would ever consider.
When I was shopping around (last year), here in Rochester, there was an '07AE that the dealer wasn't interested in going under 11k on. He still has it. I got my '08 from a forumer for $5800. It had 83k miles on it, but runs perfectly as the previous owner took great care of it. I was able to get another forumer to go and take a look at the bike for me since it was across the country, and he was very helpful in taking it for a ride and letting me know his thoughts. You might be surprised exactly how helpful the people around here are.
On the topid of those '05s you've seen at dealers, I would agree that the price is a bit high. They're "mid-mileage" for FJRs based on the shopping that I've done, and are 2 generations old. If one has scratches, that should bump the price down a bit more as well, but probably not too much.