I had the exact same issue pairing my phone through my Garmin 660. I could hear the caller but the Garmin apparently didn't relay my voice back to the phone as they could never hear me.
Now I just put the phone in the Ram mount so I can see the caller, control playlists, etc and leave the gps...