I was able to resolve this issue as follows:
When you do:
ssh-keygen -t rsa
it prompts you to (optionally) enter a filename for saving the generated keys.Specifying a filename wasted my whole day! Next day I let it use the defaultfilename and the problem(s) disappeared! Imagine!!
Platform was Win7 and msysgit.