You have some good "logical" points here, but remember, he did not go to the Bavarian to look for a woman. Sometimes, for mysterious reasons we are very impressionable, the logic flies away and the emotions take over. Things of the heart are emotional not logical. We can look at the same girl and not think anything whatsoever about her. Besides, remember that "beauty is the eye of the beer holder" I mean, beholder.
The "forbidden fruit"!
"R"