Playing With Higher Action

I'm wondering at which action height most folks find it hard to play.

I have stiff fingers and at 1/8" or 9/64" my fretting fingers seem to

bump into other strings.

Maybe, because of the stiffness, my finger tips aren't

 pointing straight down.