It is a sore point because you do have advantages if you have access to more...
In other words knowledge of the external world begins with an immediate utilisation of things whereas knowledge of self is stopped by this purely practical and utilitarian contact.