Vast majority of the males don't encounter any troubles with their prostate gland in which the dimension may be equated to that of a walnut up to the age of forty.
After which troubles might crop up and yes it could be the cause of discomfort.