When you link to an external site, you are essentially giving that external site 'Google points' and they get credit for that backlink.

For example: When you link to Amazon, you are giving Amazon.com credit for the link which will increase Amazon in the search engines. This is why they rank so well in the SERPs.