What is a VPN and what is it for?

Several times we mentioned VPN networks on various occasions. For those who are still slightly lost…