Holes are window-like things that were introduced in the same update that had clouds.
You can dig a hole in a wall of stone, sand, dirt, etc. using the right tool. You cannot use your hands; that will just make your blockhead head to that location. Holes will let in the light without freezing your blockhead, and are useful when you are not yet advanced enough to craft glass.