Simply click on the "Setup Button in the top right corner of the Pages application. Once clicked deselect "Document Body" option. Once deselected simply click on the page you wish to remove and hit delete on your keyboard and its gone!
Hope this helps!