In the Book creator toolbar, clicking on 'Show, modify book' will bring you to a new view where you can see all the pages that have been selected for your book.
To remove pages from your selection, click on the trash icon beside the page name. A list of all removed pages will be displayed under 'Pages removed from selection'.
To rearrange the order of pages, hold click on the page name and you can move pages up and down via drag and drop.