I don't need a sidebar Page Menu in the design we're using, but I cannot seem to delete that Block. What would be the reason that some blocks cannot be removed from a Page?

Another example is the Blog Sidebar - the delete icon isn't available for that Block. Any suggestions?