Selecting the Customize button for the currently active theme allows you to update settings while previewing your changes. Until you choose the Save and Publish button, only the theme preview window is updated, not your live site.