Click Memories in the sidebar.
Control-click a memory, choose Feature Less, then choose an option.
To return your memories to their original settings, choose Photos > Settings, click General, then click Reset Suggested People & Pets.