Click All (or another collection) in the sidebar.
Select one or more items, then drag them to any of the custom collections.
Tip: To select multiple items, press and hold the Command key, then click the items.
You can also click Organize with collections in Books on MacDelete books or audiobooks from your Mac in Books