You want setting for filter sidebar, you need to follow the steps in the images:
Click on View:
Click on Customize Theme to show option setting:
Select Collection Filter tab to show content:
You need enter text for Filter Title & Shop by tags list for all tab to show result as you like.
Filter made with tags, so all value from filter must exist from product.