Not with the ItemViewSlotCategoryItemActionSetBinding component. But you can create custom ItemViewSlotItemActionBindings. You could create own that checks the ItemAction as an Attribute on the ItemDefinition. Check this page:
Due to the incredible flexibility of the Attribute system it is often asked how could an Item be used as a Skill. For our purposes . . .
opsive.com
Actually you can use the "UseItemActionSetAttribute" with the CategoryItemActionSet, such that you can have different effects when calling "Use" by using the ItemActionSet that is an attribute value of the selected item.