ToggleAssign is enough for my current use model.
But if use could move his cursor to ItemHotbar directly and click it. I hope there could has some out-of-box premade item action could unassign the selected item. Or AssignHotbarItemAction could already did this?