Ok, I created left and right sword entries and set them both to Sword item type. I also have Body(for fists) and Long Sword (two handed). When I create three different item sets as Sword-None, None-Sword, Sword-Sword, it works and the inventory count is respected.
But if I use Left Hand Items...