I will need to look at how this worked in version 2. In version 3 the collider layer mask is only used to specify the colliders on your character but not the actual collision detection. For that you can change the solid objects in the character layer manager.