Hey again @Justin, I tried it again in my game project, and finally found the problem!
The raycast of the CanSee is hitting itself, thus causing the yellow line. When i changed the offset a little, it worked.
In my repro scene, i didn't have colliders first until i realized that was the issue...