Hm, the problem may have been solved, everything seam to be working now, I'll wait with "marking as solved" until I've tested a bit more, this solution doesn't feel earned lol, not sure what I did different from before but hopefully it'll keep working on all my animations...
Edit - Yeah, it...