Tracking Derails Diversity