[AutoQA] #342: Prevent duplicate tests from being scheduled