@pwolf From my experience though, the difference in points is usually like under 10 points in the re-tests we have done before. And, even if we made 100x re-tests, the nr 1 tactic would still not be "the best" for all teams. It would just be the best in our test.. In personal savegames, people have different players, and they will fit different tactics. I would thus not distinguish in quality between any of the 5-star tactics, as there really is no way to know which is "best" in all leagues for all teams. That said, it is fairly safe to presume that a 5-star tactic in our test will outperform the 4-star tactics for most teams. But, many of the 4,5 star tactics will fit many teams/leagues better than the 5-star ones and will thus outperform them in the right circumstances.
So, it wouldn't be fair to any of the tacticians to "crown" a winner....
Yes I found in 17.2* test the point difference of the same tactic in the test is fairly close. In latest test though these are what I found
There are few more repeated test in 17.2* but those tactics were not tested yet.
I think another round of test for the 5 star's and take the sum of both test as a total result will yield higher accuracy.
Btw, I am really looking forward to your league specific test. Using your current test system to find potential top tactics and then using the league specific test find the best tactic in a real league setup will be really really cool. I believe the tactic that is top in both test will be undeniably top tactic and I think even TFF fans will not disagree