tachyon1
17 Jul 2006, 04:21 PM
I've had a quick look at how the new fifa rankings compare with the old ones.
The old ratings did a reasonable job of predicting the outcome between two teams.The respective ratings of each team in themselves wern't really important,but the difference between them was.If you regressed the results of previous tournament games against the difference in rankings of the two teams you found the relationship between the two was fairly constant.Provided you allowed for a continental advantage of around 0.4 of a goal,regular HFA,and reduced the ratings of Concacaf and Asia by upto half a goal,you found the net difference in fifa ratings when multiplied by about 0.008 gave the expected goal supremacy for that particular match up.From goals supremacy it was a short step to win/draw/loss probabilities.
To use the Czech Rep(772) verses USA(756) WC game as an example.
Czech Rep fifa rating 772 + Continental advantage 50(0.38 of a goal)+53(Concacaf overvaluation of 0.4 of a goal) minus USA rating 756 = 119
Therefore Czech Rep ahead by 119 rating points,multiply by 0.0076(current value of the constant)=0.9 of a goal.
That equated to a CRep win probability of about 58%,a draw prob of about 26% and a USA win prob of about 16%.Most decent rating system had the Czech Rep win prob. between 54 and 58%.
Moving on to the new ratings.Unfortunately we only have the post WC figures.However,one feature of a decent ratings system is that whereas it will give a higher weighting to most recent results,these recent ratings should only gradually affect a teams current worth.For example if a team beat it's previous rating by an average of a goal a game for say seven games,it's base rating should only move relative to it's rating at the start of the run by around 0.2 of a goal.If the team at the end of this outstanding run could go back and play itself at the start of the run then it's win probability would only increase from 35% to about 39%.
No team in the WC got even close to this kind of run,therefore if the new fifa rankings are to have any predictive power it should be safe to use the new post WC ratings to evaluate the chances of the teams in the WC matches that have just taken place.
Therefore we only have games involving teams from the top fifty or so places.If these new rankings are going to follow the same pattern as the previous ones then the regression constant is obviously going to be different.It looks as though it's going to be in the region of 0.002,that gives you 0.1 of a goal being equivalent to 50 new ranking points.
Taking the same Czech Rep vs USA game
Czech Rep 1223 + Continental advantage 190 minus USA rating 933=480
Czech Supremacy=480*0.002=0.96 of a goal.That compares well with the 0.9 supremacy value derived from the old rating...with one significant difference.It appears the new fifa rating has addressed the overrating of concacaf.You no longer have to fudge for it.It's no longer there for Iran,SA,Japan either.These teams(and their neighbours) have plummetted in the ranking partly because they had a poor WC,but mostly because their confederation appears to have been re rated.
Overall the new ratings appear perform to a similar level as the old ones from a predictive point of view,but only time and more games and ratings will tell.
Zero ratings for a loss and the lack of goal difference slightly worries me.
The old ratings did a reasonable job of predicting the outcome between two teams.The respective ratings of each team in themselves wern't really important,but the difference between them was.If you regressed the results of previous tournament games against the difference in rankings of the two teams you found the relationship between the two was fairly constant.Provided you allowed for a continental advantage of around 0.4 of a goal,regular HFA,and reduced the ratings of Concacaf and Asia by upto half a goal,you found the net difference in fifa ratings when multiplied by about 0.008 gave the expected goal supremacy for that particular match up.From goals supremacy it was a short step to win/draw/loss probabilities.
To use the Czech Rep(772) verses USA(756) WC game as an example.
Czech Rep fifa rating 772 + Continental advantage 50(0.38 of a goal)+53(Concacaf overvaluation of 0.4 of a goal) minus USA rating 756 = 119
Therefore Czech Rep ahead by 119 rating points,multiply by 0.0076(current value of the constant)=0.9 of a goal.
That equated to a CRep win probability of about 58%,a draw prob of about 26% and a USA win prob of about 16%.Most decent rating system had the Czech Rep win prob. between 54 and 58%.
Moving on to the new ratings.Unfortunately we only have the post WC figures.However,one feature of a decent ratings system is that whereas it will give a higher weighting to most recent results,these recent ratings should only gradually affect a teams current worth.For example if a team beat it's previous rating by an average of a goal a game for say seven games,it's base rating should only move relative to it's rating at the start of the run by around 0.2 of a goal.If the team at the end of this outstanding run could go back and play itself at the start of the run then it's win probability would only increase from 35% to about 39%.
No team in the WC got even close to this kind of run,therefore if the new fifa rankings are to have any predictive power it should be safe to use the new post WC ratings to evaluate the chances of the teams in the WC matches that have just taken place.
Therefore we only have games involving teams from the top fifty or so places.If these new rankings are going to follow the same pattern as the previous ones then the regression constant is obviously going to be different.It looks as though it's going to be in the region of 0.002,that gives you 0.1 of a goal being equivalent to 50 new ranking points.
Taking the same Czech Rep vs USA game
Czech Rep 1223 + Continental advantage 190 minus USA rating 933=480
Czech Supremacy=480*0.002=0.96 of a goal.That compares well with the 0.9 supremacy value derived from the old rating...with one significant difference.It appears the new fifa rating has addressed the overrating of concacaf.You no longer have to fudge for it.It's no longer there for Iran,SA,Japan either.These teams(and their neighbours) have plummetted in the ranking partly because they had a poor WC,but mostly because their confederation appears to have been re rated.
Overall the new ratings appear perform to a similar level as the old ones from a predictive point of view,but only time and more games and ratings will tell.
Zero ratings for a loss and the lack of goal difference slightly worries me.