Pages

Sunday, 3 July 2016

The Biggest Expected Goals Shocks of 2016/15

Expected goals models have slowly gained acceptance into the mainstream of football analytics.

Whether they are entirely attempt based, predicting the likely outcome for an attempt based on its characteristics compared to historical precedence or non shot based, the aim is the same.

Namely to examine the process of goal scoring in a probabilistic way to attempt to see which teams possess solid fundamental skills that should bring success in the long term, even if they may not always reap their just rewards in the short term.

To mimic actual scorelines, expected goals match summaries are often presented as a cumulative total of the individual expected goals accrued by each team through their efforts in the match.

For example, a side may actually win the game by 2-1, while posting equivalent expected goals totals of say 1.78-1.05.

Intuitively the actual score feels fair and proper. The first named team out scored their opponent both in terms of actual and expected goals and the respective totals are relatively similar.

There are some well documented pitfalls from using cumulative expected goals, notably how a side's expected goals is distributed over their attempts, particularly in terms of so call big chances.

Simulating each chance is the most obvious way to reacquaint expected goals conclusions with the granular nature of the original data.

In comparing expected goals conclusions to actual score lines we should try to sift those optimistic sides who hope for an occasional goal bonanza by trying their luck often and from distance and those continually strive to create fewer, gilt edged chances.

On opening weekend, Arsenal created 21 opportunities, cumulatively amassing around 1.7 expected goals compared to 8 visiting West Ham attempts totalling barely half an expected goal.

West Ham still won 2-0.

Simulating each individual attempt in the game results in Arsenal "winning" around 70% of the time and West Ham just 7%, with 23% of iterations drawn. An 82% success rate for the Gunners, where draw are counted as half a win.

On the day, West Ham's success rate was a perfect 100%. But even when using actual scorelines there may exist different levels of dominance.

The record margin of victory in a Premier League game was Manchester United's 9-0 thrashing of Ipswich Town in 1995. Norwich and Liverpool in 2015/16 also played out a nine goal game, where Liverpool edged the match 5-4.

Comparing these two actual wins, with very different margins of victory, it is perhaps intuitive to think that Manchester United could only be credited with a 100% success rate, whereas Liverpool's single goal win in a goal feast is perhaps less worthy of a perfect score.

Actual goals scored and allowed can be converted into a more probabilistic final reckoning in a variety of ways and those leaving Carrow Road in late January may not have quibbled had it been suggested that Liverpool might have only deserved a success rate marginally above 50% based on the "anyone could have won" 5-4 final score.

West Ham's 2-0 win at the Emirates should perhaps lie between Liverpool's fortunate 5-4 win and United's record breaker 9-0.

A success rate of circa 90% perhaps, in a sport that is usually low scoring might seem a reasonable estimate for the Hammers' actual scoring and conceding achievement in overcoming Arsenal 2-0.

We now have ways to express actual and expected scores in the same currency of probabilistic success rates, so we can compare the two figures for a single match to see where the divergence is greatest.

And that occurred at the Emirates when Arsenal (1.7 expected goals) lost 2-0 to West Ham (0.4 expected goals).

The season's second biggest disconnect between scoreline and expected goals occurred on the final scheduled day of the season when Stoke (0.4 expected goals) beat West Ham (3.1 expected goals) by 2 actual goals to 1.

What goes around................

Saturday, 18 June 2016

Promotion. An Expected Goals Perfect Storm.

Although most fans will have their attention focused firmly on Euro 2016, mid June is also an exciting time for followers of the promoted teams with the gradual release of the new season fixtures.

The greatest anticipation will be felt, along with a certain trepidation, among the supporters of Middlesbrough, Burnley and Hull, who reacquaint themselves with the newly enriched Premier League.

Promotion to the top tier no longer automatically offers short term monetary gain in exchange for regular defeats and a swift return to the Championship. But the regular success supporters became accustomed to in their promotion season will not be repeated in 2016/17.

The stark reality for promoted teams is that they will score fewer goals and concede more than they did in the Championship and most would happily take 17th spot come May 2017 and a chance to grow into their newfound affluent position.

A team scores goals through shot volume, shot quality, taking shots from better positions and then having players that can finish these opportunities consistently well.

These factors can be followed with increasing difficulty.

Volume merely involves counting, this is followed by an expected goals based model and finally a repeatable over performance in such a model that is unlikely to be wholly down to random variation.

The three promoted teams to the Premier League in 2015/16, Bournemouth, Watford and the subsequently relegated Norwich mustered nearly 2,200 non penalty goal attempts between themselves in their promotion year, but this fell to just 1313 during their Premier League campaigns.

Accounting for the greater number of Championship games, the rate per game fell from just under 16 to 11.5. Attempts allowed increased from 11.5 to 12.5 in the Premier League.

However, proportionally, goals scored and allowed fell and rose by larger amounts.

Goals scored by the promoted three fell by 45% in the next Premier League season compared to just a 27% fall for attempts and goals conceded increased by 55% compared to just a 5% increase for attempts allowed.

So based on the experience of last season there appears to be a disconnect between the change in goals scored when going from the Championship to Premier League and the change in attempts.

One possible cause for this disproportionately large change in actual goals across the two seasons is that promoted teams, as well as experiencing a change in shot volumes, will also find chances they both create and face will be converted at different rates in Premier League compared to the Championship.

Around 13% of the games the promoted trio played in the Championship was against sides who then fell into the third tier of Division One, while over 20% of their subsequent Premier League games would be against teams competing in the Champions League.

So it is fair to assume that the overall quality of opposition will rise sharply.

We may see if this is a reasonable assumption by adding a term to a shot model to distinguish between attempts made in the two different leagues for the three promoted sides to see if there is a significant difference in success rate when taking a shot in the Premier League and an identical one based on shot location in the Championship.

Based on the experience of Bournemouth, Watford and Norwich, the Championship was an easier place for them to convert similar chances than was the top flight.

Attempts from the same pitch location were less likely to result in a goal in the Premier League, more likely to be off target and more likely to be blocked compared to the Championship.

As an example, a shot from the edge of the box in the Premier League was converted 5% more often by the promoted trio in the Championship compared to identical efforts in the Premier League.

It is easy to surmise a range of contributing factors.

The level of opposition talent faced by these nascent Premier League sides in their promotion year on average was likely to be well below that faced subsequently.

This not only includes the level of goalkeeping talent, but also the ability of Championship sides to defend as a unit, close down potential assists and disrupt the creation of clear cut opportunities.

Although the promoted teams may be capable of creating chances, the level of defensive pressure during the shot may be significantly greater in the Premier League.

In short, the competitive environment faced by the promoted teams inevitably shifts upwards.

This reduced likelihood of converting chances compared to the experience in the lower grade of the Championship is repeated on the defensive side of the ball.

When faced with Premier League quality attacking, attempts conceded from identical pitch positions are less likely to be blocked than in the previous campaign, more likely to require a save and more likely to concede a score,

So if the most recent batch of promoted teams are typical, supporters of 2016/17's newly arrived trio can expect fewer attempts, with a reduced likelihood of scoring compared to comparable opportunities in the Championship and a similarly rough deal in defence.

Making survival, if they can emulate Watford and Bournemouth, all the more sweet come May 2017.

Thursday, 16 June 2016

Is Wayne Rooney's England Career At An End?

In this pre Euro 2016 post I looked at the age profile of all 23 qualifying teams in their group matches prior to the tournament and also posted the typical age graphs here.

The abilities of one peak aged player compared to another will obviously depend upon their innate talent levels.

A 27 year old Aron Gunnarsson may not be fit to wear the shirt of a 31 year old Ronaldo, but the physical advantages of having more peak aged players may tilt a contest or a compressed tournament schedule slightly towards those teams clustering around the ideal.

What is undeniable is that every participant in a sport based on both skill and physical attributes eventually reaches a point where their output no longer increases, but actively declines.

This cycle of improvement and then decline is most often illustrated in the normal curve of performance indicators, such as goals per game for strikers or a proxy, such as minutes played for players generally.

This approach is fine in a relatively large dataset, but may be much more noisy for individual players, where impact injuries, rather than wear and tear can remove large chunks of a season.


The above plot shows Alan Shearer's change in scoring input from his debut for Southampton to his final outing for Newcastle. It is inevitably noisy, but the general trendline indicates a season on season improvement until the line crosses the x axis and turns negative around the 1999-2000 season as Shearer approached 30.

June 2000 also marked Shearer's final appearance for England. So his international career ended at the point where it appears his club performances were beginning to gradually decline when measured by his goal scoring output. Shearer continued his club career until 2006.



England habitually have around 2 million eligible males between the peak age of 24 and 29 from which to source their premier international goal scorer. So it is perhaps not surprising that often their elite scorers rarely remain on the international stage much past their peak.

The populations of Wales, Scotland, Northern Ireland and the Republic of Ireland are dwarfed by England's with the peak age male population ranging from around 190,000 for Scotland down through the Republic and Wales to a mere 60,000 for Northern Ireland.

It is also the case that other sports may compete for the same pool of talent.

Therefore, a much smaller selection pool exists for England's nearest neighbours and this may partly explain both Northern Ireland and the Republic of Ireland's less than ideal age profile from their qualification matches.

England has a selection pool that is 35 times the size of Northern Ireland's and as we can see from the table above, such countries often have to stick with their premier talent even in their declining years through lack of credible younger talent emerging.

The Republic's Robbie Keane is still a member of their Euro 2016 squad arguably over a decade since he reached his scoring peak. Scotland's Dalglish, Wales' Rush and Northern Ireland's Healy were each accruing caps 5 or 6 years beyond their best year.


Wayne Rooney is already an outlier among England's primary strikers having already played 4 years past his apparent scoring peak.

Had he played for any of the other home nations or the Republic it would perhaps be understandable if not yet been usurped by a less innately talented, but younger rival.

But to have survived as England's primary striker for so long, suggests either an unusual dearth of attacking talent from within a 2 million pool of resource or selection based on past, rather than present attributes.

With a lengthening queue of striking candidates, time may have finally caught up with Croxteth's child prodigy as the leader of England's front line.