With the UK's economy a G7 laggard, some of the pro Brexit vote no longer supports the European Union departure.