Core Tory voters "the last to get super-fast broadband"