One of the biggest issues with this system would be that a rich company or individual could buy large blocks of votes on a particular issue.
Another might be that a delegate could present a popular set of views in public for the purposes of gaining a large number of delegate votes but then they could privately vote for their real beliefs which might be much more fringe, or perhaps they might change their mind close to the election.