How long since you changed to https? It may take Google a few weeks to fully recognize the changed/redirected URLs. During this period, the rankings frequently drop but once everything settles down, the rankings and traffic should gradually come back to normal.

If it has been a while (at least a month or two) since the changes were made and the traffic has not returned, that would be a cause for concern.