The Prime Minister and Victorian Premier have weighed in on tennis legend Novak Djokovic's feelings about returning to Australia after his deportation three years ago.