Ram Madhav urged the voters to come out in large numbers but said that they should remember who is loyal