The game only counts the fruits you collect before you reach a level's goal.

Once you've reached the goal and your remaining moves have been added to the score, any more collected fruits won't count towards the required amount for a Challenge.