In order to unlock an Adventure Scene, you need to collect a certain amount of Stars AND collect all the clues in the chapter.

The number of Stars needed to unlock the Adventure Scene is shown on the card in the Scene Browser corresponding to the Adventure Scene (the card on the far right).