On second thought, it is already a game like that, its called majora's mask.