If I can tell the game is going to be easy, I crank the difficulty up.
If I can tell the game is going to be hard, I leave it on the default difficulty.
If I can tell the game has nothing to do with gameplay and it's just basically a story game or cinematic game, I turn it down to easy so I can just get through the story.