We are humans, we can't help from being distracted. So if you are working at your computer, and you get a pop up saying you have email from someone.....its very hard to not check it.
But if you are constantly checking and following up on emails, you won't be very efficient on the task you are trying to accomplish. Efficiency experts say only check your email every hour or half hour if you really have to.
The default for Gmail is to have notification off, but in case you have turned it on, think about turning it off.
Or at least set it to only "important" which it rates by who the email is from.
You find those control options in the Gear (settings) option of Gmail
Need some humor on this "problem"?