Change page on ipad with annotation tools active

I would like to be able to *easily* change page on my ipad with annotation/pen tools active. 

It would greatly improve the UX if when could work more directly rather than having to switch on, annotate, switch of, flip page, switch on etc. I'm aware that you can swipe with two fingers but this is error prone with a pen active - you easily end up with the whole page hilighted. (See crude illustration.)