Tip:
Flip the card to the next number when the swimmer in your lane, the one you are counting for, does the flip turn at the other end of the pool.
If you do the flipping of the cards to the next number then, in a consistent basis, you won't forget nor ask yourself -- did that number already get flipped ahead.
Plus, the officials like it to happen then too.