I think the effect is only there when you move your eyes; it's strong at first because any time you see something new, your eyes move around a lot. I'm sort of guessing, though; I'm not sure how well we really understand what's going on in this style of illusion.
no subject