I'm facing exactly the same problem.
When the image marker is detected soon after scene loading, the model shows correctly on the image.
When the image marker is not detected for a while, plane detection starts automatically and the model appears on its own (without image marker).
Is it a bug?