Approaching sound index by multiplying second and sample rate isn't accurate

Question

I was experimenting sounds and I thought that seconds multiplied by sample rate would give me the correct index on the sound. But when I tested out, it actually turned out that it is faster then it should on short sounds and slower on the long sounds. Which approach have I thought wrong? Or is it caused by the other reasons?