Unknown population standard deviation
If its value is unknown, simply replacing the population standard deviation, σ, by the sample standard deviation, s, results in an interval whose confidence level is less than 95%.
Simulation
The interval estimate clearly needs to be modified in order to have a confidence level of 95%, especially for small samples.