What does statistical significance mean?

A 5% level of significance means you have a 5% chance of rejecting the null hypothesis when actually you shouldn't have rejected it. In other words, you have a 5% chance of making a mistake. Of course, we want this error to be as low as possible. That's why a .0001 level is frequently used.