Can listening to loud music through your headphones cause you to go deaf?

I've been wondering lately because apparently I've gotten used to the loudness and when people are around me they say it's loud when I don't think it is.