A bump map i believe makes your textures have more, texture ;/
So if you had a peice of paper, it's flat right? Well what if you crumpled it up and then put it flat again, it would be bumpy and stuff.
flat piece of paper = normal texture
crumpled piece of paper = bumpmap
That's just my take on it.