Fish won't go near driftwood?

I added some driftwood to my aquarium (and yes I boiled it). But then, when I put it inside the tank, my goldfish act as if they don't want to be near the driftwood. I saw one go close to the driftwood but then immediately it turned back and swam away. Anything wrong?