I picked up Heartgold a few days ago, and have used the Pokewalker a couple times. I started using it again today and noticed it wasn't making any noise. I doubt the battery could be dead already, because I just got the game.

Check your sound settings - open up the menu, go to Settings and make sure you haven't selected the first option