Sleeping at night!

I adopted a cross breed puppy 4 weeks ago (He had been dumped in a cardboard box!) I live in a terrace house, with neighbours either side: sound insulation between the houses isn't brilliant. I have a cage for the puppy and started off putting him into it at night, downstairs in the kitchen. He did not settle at all and barked and whined for most of the night. I would go downstairs, not speak to him, and take him outside for a wee (praise the weeing) and then back into the cage and go back to bed.
But............
After a week of this the neighbours mentioned the noise, and so I took him up to my bedroom.
He sleeps right through the night, no weeing or pooing, no chewing, no getting out of his bed.
The vet said I should knock this bad habit on the head straight away!
What does everyone else think?
Is it a bad habit?
Should I start trying to wean him out of my room?
Comments welcome.

when i got my puupie where tryed the lot kitchen,hallect but they best they have been in my bedroom i would say it when you and you dog what not vet