What record player are you restoring?
.
Probably depends on what you call budget. You can buy a really nice record player for $175-225, new. Below that it's mainly plastic crap.
I have a rather nice CD player and a rather nice record player and I just can't understand why people would prefer CD's. Yes I see the downsides of records. The background noise, mainly. But it's as Neil says, a record player makes so much more 'music'. I'm not saying digital can't sound good. Because it can. But CD, in it's current format (16 bits 44.1khz samplerate) can't. Or at least it can't sound as good as a proper record player.