Try to get listening time on a higher end analog set-up to gain a sense of what is possible with the medium.
Vinyl means a turntable, tonearm, cartridge, phono-stage, interconnects and of course records.
Take a look at the
VPI Nomad with built-in phono stage. It's not a long term table but will get you off the ground. Comes set-up and ready to go. Make sure you get a record brush and some means for record cleaning.
A step-up would be the Clearaudio Concept Turntable w/ Verify Tonearm. You'll need a phono-stage