A quick analogy that would help to set the right path down this nutty hobby of ours.
Think of building a race car. The speakers are the chassis and the body, they shape everything that is to come. The amp is the engine, it is what propels that fancy chassis and body and the source with the rest of tweaks are the all important finishing touch, the proper racing tires.
Another words, always audition, audition, audition until you come across a proper speaker that moves you but can also reach its potential given your listening room dimensions. Not too big, it will overpower the room and sound congested and bloated, not too small, it will never have good bass response. Once the right speaker finds you, (that's right, it is not you finding it, it's the other way around
) everything else falls into place and you can take your time auditioning components that can bring out the very best of that speaker. I would also suggest spending a very good chunk of your budget on good speakers. There is not one single item after the speaker that can make as of substantial difference as the difference between different speakers.