Let us postulate for a moment.
For what reasons would humanity fling itself across the stars and visit an alien species?
1) Because we like exploring and meeting new people.
2) Because we need a new place to live (which might mean the 'visit' was accidental).
Now, turning this around, these would be the likeliest reasons why an alien would visit us, here on Earth.
If it is option 1, there would be a tremendous amount of investment of resources involved. Technologies would need to exist that we do not presently know how to make, so the visiting species would have a severe technological advantage. Encountering an alien species that is technologically advanced enough, and possess enough resources, to 'explore' our solar system casually means we would be fairly insignificant enough as a species.
They (the aliens) should realize that making its presence known to our species would cause an inferiority complex whereby we'd need to expand up to their level of technology and power (especially if they have been watching ANY of our behavior and news broadcasts). They might consider gifting us their technology, but our willingness to make war and murder our own people would likely cause them to have second, third, and probably even fourth thoughts about sharing star-spanning technology with such a warlike species that would have even fewer problems with making war on other species.
So, how about option 2?
That would go even less well for us, if we happen to live on the habitable planet they can live upon. As technologically superior beings, they would take over. They might be benign and benevolent and keep us around like pets, or possibly even close-to-equals, but given we are already straining our planetary resources I can't imagine they'd think that 'culling the human herd' would be best for them and for the planet, in the same fashion that we do the same for our animals.
So, no, I don't think ET would stop for a visit. Anyone who does, we should probably be worried about because they are either lacking in a sense of self-preservation, or coming to take our stuff.