Looking up at the stars, I know quite well
That, for all they care, I can go to hell,
But on earth indifference is the least
We have to dread from man or beast.
How should we like it were stars to burn
The speaker believes the personified stars to be indifferent to the human condition–aloft and aloof. 
 
 The unfeeling stars are securely settled up in Heaven which is quite far away from Hell. They don’t even long to have him at their side; they’ll be unperturbed if he ends up in a completely different world.
The More Loving One