Looking up at the stars, I know quite well
That, for all they care, I can go to hell,
But on earth indifference is the least
We have to dread from man or beast.
How should we like it were stars to burn
With a passion for us we could not return?
If equal affection cannot be,
Let the more loving one be me.
Admirer as I think I am

 Directly, Auden is making a rather wry point that we’d be dead if stars “burned” as strongly as we care for the stars. 
 Of course, this isn’t really a poem about stars but rather about relationships. Auden is describing an unrequited love here – and he does it in a sad, rationalizing way.
The More Loving One