Round the cape of a sudden came the sea,
And the sun looked over the mountain's rim:
And straight was a path of gold for him,
And the need of a world of men for me.
The two worlds merge. The speaker who had an adventurous night-time meeting with a lover in the prequal poem “Meeting at Night”, needs to earn a living. 
 The word “need” is ambiguous. It is not clear if it is a practical requirement for the speaker to return to the “world of men” — this is an era of clear division of gender roles. Or is this “need” an equally urgent desire for a practical challenge, where the romance of a tryst with a woman only satisfies part of his being? This speaker could be keen to return to real life.  He seems happy to do so, implying that his night-time adventure sustains him. 
 So the reader is left with teasing glimpses of a larger story which will never been completed.
Parting at Morning