Offload what the card can hold, survive a dropped connection, and stop sending prompts the model cannot read

initial commit