cadazar's picture
modeling_han2han: the subword tables follow the model's device on load; continuous batching withheld (serve falls back to sequential generation)
8a947f2 verified