How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="jiosephlee/intern-s1-mini-context-conditioned-molecule-transfer-v10-4-bioavailability-ma-best")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("jiosephlee/intern-s1-mini-context-conditioned-molecule-transfer-v10-4-bioavailability-ma-best")
model = AutoModelForCausalLM.from_pretrained("jiosephlee/intern-s1-mini-context-conditioned-molecule-transfer-v10-4-bioavailability-ma-best", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

Intern-S1-mini context-conditioned molecule transfer V10.4 — Oral bioavailability

Validation-selected best checkpoint from the V10.4 mixed-continuous Oral bioavailability context-conditioned molecule-transfer run.

Provenance

  • Base model: jiosephlee/Intern-S1-mini-lm
  • Base model revision: fcb667c380ae01f57693a45b4b5c2d331052a107
  • Training dataset: jiosephlee/context-conditioned-molecule-transfer-v10.4-bioavailability-ma-mixed-continuous-intern
  • Dataset revision: 8cfc12c9b374cc316d227d88319133ccdd2a0a67
  • Training schedule: 10 epochs with a 350-step cap, seed 42, soft-target loss
  • Training stopped after step 255 when validation performance had plateaued
  • Selection metric: validation knn_binary_macro_f1_at_5
  • Selected optimizer step: 200
  • Weights & Biases training run
  • Weights & Biases test evaluation

Metrics

Split Queries Macro-F1@5 NDCG@5 Precision@5 Spearman
Validation 262 0.6723 0.7222 0.7252 0.3573
Test 267 0.6814 0.7364 0.7393 0.3729

The repository contains the full Transformers checkpoint and tokenizer files. metric.json is the complete validation-selection record stored with the checkpoint.

Downloads last month
389
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jiosephlee/intern-s1-mini-context-conditioned-molecule-transfer-v10-4-bioavailability-ma-best

Finetuned
(30)
this model

Dataset used to train jiosephlee/intern-s1-mini-context-conditioned-molecule-transfer-v10-4-bioavailability-ma-best