How to use from
SGLang
Install from pip and serve model
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "dnaihao/qwen2.5-7b-tablegpt" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dnaihao/qwen2.5-7b-tablegpt",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker images
docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "dnaihao/qwen2.5-7b-tablegpt" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dnaihao/qwen2.5-7b-tablegpt",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Quick Links

Configuration Parsing Warning:Config file config.json cannot be fetched (too big)

Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

qwen2.5-7b-tablegpt

Replication of TableGPT, trained from Qwen2.5-7B-Instruct on the corresponding instruction-tuning corpus.

Released alongside the EACL 2026 Findings paper "What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects" (Deng et al., 2026) as an additional artefact extending the paper's experiments — the main 3 base × 4 training-data grid in the paper covers Mistral-v0.3, OLMo, and Phi-3-small at the 7B scale; this model adds another base-model variant trained on the same corpus.

Training

Base model Qwen/Qwen2.5-7B-Instruct
Training corpus tablegpt_large_train.json from dnaihao/Table-Instructs
Method Full SFT via LLaMA-Factory
Learning rate 5e-7

Full hyperparameter sweep, ablations, and per-benchmark numbers are reported in the paper.

Evaluation

This model was not part of the per-benchmark evaluation reported in the paper; it is released as an additional artefact for the community. See github.com/dnaihao/table-sft-eacl-2026 for the eval setup we used on the paper's main models — the same scripts can be adapted for this checkpoint.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("dnaihao/qwen2.5-7b-tablegpt")
model = AutoModelForCausalLM.from_pretrained(
    "dnaihao/qwen2.5-7b-tablegpt",
    torch_dtype="auto",
    device_map="auto",
)

License

This model inherits the license of its base model (Qwen/Qwen2.5-7B-Instruct: apache-2.0).

Citation

@inproceedings{deng-etal-2026-really,
    title = "What Really Matters for Table {LLM}s? A Meta-Evaluation of Model and Data Effects",
    author = "Deng, Naihao  and Zhang, Sheng  and Zhu, Henghui  and Chang, Shuaichen  and Zhang, Jiani  and Li, Alexander Hanbo  and Hang, Chung-Wei  and Kobayashi, Hideo  and Hu, Yiqun  and Ng, Patrick",
    booktitle = "Findings of the Association for Computational Linguistics: EACL 2026",
    year = "2026",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2026.findings-eacl.195/",
    doi = "10.18653/v1/2026.findings-eacl.195"
}
Downloads last month
6
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dnaihao/qwen2.5-7b-tablegpt

Base model

Qwen/Qwen2.5-7B
Finetuned
(3029)
this model

Dataset used to train dnaihao/qwen2.5-7b-tablegpt

Collection including dnaihao/qwen2.5-7b-tablegpt

Paper for dnaihao/qwen2.5-7b-tablegpt