runtime error

Exit code: 1. Reason: of-00002.safetensors: 0%| | 0.00/3.08G [00:00<?, ?B/s] model-00002-of-00002.safetensors: 0%| | 0.00/3.08G [00:01<?, ?B/s] model-00002-of-00002.safetensors: 0%| | 0.00/3.08G [00:02<?, ?B/s] model-00002-of-00002.safetensors: 0%| | 0.00/3.08G [00:05<?, ?B/s] model-00002-of-00002.safetensors: 100%|██████████| 3.08G/3.08G [00:06<00:00, 495MB/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00, 24456.58it/s] generation_config.json: 0%| | 0.00/213 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 213/213 [00:00<00:00, 1.04MB/s] Traceback (most recent call last): File "/app/app.py", line 10, in <module> model = AutoModelForCausalLM.from_pretrained( model_id, ...<2 lines>... trust_remote_code=True ) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 604, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 277, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 5140, in from_pretrained dispatch_model(model, **device_map_kwargs) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/accelerate/big_modeling.py", line 514, in dispatch_model raise ValueError( "You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead." ) ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: