GavinChan1105

/

Llama-3-8B-sft-lora

Like 0

• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "torch.FloatStorage",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.utils.tensor_fragment.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "deepspeed.utils.tensor_fragment.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "collections.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "torch.FloatStorage",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "collections.OrderedDict",
• "deepspeed.runtime.zero.config.ZeroStageEnum"

How to fix it?

• "deepspeed.utils.tensor_fragment.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "torch.FloatStorage",
• "collections.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "deepspeed.runtime.fp16.loss_scaler.LossScaler",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "collections.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "torch.Size",
• "__builtin__.set",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch.ByteStorage",
• "torch.BFloat16Storage"

How to fix it?