alibayram's picture
Upload folder using huggingface_hub
90a8e36 verified
|
Raw History Blame Contribute Delete
786 Bytes
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - meta-llama/Meta-Llama-3-8B-Instruct
  - alibayram/Doktor-Llama-3-8b

Doktor-Llama-3-8b-slerp

Doktor-Llama-3-8b-slerp is a merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
      - model: meta-llama/Meta-Llama-3-8B-Instruct
        layer_range: [0, 32]
      - model: alibayram/Doktor-Llama-3-8b
        layer_range: [0, 32]
merge_method: slerp
base_model: meta-llama/Meta-Llama-3-8B-Instruct
parameters:
  t:
    - value: 0.5
dtype: bfloat16