Update README.md

README.md

@@ -29,6 +29,29 @@ Instruction tuned FlanT5-XXL on Legal Clauses data generated via ChatGPT. The mo
 # Uses
 
 
+</details>
+
+### Prompt
+
+
+<details>
+<summary> Click to expand </summary>
+
+```python
+# pip install accelerate peft bitsandbytes
+import torch
+from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
+from peft import PeftModel,PeftConfig
+peft_model_id = 'NebulaSense/ContractAssist'
+
+peft_config = PeftConfig.from_pretrained(peft_model_id) 
+
+model =  AutoModelForSeq2SeqLM.from_pretrained(peft_config.base_model_name_or_path, device_map="auto",load_in_8bit=True)
+tokenizer = AutoTokenizer.from_pretrained(peft_config.base_model_name_or_path)
+model = PeftModel.from_pretrained(model, peft_model_id)
+model.eval()
+```
+
 </details>
 
 ### Running the model on a GPU in 8bit