Instructions to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1")
model = AutoModelForCausalLM.from_pretrained("thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1

SGLang

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with Docker Model Runner:
```
docker model run hf.co/thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1
```

cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 / loss_curve.json

amirali1985

Upload folder using huggingface_hub

7f15173 verified 2 months ago

Raw

History Blame

29.3 kB

	[
	{
	"step": 100,
	"loss": 0.4139493179321289,
	"t": 3641018.57541876
	},
	{
	"step": 200,
	"loss": 0.3999126434326172,
	"t": 3641135.021174932
	},
	{
	"step": 300,
	"loss": 0.3939873886108398,
	"t": 3641246.227585853
	},
	{
	"step": 400,
	"loss": 0.39854782104492187,
	"t": 3641361.415985155
	},
	{
	"step": 500,
	"loss": 0.391977424621582,
	"t": 3641466.864527444
	},
	{
	"step": 600,
	"loss": 0.3971506500244141,
	"t": 3641574.277037461
	},
	{
	"step": 700,
	"loss": 0.41444538116455076,
	"t": 3641687.502280176
	},
	{
	"step": 800,
	"loss": 0.39362709045410155,
	"t": 3641793.203879862
	},
	{
	"step": 900,
	"loss": 0.42712318420410156,
	"t": 3641901.149821837
	},
	{
	"step": 1000,
	"loss": 0.4155216979980469,
	"t": 3642007.041745516
	},
	{
	"step": 1100,
	"loss": 0.4433013153076172,
	"t": 3642119.374340605
	},
	{
	"step": 1200,
	"loss": 0.45192947387695315,
	"t": 3642237.070725074
	},
	{
	"step": 1300,
	"loss": 0.46952545166015625,
	"t": 3642350.971402177
	},
	{
	"step": 1400,
	"loss": 0.48848690032958986,
	"t": 3642463.267357983
	},
	{
	"step": 1500,
	"loss": 0.46345497131347657,
	"t": 3642576.435861055
	},
	{
	"step": 1600,
	"loss": 0.46443763732910154,
	"t": 3642686.93773331
	},
	{
	"step": 1700,
	"loss": 0.4557395553588867,
	"t": 3642799.081780491
	},
	{
	"step": 1800,
	"loss": 0.4551454162597656,
	"t": 3642912.987856061
	},
	{
	"step": 1900,
	"loss": 0.47761753082275393,
	"t": 3643023.02471172
	},
	{
	"step": 2000,
	"loss": 0.48391231536865237,
	"t": 3643135.463391959
	},
	{
	"step": 2100,
	"loss": 0.4816680145263672,
	"t": 3643247.786421015
	},
	{
	"step": 2200,
	"loss": 0.48629653930664063,
	"t": 3643356.654927605
	},
	{
	"step": 2300,
	"loss": 0.48312870025634763,
	"t": 3643471.355283739
	},
	{
	"step": 2400,
	"loss": 0.4898276519775391,
	"t": 3643585.515741733
	},
	{
	"step": 2500,
	"loss": 0.4871330261230469,
	"t": 3643701.073512643
	},
	{
	"step": 2600,
	"loss": 0.49299495697021484,
	"t": 3643810.815200894
	},
	{
	"step": 2700,
	"loss": 0.48448883056640624,
	"t": 3643924.545900768
	},
	{
	"step": 2800,
	"loss": 0.5068112182617187,
	"t": 3644038.05696541
	},
	{
	"step": 2900,
	"loss": 0.4947779083251953,
	"t": 3644153.684531179
	},
	{
	"step": 3000,
	"loss": 0.5077388381958008,
	"t": 3644263.571026253
	},
	{
	"step": 3100,
	"loss": 0.5059045791625977,
	"t": 3644373.60188949
	},
	{
	"step": 3200,
	"loss": 0.5012545013427734,
	"t": 3644486.598964169
	},
	{
	"step": 3300,
	"loss": 0.4981550598144531,
	"t": 3644603.812939786
	},
	{
	"step": 3400,
	"loss": 0.5133832168579101,
	"t": 3644719.741665155
	},
	{
	"step": 3500,
	"loss": 0.49542972564697263,
	"t": 3644831.912562662
	},
	{
	"step": 3600,
	"loss": 0.523467903137207,
	"t": 3644935.650562517
	},
	{
	"step": 3700,
	"loss": 0.5192116928100586,
	"t": 3645046.364799219
	},
	{
	"step": 3800,
	"loss": 0.5325949096679687,
	"t": 3645159.158413639
	},
	{
	"step": 3900,
	"loss": 0.5066390609741211,
	"t": 3645266.567485167
	},
	{
	"step": 4000,
	"loss": 0.5159475708007812,
	"t": 3645379.292791741
	},
	{
	"step": 4100,
	"loss": 0.526229248046875,
	"t": 3645493.097967775
	},
	{
	"step": 4200,
	"loss": 0.5125686264038086,
	"t": 3645609.831962734
	},
	{
	"step": 4300,
	"loss": 0.5045449829101563,
	"t": 3645720.324605675
	},
	{
	"step": 4400,
	"loss": 0.5092525863647461,
	"t": 3645824.006482461
	},
	{
	"step": 4500,
	"loss": 0.5333821487426758,
	"t": 3645937.50236836
	},
	{
	"step": 4600,
	"loss": 0.5122455215454101,
	"t": 3646048.135087622
	},
	{
	"step": 4700,
	"loss": 0.5285649871826172,
	"t": 3646155.629935755
	},
	{
	"step": 4800,
	"loss": 0.5229104614257812,
	"t": 3646264.321104803
	},
	{
	"step": 4900,
	"loss": 0.528692741394043,
	"t": 3646373.449502525
	},
	{
	"step": 5000,
	"loss": 0.516887092590332,
	"t": 3646482.770485336
	},
	{
	"step": 5100,
	"loss": 0.5270553588867187,
	"t": 3646596.555603593
	},
	{
	"step": 5200,
	"loss": 0.5248835372924805,
	"t": 3646707.648140788
	},
	{
	"step": 5300,
	"loss": 0.5142387771606445,
	"t": 3646826.297558046
	},
	{
	"step": 5400,
	"loss": 0.5393224716186523,
	"t": 3646933.096561585
	},
	{
	"step": 5500,
	"loss": 0.5220268249511719,
	"t": 3647044.749238476
	},
	{
	"step": 5600,
	"loss": 0.5316015243530273,
	"t": 3647158.830489029
	},
	{
	"step": 5700,
	"loss": 0.5409671020507812,
	"t": 3647272.321098626
	},
	{
	"step": 5800,
	"loss": 0.5459469985961914,
	"t": 3647387.996287152
	},
	{
	"step": 5900,
	"loss": 0.5361923599243164,
	"t": 3647498.718742692
	},
	{
	"step": 6000,
	"loss": 0.5309235382080079,
	"t": 3647602.927491483
	},
	{
	"step": 6100,
	"loss": 0.52790283203125,
	"t": 3647715.316951262
	},
	{
	"step": 6200,
	"loss": 0.53140869140625,
	"t": 3647828.221225456
	},
	{
	"step": 6300,
	"loss": 0.5369846725463867,
	"t": 3647944.256575761
	},
	{
	"step": 6400,
	"loss": 0.5408168029785156,
	"t": 3648053.236855256
	},
	{
	"step": 6500,
	"loss": 0.5313311004638672,
	"t": 3648173.02092206
	},
	{
	"step": 6600,
	"loss": 0.5314226150512695,
	"t": 3648283.141438331
	},
	{
	"step": 6700,
	"loss": 0.5262820816040039,
	"t": 3648395.700024675
	},
	{
	"step": 6800,
	"loss": 0.5296177673339844,
	"t": 3648505.416643493
	},
	{
	"step": 6900,
	"loss": 0.5127635955810547,
	"t": 3648617.981766677
	},
	{
	"step": 7000,
	"loss": 0.5556907653808594,
	"t": 3648728.374212221
	},
	{
	"step": 7100,
	"loss": 0.5337480163574219,
	"t": 3648835.252616941
	},
	{
	"step": 7200,
	"loss": 0.5687614440917969,
	"t": 3648944.870873965
	},
	{
	"step": 7300,
	"loss": 0.5197809219360352,
	"t": 3649062.181623494
	},
	{
	"step": 7400,
	"loss": 0.5260874938964843,
	"t": 3649171.756246334
	},
	{
	"step": 7500,
	"loss": 0.5262385177612304,
	"t": 3649283.031840421
	},
	{
	"step": 7600,
	"loss": 0.5467538833618164,
	"t": 3649392.99016379
	},
	{
	"step": 7700,
	"loss": 0.5346250915527344,
	"t": 3649507.484318381
	},
	{
	"step": 7800,
	"loss": 0.5366121673583985,
	"t": 3649620.024784957
	},
	{
	"step": 7900,
	"loss": 0.5366439819335938,
	"t": 3649726.180476227
	},
	{
	"step": 8000,
	"loss": 0.5511039352416992,
	"t": 3649838.687432268
	},
	{
	"step": 8100,
	"loss": 0.5222838592529296,
	"t": 3649954.809473557
	},
	{
	"step": 8200,
	"loss": 0.561098289489746,
	"t": 3650066.621025067
	},
	{
	"step": 8300,
	"loss": 0.5409799957275391,
	"t": 3650173.585494994
	},
	{
	"step": 8400,
	"loss": 0.5295036697387695,
	"t": 3650280.944332709
	},
	{
	"step": 8500,
	"loss": 0.5407683181762696,
	"t": 3650393.604368828
	},
	{
	"step": 8600,
	"loss": 0.5316322708129883,
	"t": 3650506.759169409
	},
	{
	"step": 8700,
	"loss": 0.5211929321289063,
	"t": 3650625.030093116
	},
	{
	"step": 8800,
	"loss": 0.5287810897827149,
	"t": 3650736.128527726
	},
	{
	"step": 8900,
	"loss": 0.5374567413330078,
	"t": 3650844.708563217
	},
	{
	"step": 9000,
	"loss": 0.5427730560302735,
	"t": 3650946.728788651
	},
	{
	"step": 9100,
	"loss": 0.5350897979736328,
	"t": 3651060.281201252
	},
	{
	"step": 9200,
	"loss": 0.5145306777954102,
	"t": 3651173.840835806
	},
	{
	"step": 9300,
	"loss": 0.5156887435913086,
	"t": 3651293.334090679
	},
	{
	"step": 9400,
	"loss": 0.5518135070800781,
	"t": 3651413.728472992
	},
	{
	"step": 9500,
	"loss": 0.5189069747924805,
	"t": 3651524.486768146
	},
	{
	"step": 9600,
	"loss": 0.5369224166870117,
	"t": 3651630.50167203
	},
	{
	"step": 9700,
	"loss": 0.5375583267211914,
	"t": 3651739.497126956
	},
	{
	"step": 9800,
	"loss": 0.5243018341064453,
	"t": 3651860.624430688
	},
	{
	"step": 9900,
	"loss": 0.524787826538086,
	"t": 3651976.579250919
	},
	{
	"step": 10000,
	"loss": 0.5153005981445312,
	"t": 3652092.266425656
	},
	{
	"step": 10100,
	"loss": 0.5343574905395507,
	"t": 3652201.970561624
	},
	{
	"step": 10200,
	"loss": 0.5220724487304688,
	"t": 3652310.692182929
	},
	{
	"step": 10300,
	"loss": 0.5289925765991211,
	"t": 3652421.31188739
	},
	{
	"step": 10400,
	"loss": 0.5366571426391602,
	"t": 3652536.660688405
	},
	{
	"step": 10500,
	"loss": 0.5192051696777343,
	"t": 3652650.919153932
	},
	{
	"step": 10600,
	"loss": 0.5225317764282227,
	"t": 3652763.489007148
	},
	{
	"step": 10700,
	"loss": 0.5160102462768554,
	"t": 3652877.436243605
	},
	{
	"step": 10800,
	"loss": 0.5206741714477539,
	"t": 3652990.85098336
	},
	{
	"step": 10900,
	"loss": 0.5444929504394531,
	"t": 3653096.579405127
	},
	{
	"step": 11000,
	"loss": 0.5348928833007812,
	"t": 3653204.975521628
	},
	{
	"step": 11100,
	"loss": 0.5239725875854492,
	"t": 3653315.894424532
	},
	{
	"step": 11200,
	"loss": 0.5371329879760742,
	"t": 3653425.390932175
	},
	{
	"step": 11300,
	"loss": 0.5409563064575196,
	"t": 3653539.964124469
	},
	{
	"step": 11400,
	"loss": 0.5095580291748046,
	"t": 3653648.818726202
	},
	{
	"step": 11500,
	"loss": 0.5122764205932617,
	"t": 3653755.823176868
	},
	{
	"step": 11600,
	"loss": 0.49666217803955076,
	"t": 3653868.147428834
	},
	{
	"step": 11700,
	"loss": 0.5288271331787109,
	"t": 3653980.384794755
	},
	{
	"step": 11800,
	"loss": 0.5039447784423828,
	"t": 3654089.091825979
	},
	{
	"step": 11900,
	"loss": 0.5164062118530274,
	"t": 3654197.907934782
	},
	{
	"step": 12000,
	"loss": 0.5324673461914062,
	"t": 3654311.424691789
	},
	{
	"step": 12100,
	"loss": 0.49512645721435544,
	"t": 3654423.005352828
	},
	{
	"step": 12200,
	"loss": 0.5213711547851563,
	"t": 3654535.392487912
	},
	{
	"step": 12300,
	"loss": 0.5367744827270508,
	"t": 3654644.853826117
	},
	{
	"step": 12400,
	"loss": 0.5129185485839843,
	"t": 3654761.823595677
	},
	{
	"step": 12500,
	"loss": 0.5084508514404297,
	"t": 3654873.424812122
	},
	{
	"step": 12600,
	"loss": 0.509472770690918,
	"t": 3654987.17741833
	},
	{
	"step": 12700,
	"loss": 0.5060905838012695,
	"t": 3655100.116259694
	},
	{
	"step": 12800,
	"loss": 0.5352336502075196,
	"t": 3655206.133508993
	},
	{
	"step": 12900,
	"loss": 0.5166192626953126,
	"t": 3655315.679448853
	},
	{
	"step": 13000,
	"loss": 0.5015892791748047,
	"t": 3655425.26812083
	},
	{
	"step": 13100,
	"loss": 0.540953254699707,
	"t": 3655538.460754727
	},
	{
	"step": 13200,
	"loss": 0.5186798095703125,
	"t": 3655651.477773729
	},
	{
	"step": 13300,
	"loss": 0.5170705032348633,
	"t": 3655756.579864249
	},
	{
	"step": 13400,
	"loss": 0.5115008926391602,
	"t": 3655869.417298251
	},
	{
	"step": 13500,
	"loss": 0.4840225601196289,
	"t": 3655987.162967324
	},
	{
	"step": 13600,
	"loss": 0.49869815826416014,
	"t": 3656095.618403744
	},
	{
	"step": 13700,
	"loss": 0.5112997817993165,
	"t": 3656205.531543068
	},
	{
	"step": 13800,
	"loss": 0.49200103759765623,
	"t": 3656313.079311368
	},
	{
	"step": 13900,
	"loss": 0.5146323394775391,
	"t": 3656424.893104507
	},
	{
	"step": 14000,
	"loss": 0.5115189361572265,
	"t": 3656537.545203217
	},
	{
	"step": 14100,
	"loss": 0.5084482192993164,
	"t": 3656650.266186453
	},
	{
	"step": 14200,
	"loss": 0.5086818313598633,
	"t": 3656764.023919163
	},
	{
	"step": 14300,
	"loss": 0.5038053894042969,
	"t": 3656875.034495785
	},
	{
	"step": 14400,
	"loss": 0.4947283935546875,
	"t": 3656988.4046288
	},
	{
	"step": 14500,
	"loss": 0.5067621612548828,
	"t": 3657097.24390148
	},
	{
	"step": 14600,
	"loss": 0.5017283630371093,
	"t": 3657209.442835063
	},
	{
	"step": 14700,
	"loss": 0.4816585922241211,
	"t": 3657324.702737149
	},
	{
	"step": 14800,
	"loss": 0.5012429428100585,
	"t": 3657436.239145423
	},
	{
	"step": 14900,
	"loss": 0.5000526428222656,
	"t": 3657550.329903507
	},
	{
	"step": 15000,
	"loss": 0.5109487915039063,
	"t": 3657662.293267772
	},
	{
	"step": 15100,
	"loss": 0.4990576934814453,
	"t": 3657773.589491026
	},
	{
	"step": 15200,
	"loss": 0.4882029342651367,
	"t": 3657889.254049946
	},
	{
	"step": 15300,
	"loss": 0.49163375854492186,
	"t": 3657995.073913528
	},
	{
	"step": 15400,
	"loss": 0.48517963409423825,
	"t": 3658110.514158834
	},
	{
	"step": 15500,
	"loss": 0.4996240234375,
	"t": 3658221.187203123
	},
	{
	"step": 15600,
	"loss": 0.506878318786621,
	"t": 3658331.613756622
	},
	{
	"step": 15700,
	"loss": 0.5200733184814453,
	"t": 3658445.480592864
	},
	{
	"step": 15800,
	"loss": 0.49376884460449216,
	"t": 3658558.396919788
	},
	{
	"step": 15900,
	"loss": 0.4895199966430664,
	"t": 3658664.606477798
	},
	{
	"step": 16000,
	"loss": 0.5017339706420898,
	"t": 3658775.387544515
	},
	{
	"step": 16100,
	"loss": 0.497427864074707,
	"t": 3658880.518768164
	},
	{
	"step": 16200,
	"loss": 0.4897993850708008,
	"t": 3658990.704655931
	},
	{
	"step": 16300,
	"loss": 0.5080777740478516,
	"t": 3659095.416051223
	},
	{
	"step": 16400,
	"loss": 0.4836525344848633,
	"t": 3659203.793150059
	},
	{
	"step": 16500,
	"loss": 0.4874740982055664,
	"t": 3659314.126633387
	},
	{
	"step": 16600,
	"loss": 0.4806544876098633,
	"t": 3659427.882138383
	},
	{
	"step": 16700,
	"loss": 0.46979217529296874,
	"t": 3659537.585164378
	},
	{
	"step": 16800,
	"loss": 0.47236412048339843,
	"t": 3659648.749196494
	},
	{
	"step": 16900,
	"loss": 0.4744161605834961,
	"t": 3659756.393874882
	},
	{
	"step": 17000,
	"loss": 0.47793270111083985,
	"t": 3659869.193169528
	},
	{
	"step": 17100,
	"loss": 0.48293643951416015,
	"t": 3659980.683486698
	},
	{
	"step": 17200,
	"loss": 0.48235374450683594,
	"t": 3660090.398820049
	},
	{
	"step": 17300,
	"loss": 0.48811561584472657,
	"t": 3660207.995052698
	},
	{
	"step": 17400,
	"loss": 0.4859189605712891,
	"t": 3660323.82487412
	},
	{
	"step": 17500,
	"loss": 0.5003202819824218,
	"t": 3660434.687005326
	},
	{
	"step": 17600,
	"loss": 0.48786808013916017,
	"t": 3660549.061231283
	},
	{
	"step": 17700,
	"loss": 0.4793394088745117,
	"t": 3660667.683503333
	},
	{
	"step": 17800,
	"loss": 0.46893489837646485,
	"t": 3660783.804043752
	},
	{
	"step": 17900,
	"loss": 0.4705881881713867,
	"t": 3660896.139695309
	},
	{
	"step": 18000,
	"loss": 0.49460884094238283,
	"t": 3660999.785554408
	},
	{
	"step": 18100,
	"loss": 0.4943653869628906,
	"t": 3661118.96808763
	},
	{
	"step": 18200,
	"loss": 0.49038745880126955,
	"t": 3661226.288906362
	},
	{
	"step": 18300,
	"loss": 0.4898207473754883,
	"t": 3661335.91600741
	},
	{
	"step": 18400,
	"loss": 0.46185997009277346,
	"t": 3661443.607964539
	},
	{
	"step": 18500,
	"loss": 0.4916408920288086,
	"t": 3661555.983300019
	},
	{
	"step": 18600,
	"loss": 0.4948012542724609,
	"t": 3661667.106682747
	},
	{
	"step": 18700,
	"loss": 0.4832735443115234,
	"t": 3661776.457942773
	},
	{
	"step": 18800,
	"loss": 0.48468441009521485,
	"t": 3661887.357695922
	},
	{
	"step": 18900,
	"loss": 0.49177783966064453,
	"t": 3661996.213343999
	},
	{
	"step": 19000,
	"loss": 0.46545318603515623,
	"t": 3662107.539329463
	},
	{
	"step": 19100,
	"loss": 0.47124656677246096,
	"t": 3662226.186980901
	},
	{
	"step": 19200,
	"loss": 0.4834438323974609,
	"t": 3662336.860355365
	},
	{
	"step": 19300,
	"loss": 0.4717301559448242,
	"t": 3662444.045919552
	},
	{
	"step": 19400,
	"loss": 0.4692134475708008,
	"t": 3662558.650017113
	},
	{
	"step": 19500,
	"loss": 0.47008815765380857,
	"t": 3662663.725931961
	},
	{
	"step": 19600,
	"loss": 0.4640768051147461,
	"t": 3662773.058621805
	},
	{
	"step": 19700,
	"loss": 0.4562409591674805,
	"t": 3662888.580609747
	},
	{
	"step": 19800,
	"loss": 0.4819388580322266,
	"t": 3662997.676496278
	},
	{
	"step": 19900,
	"loss": 0.5024312591552734,
	"t": 3663104.181747879
	},
	{
	"step": 20000,
	"loss": 0.45944580078125,
	"t": 3663216.281129538
	},
	{
	"step": 20100,
	"loss": 0.4641510772705078,
	"t": 3663319.138550265
	},
	{
	"step": 20200,
	"loss": 0.48281253814697267,
	"t": 3663428.924262956
	},
	{
	"step": 20300,
	"loss": 0.47998580932617185,
	"t": 3663535.381328069
	},
	{
	"step": 20400,
	"loss": 0.4715848159790039,
	"t": 3663643.604037759
	},
	{
	"step": 20500,
	"loss": 0.4743906021118164,
	"t": 3663754.714025592
	},
	{
	"step": 20600,
	"loss": 0.5027505111694336,
	"t": 3663860.435049672
	},
	{
	"step": 20700,
	"loss": 0.4673704528808594,
	"t": 3663972.159750198
	},
	{
	"step": 20800,
	"loss": 0.4842581939697266,
	"t": 3664084.52268584
	},
	{
	"step": 20900,
	"loss": 0.47386459350585936,
	"t": 3664199.904398972
	},
	{
	"step": 21000,
	"loss": 0.4636588668823242,
	"t": 3664307.304038708
	},
	{
	"step": 21100,
	"loss": 0.4759894561767578,
	"t": 3664416.246315667
	},
	{
	"step": 21200,
	"loss": 0.4631285095214844,
	"t": 3664529.462738474
	},
	{
	"step": 21300,
	"loss": 0.4547287368774414,
	"t": 3664649.160578106
	},
	{
	"step": 21400,
	"loss": 0.46258445739746096,
	"t": 3664776.85958668
	},
	{
	"step": 21500,
	"loss": 0.46528297424316406,
	"t": 3664893.292319818
	},
	{
	"step": 21600,
	"loss": 0.4648211669921875,
	"t": 3665014.551180273
	},
	{
	"step": 21700,
	"loss": 0.4712186813354492,
	"t": 3665130.806368302
	},
	{
	"step": 21800,
	"loss": 0.48135120391845704,
	"t": 3665241.728806095
	},
	{
	"step": 21900,
	"loss": 0.49007961273193357,
	"t": 3665354.306120821
	},
	{
	"step": 22000,
	"loss": 0.474335823059082,
	"t": 3665465.0034661
	},
	{
	"step": 22100,
	"loss": 0.43227222442626956,
	"t": 3665586.695641281
	},
	{
	"step": 22200,
	"loss": 0.48025463104248045,
	"t": 3665700.922740384
	},
	{
	"step": 22300,
	"loss": 0.4803887176513672,
	"t": 3665814.028676135
	},
	{
	"step": 22400,
	"loss": 0.48598995208740237,
	"t": 3665931.67414953
	},
	{
	"step": 22500,
	"loss": 0.47501617431640625,
	"t": 3666044.04916126
	},
	{
	"step": 22600,
	"loss": 0.4559401702880859,
	"t": 3666162.163014699
	},
	{
	"step": 22700,
	"loss": 0.4727600479125977,
	"t": 3666277.803078778
	},
	{
	"step": 22800,
	"loss": 0.4790314102172852,
	"t": 3666389.926786907
	},
	{
	"step": 22900,
	"loss": 0.48978160858154296,
	"t": 3666501.703092732
	},
	{
	"step": 23000,
	"loss": 0.48619808197021486,
	"t": 3666613.85039699
	},
	{
	"step": 23100,
	"loss": 0.47821170806884766,
	"t": 3666720.839411546
	},
	{
	"step": 23200,
	"loss": 0.4578924560546875,
	"t": 3666842.923814141
	},
	{
	"step": 23300,
	"loss": 0.49057342529296877,
	"t": 3666949.585450678
	},
	{
	"step": 23400,
	"loss": 0.4597020721435547,
	"t": 3667064.759788997
	},
	{
	"step": 23500,
	"loss": 0.46680320739746095,
	"t": 3667179.39568796
	},
	{
	"step": 23600,
	"loss": 0.4613536834716797,
	"t": 3667292.734816478
	},
	{
	"step": 23700,
	"loss": 0.47014427185058594,
	"t": 3667406.49902059
	},
	{
	"step": 23800,
	"loss": 0.4574002838134766,
	"t": 3667515.928134179
	},
	{
	"step": 23900,
	"loss": 0.46272739410400393,
	"t": 3667630.528119746
	},
	{
	"step": 24000,
	"loss": 0.4752834320068359,
	"t": 3667744.13985586
	},
	{
	"step": 24100,
	"loss": 0.4621294021606445,
	"t": 3667858.790752466
	},
	{
	"step": 24200,
	"loss": 0.48526031494140626,
	"t": 3667970.509786274
	},
	{
	"step": 24300,
	"loss": 0.4535098648071289,
	"t": 3668080.129997399
	},
	{
	"step": 24400,
	"loss": 0.45493019104003907,
	"t": 3668196.005940356
	},
	{
	"step": 24500,
	"loss": 0.4015729522705078,
	"t": 3668305.09347665
	},
	{
	"step": 24600,
	"loss": 0.34853343963623046,
	"t": 3668420.205056437
	},
	{
	"step": 24700,
	"loss": 0.33041091918945314,
	"t": 3668524.275854896
	},
	{
	"step": 24800,
	"loss": 0.34184898376464845,
	"t": 3668639.165122686
	},
	{
	"step": 24900,
	"loss": 0.33129405975341797,
	"t": 3668753.403537156
	},
	{
	"step": 25000,
	"loss": 0.34359222412109375,
	"t": 3668864.322063501
	},
	{
	"step": 25100,
	"loss": 0.32129150390625,
	"t": 3668978.204876526
	},
	{
	"step": 25200,
	"loss": 0.32565616607666015,
	"t": 3669088.267408365
	},
	{
	"step": 25300,
	"loss": 0.33178607940673827,
	"t": 3669205.029005354
	},
	{
	"step": 25400,
	"loss": 0.3174081039428711,
	"t": 3669324.868649554
	},
	{
	"step": 25500,
	"loss": 0.33235836029052734,
	"t": 3669439.525376524
	},
	{
	"step": 25600,
	"loss": 0.32161895751953123,
	"t": 3669552.55996468
	},
	{
	"step": 25700,
	"loss": 0.32654666900634766,
	"t": 3669661.947192856
	},
	{
	"step": 25800,
	"loss": 0.3252897262573242,
	"t": 3669779.911550409
	},
	{
	"step": 25900,
	"loss": 0.3319485092163086,
	"t": 3669884.720063959
	},
	{
	"step": 26000,
	"loss": 0.33971240997314456,
	"t": 3670001.558715227
	},
	{
	"step": 26100,
	"loss": 0.3300847625732422,
	"t": 3670117.569555702
	},
	{
	"step": 26200,
	"loss": 0.3221352005004883,
	"t": 3670226.651930286
	},
	{
	"step": 26300,
	"loss": 0.32499649047851564,
	"t": 3670333.9200696
	},
	{
	"step": 26400,
	"loss": 0.3315388488769531,
	"t": 3670448.097273033
	},
	{
	"step": 26500,
	"loss": 0.34465965270996096,
	"t": 3670563.490827931
	},
	{
	"step": 26600,
	"loss": 0.3259738540649414,
	"t": 3670675.257319522
	},
	{
	"step": 26700,
	"loss": 0.3259927749633789,
	"t": 3670784.729265793
	},
	{
	"step": 26800,
	"loss": 0.3188020706176758,
	"t": 3670893.768154464
	},
	{
	"step": 26900,
	"loss": 0.33446582794189456,
	"t": 3671006.30504332
	},
	{
	"step": 27000,
	"loss": 0.326951904296875,
	"t": 3671123.375953608
	},
	{
	"step": 27100,
	"loss": 0.33547374725341794,
	"t": 3671232.461234162
	},
	{
	"step": 27200,
	"loss": 0.33774211883544925,
	"t": 3671343.898072284
	},
	{
	"step": 27300,
	"loss": 0.32772579193115237,
	"t": 3671451.240884195
	},
	{
	"step": 27400,
	"loss": 0.31342626571655274,
	"t": 3671569.887797525
	},
	{
	"step": 27500,
	"loss": 0.35068641662597655,
	"t": 3671681.439511136
	},
	{
	"step": 27600,
	"loss": 0.320196647644043,
	"t": 3671792.672417693
	},
	{
	"step": 27700,
	"loss": 0.33424442291259765,
	"t": 3671900.098098845
	},
	{
	"step": 27800,
	"loss": 0.3341121292114258,
	"t": 3672009.27935655
	},
	{
	"step": 27900,
	"loss": 0.342039794921875,
	"t": 3672115.168773922
	},
	{
	"step": 28000,
	"loss": 0.34753803253173826,
	"t": 3672232.641758842
	},
	{
	"step": 28100,
	"loss": 0.3392208480834961,
	"t": 3672342.955755318
	},
	{
	"step": 28200,
	"loss": 0.326173210144043,
	"t": 3672455.172982076
	},
	{
	"step": 28300,
	"loss": 0.3348968505859375,
	"t": 3672569.577669203
	},
	{
	"step": 28400,
	"loss": 0.33625579833984376,
	"t": 3672679.100850286
	},
	{
	"step": 28500,
	"loss": 0.34543479919433595,
	"t": 3672786.756246903
	},
	{
	"step": 28600,
	"loss": 0.3286529541015625,
	"t": 3672896.393125678
	},
	{
	"step": 28700,
	"loss": 0.3243720626831055,
	"t": 3673005.958535404
	},
	{
	"step": 28800,
	"loss": 0.32381084442138675,
	"t": 3673118.882609985
	},
	{
	"step": 28900,
	"loss": 0.31717554092407224,
	"t": 3673237.332415008
	},
	{
	"step": 29000,
	"loss": 0.3252934646606445,
	"t": 3673349.80585557
	},
	{
	"step": 29100,
	"loss": 0.33298519134521487,
	"t": 3673460.30230414
	},
	{
	"step": 29200,
	"loss": 0.3299081802368164,
	"t": 3673572.74255986
	},
	{
	"step": 29300,
	"loss": 0.3232647705078125,
	"t": 3673686.389943415
	},
	{
	"step": 29400,
	"loss": 0.3403680419921875,
	"t": 3673794.409361841
	},
	{
	"step": 29500,
	"loss": 0.33291160583496093,
	"t": 3673908.655544071
	},
	{
	"step": 29600,
	"loss": 0.31180213928222655,
	"t": 3674021.861270231
	},
	{
	"step": 29700,
	"loss": 0.3155292320251465,
	"t": 3674134.179355298
	},
	{
	"step": 29800,
	"loss": 0.32925010681152345,
	"t": 3674255.376012231
	},
	{
	"step": 29900,
	"loss": 0.3215509796142578,
	"t": 3674370.070608391
	},
	{
	"step": 30000,
	"loss": 0.32963455200195313,
	"t": 3674487.956971653
	},
	{
	"step": 30100,
	"loss": 0.33893863677978514,
	"t": 3674600.770897769
	},
	{
	"step": 30200,
	"loss": 0.3172222900390625,
	"t": 3674715.732264223
	},
	{
	"step": 30300,
	"loss": 0.33034099578857423,
	"t": 3674828.894091753
	},
	{
	"step": 30400,
	"loss": 0.33480167388916016,
	"t": 3674938.148438141
	},
	{
	"step": 30500,
	"loss": 0.32690311431884767,
	"t": 3675047.895317932
	},
	{
	"step": 30600,
	"loss": 0.33848907470703127,
	"t": 3675157.365726532
	},
	{
	"step": 30700,
	"loss": 0.3433504104614258,
	"t": 3675266.613311686
	},
	{
	"step": 30800,
	"loss": 0.34671615600585937,
	"t": 3675382.629264221
	},
	{
	"step": 30900,
	"loss": 0.3286149597167969,
	"t": 3675498.298285884
	},
	{
	"step": 31000,
	"loss": 0.31849456787109376,
	"t": 3675610.766314725
	},
	{
	"step": 31100,
	"loss": 0.3279303741455078,
	"t": 3675721.383696292
	},
	{
	"step": 31200,
	"loss": 0.33260307312011717,
	"t": 3675826.557171534
	},
	{
	"step": 31300,
	"loss": 0.33116119384765624,
	"t": 3675941.748111794
	},
	{
	"step": 31400,
	"loss": 0.32135829925537107,
	"t": 3676051.941160977
	},
	{
	"step": 31500,
	"loss": 0.31575860977172854,
	"t": 3676167.266227446
	},
	{
	"step": 31600,
	"loss": 0.3259143829345703,
	"t": 3676280.495872681
	},
	{
	"step": 31700,
	"loss": 0.33826393127441406,
	"t": 3676391.608402051
	},
	{
	"step": 31800,
	"loss": 0.3293943405151367,
	"t": 3676498.915456699
	},
	{
	"step": 31900,
	"loss": 0.3397318267822266,
	"t": 3676608.215496535
	},
	{
	"step": 32000,
	"loss": 0.3285797500610352,
	"t": 3676724.096930323
	},
	{
	"step": 32100,
	"loss": 0.32765430450439453,
	"t": 3676836.724767369
	},
	{
	"step": 32200,
	"loss": 0.33491619110107423,
	"t": 3676950.46426603
	},
	{
	"step": 32300,
	"loss": 0.32695606231689456,
	"t": 3677059.438128276
	},
	{
	"step": 32400,
	"loss": 0.3413416290283203,
	"t": 3677166.970771298
	},
	{
	"step": 32500,
	"loss": 0.3288777923583984,
	"t": 3677279.945242716
	},
	{
	"step": 32600,
	"loss": 0.31414003372192384,
	"t": 3677394.794885949
	},
	{
	"step": 32700,
	"loss": 0.31714874267578125,
	"t": 3677506.109387148
	},
	{
	"step": 32800,
	"loss": 0.3147380256652832,
	"t": 3677628.017573852
	},
	{
	"step": 32900,
	"loss": 0.3317835235595703,
	"t": 3677730.045122623
	},
	{
	"step": 33000,
	"loss": 0.33235992431640626,
	"t": 3677838.152269754
	},
	{
	"step": 33100,
	"loss": 0.3376754379272461,
	"t": 3677950.113078472
	},
	{
	"step": 33200,
	"loss": 0.3354543685913086,
	"t": 3678058.018043926
	},
	{
	"step": 33300,
	"loss": 0.32485801696777344,
	"t": 3678167.281081834
	},
	{
	"step": 33400,
	"loss": 0.3328155517578125,
	"t": 3678275.412638694
	},
	{
	"step": 33500,
	"loss": 0.30949831008911133,
	"t": 3678386.83012429
	},
	{
	"step": 33600,
	"loss": 0.33079010009765625,
	"t": 3678492.703436282
	},
	{
	"step": 33700,
	"loss": 0.316292724609375,
	"t": 3678609.408717798
	}
	]