Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,18 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+fold_0/model.bias_scaled.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet_nobias.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.bias_scaled.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet_nobias.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.bias_scaled.fold_2.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet.fold_2.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet_nobias.fold_2.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.bias_scaled.fold_3.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet.fold_3.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet_nobias.fold_3.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.bias_scaled.fold_4.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet.fold_4.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet_nobias.fold_4.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,120 @@
+---
+license: mit
+library_name: chrombpnet
+tags:
+  - encode
+  - chrombpnet
+  - chromatin-accessibility
+  - ATAC
+  - lung
+  - hg38
+---
+# ENCODE ChromBPNet Atlas
+As part of the ENCODE 4 Project, we trained ChromBPNet models on 1,512 ENCODE DNAse-seq and ATAC-seq across 408 biosamples. Here, we provide all models for open-source use.
+
+For more information about the models, see:
+- Main ENCODE 4 Paper
+- [A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays](https://doi.org/10.5281/zenodo.17123347) (Deshpande et al., Zenodo 2025)
+- [ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants](https://doi.org/10.1101/2024.12.25.630221) (Pampari et al., bioRxiv 2024)
+
+## ChromBPNet model: ATAC in lower lobe of left lung (ENCSR555ZDH)
+- Model: ChromBPNet
+- Assay: ATAC-seq
+- Experiment: [ENCSR555ZDH](https://www.encodeproject.org/experiments/ENCSR555ZDH/)
+- Model annotation: [ENCSR782KOZ](https://www.encodeproject.org/annotations/ENCSR782KOZ/)
+- Biosample: lower lobe of left lung (Full name: Homo sapiens lower lobe of left lung tissue male adult (60 years))
+- Cell slim(s): None
+- Organ slim(s): lung
+- Developmental slim(s): endoderm
+- System slim(s): respiratory-system
+- Assembly: hg38
+
+## Directory structure
+- `fold_0`: Model of 5-fold cross-validation: Fold 0
+    - `model.chrombpnet.fold_0.encid.h5`: full chrombpnet model that combines both bias and corrected model in .h5 format
+    - `model.chrombpnet_nobias.fold_0.encid.h5`: bias-corrected accessibility model in .h5 format (Use for all biological discovery)
+    - `model.bias_scaled.fold_0.encid.h5`: bias model in .h5 format
+    - `model.chrombpnet.fold_0.encid.tar`: full chrombpnet model that combines both bias and  corrected model in SavedModel format. After being untarred, it results in a directory named "chrombpnet".
+    - `model.chrombpnet_nobias.fold_0.encid.tar`: bias-corrected accessibility model in SavedModel format (Use for all biological discovery). After being untarred, it results in a directory named "chrombpnet_wo_bias".
+    - `model.bias_scaled.fold_0.encid.tar`: bias model in SavedModel format. After being untarred, it results in a directory named "bias_model_scaled".
+    - `logs.models.fold_0.encid`: folder containing log files for training models
+- `fold_1`: Model of 5-fold coss-validation: Fold 1
+- `fold_2`: Model of 5-fold cross-validation: Fold 2
+- `fold_3`: Model of 5-fold cross-validation: Fold 3
+- `fold_4`: Model of 5-fold cross-validation: Fold 4
+
+# Instructions
+## 1. Pseudocode for loading models in .h5 format 
+
+(1) Use the code in python after appropriately defining `model_in_h5_format` and `inputs`. \
+(2) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the 
+number of tested sequences, 2114 is the input sequence length and 4 corresponds to [A,C,G,T].
+
+```python
+import tensorflow as tf
+from tensorflow.keras.utils import get_custom_objects
+from tensorflow.keras.models import load_model
+
+custom_objects={"tf": tf}
+get_custom_objects().update(custom_objects)
+
+model=load_model(model_in_h5_format,compile=False)
+outputs = model(inputs)
+```
+
+The list `outputs` consists of two elements. The first element has a shape of (N, 1000) and
+contains logit predictions for a 1000-base-pair output. The second element, with a shape of
+(N, 1), contains logcount predictions. To transform these predictions into per-base signals, 
+follow the provided pseudo code lines below.
+
+```python
+import numpy as np
+
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs[0]) * (np.exp(outputs[1])-1)
+```
+
+## 2. Pseudocode for loading models in .tar format
+
+(1) First untar the directory as follows `tar -xvf model.tar`. \
+(2) Use the code below in python after appropriately defining `model_dir_untared` and `inputs`. \
+(3) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the number
+of tested sequences, 2114 is the input sequence length and 4 corresponds to ACGT.
+
+Reference: https://www.tensorflow.org/api_docs/python/tf/saved_model/load
+
+```python
+import tensorflow as tf
+
+model = tf.saved_model.load('model_dir_untared')
+outputs = model.signatures['serving_default'](**{'sequence':inputs.astype('float32')})
+```
+
+The variable `outputs` represents a dictionary containing two key-value pairs. The first key
+is `logits_profile_predictions`, holding a value with a shape of (N, 1000). This value corresponds
+to logit predictions for a 1000-base-pair output. The second key, named `logcount_predictions``, 
+is associated with a value of shape (N, 1), representing logcount predictions. To transform these
+predictions into per-base signals, utilize the provided pseudo code lines mentioned below.
+
+```python
+import numpy as np
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs["logits_profile_predictions"]) * (np.exp(outputs["logcount_predictions"])-1)
+```
+
+## Docker image to load and use the models
+- https://hub.docker.com/r/kundajelab/chrombpnet-atlas/ (tag:v1)
+
+## Code for ChromBPNet
+- https://github.com/kundajelab/chrombpnet/
+
+# License & citation
+External data users may freely download, analyze and publish results based on any ENCODE data without restrictions.
+
+Released under the [ENCODE data-use policy](https://www.encodeproject.org/about/data-use-policy/). Please cite the ENCODE Project Consortium and the model software: [ChromBPNet](https://github.com/kundajelab/chrombpnet) (Pampari et al., bioRxiv 2024).

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.args.json

@@ -0,0 +1,23 @@
+{
+    "genome": "/scratch/groups/akundaje/anusri/chromatin_atlas/reference/hg38.genome.fa",
+    "bigwig": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//preprocessing/bigWigs/ENCSR555ZDH.bigWig",
+    "peaks": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15//filtered.peaks.bed",
+    "nonpeaks": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15//filtered.nonpeaks.bed",
+    "output_prefix": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15//chrombpnet",
+    "chr_fold_path": "/scratch/groups/akundaje/anusri/chromatin_atlas/splits/fold_0.json",
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "epochs": 50,
+    "early_stop": 5,
+    "batch_size": 64,
+    "learning_rate": 0.001,
+    "params": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15//chrombpnet_model_params.tsv",
+    "seed": 1234,
+    "architecture_from_file": "/home/users/anusri/chromatin-atlas-anvil/sherlock/chrombpnet/src/training/models/chrombpnet_with_bias_model.py"
+}

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_0/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	56.0
+counts_sum_max_thresh	11777.66
+trainings_pts_post_thresh	232958

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_0/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	79.0
+filters	512
+n_dil_layers	8
+bias_model_path	/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/scratch/groups/akundaje/anusri/chromatin_atlas/splits/fold_0.json
+negative_sampling_ratio	0.1

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15/chrombpnet_wo_bias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_0/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR555ZDH/logfile.modelling.fold_0.ENCSR555ZDH.epoch_loss.csv

@@ -0,0 +1,22 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,0.661749005317688,1033.4820556640625,1085.76171875,0.5072216987609863,965.0763549804688,1005.1467895507812
+1,0.5308705568313599,937.3510131835938,979.2894287109375,0.48859134316444397,936.5579833984375,975.156982421875
+2,0.48812201619148254,908.3359375,946.8969116210938,0.457459419965744,925.7861938476562,961.9253540039062
+3,0.46002697944641113,888.1445922851562,924.4862060546875,0.4436764419078827,921.7623901367188,956.8135375976562
+4,0.4346415400505066,874.4525756835938,908.7875366210938,0.4494961202144623,915.2472534179688,950.757080078125
+5,0.42120909690856934,863.6318969726562,896.9083862304688,0.4198385775089264,911.0581665039062,944.2249145507812
+6,0.40543389320373535,855.5582275390625,887.5873413085938,0.4152581989765167,912.0525512695312,944.8577880859375
+7,0.39272379875183105,849.0112915039062,880.0359497070312,0.4211795926094055,909.5051879882812,942.7779541015625
+8,0.37925294041633606,844.3141479492188,874.2742919921875,0.40750133991241455,913.7691040039062,945.9619140625
+9,0.3685862123966217,840.1288452148438,869.2483520507812,0.4138126075267792,911.5048828125,944.1962890625
+10,0.3576819598674774,836.0536499023438,864.3115844726562,0.4005168676376343,913.0393676757812,944.6796875
+11,0.31234508752822876,813.0114135742188,837.6868896484375,0.4187460243701935,898.615478515625,931.6964721679688
+12,0.291025310754776,802.25927734375,825.2512817382812,0.4041016399860382,900.1155395507812,932.0400390625
+13,0.2729349732398987,796.0299682617188,817.5905151367188,0.43400898575782776,900.4888305664062,934.775634765625
+14,0.26077648997306824,791.6664428710938,812.2683715820312,0.4111849367618561,900.9331665039062,933.4176635742188
+15,0.23015284538269043,781.9424438476562,800.1229248046875,0.415922611951828,898.5279541015625,931.3857421875
+16,0.21712078154087067,777.0108642578125,794.1624145507812,0.41656145453453064,900.0343627929688,932.9428100585938
+17,0.20780566334724426,773.8815307617188,790.2984008789062,0.4212171137332916,902.3076782226562,935.583740234375
+18,0.19739431142807007,772.0013427734375,787.5950317382812,0.42550674080848694,903.5161743164062,937.130859375
+19,0.18329356610774994,767.789794921875,782.2723388671875,0.42789819836616516,903.9603271484375,937.7644653320312
+20,0.18088029325008392,766.4927368164062,780.78076171875,0.43316900730133057,904.432861328125,938.6535034179688

fold_0/model.bias_scaled.fold_0.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ddde6a57ad08bb129a9667eae89c044bbabf0693d44ba9c0e3041b78cb37601
+size 2688440

fold_0/model.bias_scaled.fold_0.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63117a2eb534ffbbab49a8851db5a3a389848ec95e238cdeb7703f716320b0e2
+size 32967

fold_0/model.bias_scaled.fold_0.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b609c6240b6cac9cb3c4fcd8327e7e02089b8294af626a08962d6180f9f1d363
+size 269887

fold_0/model.bias_scaled.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dcd2c2f7405068bb22460cde6cdabe8e26710df2b06ac3c5131dcf008a0ab727
+size 882550

fold_0/model.chrombpnet.fold_0.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd95bd888f1a430a939bbeb565355a8b1b70d565d9d1b8d8327c248f47364e2e
+size 26448016

fold_0/model.chrombpnet.fold_0.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79d33127f8f1fe94dcee61631b130125d8c491e4a94cc42fcfd126eb4df1208b
+size 136306

fold_0/model.chrombpnet.fold_0.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3dbc0b539d0f8f8efb05ac13c67fd01796f4f27e0580706865c52db5d37b3fb9
+size 967141

fold_0/model.chrombpnet.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af22083607f8b5d93927b8054ed917b19ab17660933b9b872df190ff3b4c81af
+size 26415907

fold_0/model.chrombpnet_nobias.fold_0.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8cd858fb2f4669244868b3c56012f08870b60dcac585acd7184b57baecfae3ec
+size 25583536

fold_0/model.chrombpnet_nobias.fold_0.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_0/model.chrombpnet_nobias.fold_0.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_0/model.chrombpnet_nobias.fold_0.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59b8c078b2f00988b07416adc52a8c2de151e737de0509ba67bd444adb3cefe3
+size 25531097

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.args.json

@@ -0,0 +1,23 @@
+{
+    "genome": "/scratch/groups/akundaje/anusri/chromatin_atlas/reference/hg38.genome.fa",
+    "bigwig": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//preprocessing/bigWigs/ENCSR555ZDH.bigWig",
+    "peaks": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15_fold_1//filtered.peaks.bed",
+    "nonpeaks": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15_fold_1//filtered.nonpeaks.bed",
+    "output_prefix": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15_fold_1//chrombpnet",
+    "chr_fold_path": "/scratch/groups/akundaje/anusri/chromatin_atlas/splits/fold_1.json",
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "epochs": 50,
+    "early_stop": 5,
+    "batch_size": 64,
+    "learning_rate": 0.001,
+    "params": "/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15_fold_1//chrombpnet_model_params.tsv",
+    "seed": 1234,
+    "architecture_from_file": "/home/users/anusri/chromatin-atlas-anvil/sherlock/chrombpnet/src/training/models/chrombpnet_with_bias_model.py"
+}

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15_fold_1/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_1/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	57.0
+counts_sum_max_thresh	11681.08
+trainings_pts_post_thresh	238850

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15_fold_1/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_1/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	79.0
+filters	512
+n_dil_layers	8
+bias_model_path	/scratch/groups/akundaje/anusri/chromatin_atlas/ATAC/ENCSR555ZDH//chrombpnet_model_feb15_fold_1/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/scratch/groups/akundaje/anusri/chromatin_atlas/splits/fold_1.json
+negative_sampling_ratio	0.1

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/chrombpnet_model_feb15_fold_1/chrombpnet_wo_bias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR555ZDH/fold_1/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR555ZDH/logfile.modelling.fold_1.ENCSR555ZDH.epoch_loss.csv

@@ -0,0 +1,23 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.3540501594543457,958.6524047851562,1065.6220703125,0.5353314280509949,1017.1806640625,1059.47216796875
+1,0.5174083113670349,871.05712890625,911.932861328125,0.6151682138442993,978.920166015625,1027.5181884765625
+2,0.4696837365627289,843.4293823242188,880.5347900390625,0.45692792534828186,974.9165649414062,1011.0138549804688
+3,0.4354616701602936,826.751953125,861.1527099609375,0.4354149103164673,961.6296997070312,996.0271606445312
+4,0.4114015996456146,815.2852783203125,847.78515625,0.425031840801239,955.7752685546875,989.3526611328125
+5,0.3911776542663574,806.9175415039062,837.820068359375,0.4407230019569397,954.18115234375,988.998291015625
+6,0.3729826807975769,800.668701171875,830.1334838867188,0.42848753929138184,950.8999633789062,984.7509765625
+7,0.3616821765899658,796.488037109375,825.0625610351562,0.419350266456604,953.3141479492188,986.4429321289062
+8,0.3501471281051636,792.4014282226562,820.06494140625,0.49967360496520996,950.2503051757812,989.723876953125
+9,0.3391254246234894,789.7511596679688,816.5425415039062,0.4080493748188019,949.6245727539062,981.8603515625
+10,0.32688501477241516,787.0672607421875,812.8916015625,0.41802576184272766,950.7107543945312,983.7344970703125
+11,0.3167129456996918,784.4248046875,809.4454345703125,0.412889689207077,948.544189453125,981.1621704101562
+12,0.3089589476585388,782.9966430664062,807.4031372070312,0.43091994524002075,949.30859375,983.3515625
+13,0.3006969094276428,780.5487670898438,804.3035888671875,0.4293467700481415,952.5164794921875,986.4351806640625
+14,0.28848978877067566,779.1517333984375,801.9442749023438,0.42871418595314026,954.3925170898438,988.2606811523438
+15,0.24763517081737518,762.4728393554688,782.0355224609375,0.47453492879867554,942.6491088867188,980.1383056640625
+16,0.2236042022705078,754.5816650390625,772.2474365234375,0.4149192273616791,939.2578735351562,972.0363159179688
+17,0.20673388242721558,751.1386108398438,767.4717407226562,0.4393916726112366,941.818115234375,976.5303344726562
+18,0.1958666294813156,748.3099365234375,763.7852172851562,0.42572665214538574,941.2567138671875,974.888671875
+19,0.18513937294483185,746.6243896484375,761.2505493164062,0.44789212942123413,942.8832397460938,978.2664184570312
+20,0.16236239671707153,739.2681884765625,752.0963745117188,0.43732860684394836,941.007568359375,975.556640625
+21,0.153981551527977,736.764404296875,748.9275512695312,0.4367566406726837,942.7966918945312,977.300537109375

fold_1/model.bias_scaled.fold_1.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e1f32bf84f5deccfc837c6dc1dccc45cfd066d35202eae053e68cfb562a1505
+size 2688440

fold_1/model.bias_scaled.fold_1.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf03080435e97ceaf819923c48ce2acde74d094371880a79e44141b267548eed
+size 32946

fold_1/model.bias_scaled.fold_1.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4086baa1e3c62ff25642424fc6d21a96ea0cc655ae97cb912c3fa732920a5ffa
+size 267277

fold_1/model.bias_scaled.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:643591736fc95f0de525b7a4cfaa47624ce89721c2262fd4529a9e301c4a922b
+size 882550

fold_1/model.chrombpnet.fold_1.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4947e3113725d0322dd9c2cd741442189d7f3a24ad205ea0f830595903b29d8a
+size 26447928

fold_1/model.chrombpnet.fold_1.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebe506db4537ef651940c2b08186cfa7b507d047b9662be5a18106bc7fe429e8
+size 136215

fold_1/model.chrombpnet.fold_1.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd8859980820e3c793ba5de7de2bbaf42fd449ee64317fa894ebf61eb3271e3b
+size 958743

fold_1/model.chrombpnet.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:688b40ad18bc8427934a701c9d8f25fb86f1f0d7c8dac6f72d71f34dad527b64
+size 26415907

fold_1/model.chrombpnet_nobias.fold_1.ENCSR555ZDH.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6651994d9b852d49436b7dca9e793997aa9de26f76aaa9024117c6cce279b780
+size 25583536

fold_1/model.chrombpnet_nobias.fold_1.ENCSR555ZDH.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_1/model.chrombpnet_nobias.fold_1.ENCSR555ZDH.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_1/model.chrombpnet_nobias.fold_1.ENCSR555ZDH.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5517a0fa4f0d06c8480bab0339737c39d8817f41cbfbde4dd50ed35ac98cc692
+size 25531097

fold_2/logs.models.fold_2.ENCSR555ZDH/logfile.modelling.fold_2.ENCSR555ZDH.args.json

@@ -0,0 +1,23 @@
+{
+    "genome": "/scratch/groups/akundaje/anusri/chromatin_atlas/reference/hg38.genome.fa",
+    "bigwig": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//preprocessing/bigWigs/ENCSR555ZDH.bigWig",
+    "peaks": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//chrombpnet_model_feb15_fold_2//filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//chrombpnet_model_feb15_fold_2//filtered.nonpeaks.bed",
+    "output_prefix": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//chrombpnet_model_feb15_fold_2//chrombpnet",
+    "chr_fold_path": "/scratch/groups/akundaje/anusri/chromatin_atlas/splits/fold_2.json",
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "epochs": 50,
+    "early_stop": 5,
+    "batch_size": 64,
+    "learning_rate": 0.001,
+    "params": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/ATAC//ENCSR555ZDH//chrombpnet_model_feb15_fold_2//chrombpnet_model_params.tsv",
+    "seed": 1234,
+    "architecture_from_file": "/home/users/anusri/chromatin-atlas-anvil/sherlock/chrombpnet/src/training/models/chrombpnet_with_bias_model.py"
+}