Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,18 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+fold_0/model.bias_scaled.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet_nobias.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.bias_scaled.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet_nobias.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.bias_scaled.fold_2.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet.fold_2.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet_nobias.fold_2.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.bias_scaled.fold_3.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet.fold_3.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet_nobias.fold_3.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.bias_scaled.fold_4.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet.fold_4.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet_nobias.fold_4.ENCSR101QXF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,120 @@
+---
+license: mit
+library_name: chrombpnet
+tags:
+  - encode
+  - chrombpnet
+  - chromatin-accessibility
+  - DNASE
+  - skin
+  - hg38
+---
+# ENCODE ChromBPNet Atlas
+As part of the ENCODE 4 Project, we trained ChromBPNet models on 1,512 ENCODE DNAse-seq and ATAC-seq across 408 biosamples. Here, we provide all models for open-source use.
+
+For more information about the models, see:
+- Main ENCODE 4 Paper
+- [A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays](https://doi.org/10.5281/zenodo.17123347) (Deshpande et al., Zenodo 2025)
+- [ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants](https://doi.org/10.1101/2024.12.25.630221) (Pampari et al., bioRxiv 2024)
+
+## ChromBPNet model: DNASE in suprapubic skin (ENCSR101QXF)
+- Model: ChromBPNet
+- Assay: DNASE-seq
+- Experiment: [ENCSR101QXF](https://www.encodeproject.org/experiments/ENCSR101QXF/)
+- Model annotation: [ENCSR580EKH](https://www.encodeproject.org/annotations/ENCSR580EKH/)
+- Biosample: suprapubic skin (Full name: Homo sapiens suprapubic skin tissue female adult (53 years))
+- Cell slim(s): None
+- Organ slim(s): skin-of-body
+- Developmental slim(s): ectoderm
+- System slim(s): integumental-system
+- Assembly: hg38
+
+## Directory structure
+- `fold_0`: Model of 5-fold cross-validation: Fold 0
+    - `model.chrombpnet.fold_0.encid.h5`: full chrombpnet model that combines both bias and corrected model in .h5 format
+    - `model.chrombpnet_nobias.fold_0.encid.h5`: bias-corrected accessibility model in .h5 format (Use for all biological discovery)
+    - `model.bias_scaled.fold_0.encid.h5`: bias model in .h5 format
+    - `model.chrombpnet.fold_0.encid.tar`: full chrombpnet model that combines both bias and  corrected model in SavedModel format. After being untarred, it results in a directory named "chrombpnet".
+    - `model.chrombpnet_nobias.fold_0.encid.tar`: bias-corrected accessibility model in SavedModel format (Use for all biological discovery). After being untarred, it results in a directory named "chrombpnet_wo_bias".
+    - `model.bias_scaled.fold_0.encid.tar`: bias model in SavedModel format. After being untarred, it results in a directory named "bias_model_scaled".
+    - `logs.models.fold_0.encid`: folder containing log files for training models
+- `fold_1`: Model of 5-fold coss-validation: Fold 1
+- `fold_2`: Model of 5-fold cross-validation: Fold 2
+- `fold_3`: Model of 5-fold cross-validation: Fold 3
+- `fold_4`: Model of 5-fold cross-validation: Fold 4
+
+# Instructions
+## 1. Pseudocode for loading models in .h5 format 
+
+(1) Use the code in python after appropriately defining `model_in_h5_format` and `inputs`. \
+(2) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the 
+number of tested sequences, 2114 is the input sequence length and 4 corresponds to [A,C,G,T].
+
+```python
+import tensorflow as tf
+from tensorflow.keras.utils import get_custom_objects
+from tensorflow.keras.models import load_model
+
+custom_objects={"tf": tf}
+get_custom_objects().update(custom_objects)
+
+model=load_model(model_in_h5_format,compile=False)
+outputs = model(inputs)
+```
+
+The list `outputs` consists of two elements. The first element has a shape of (N, 1000) and
+contains logit predictions for a 1000-base-pair output. The second element, with a shape of
+(N, 1), contains logcount predictions. To transform these predictions into per-base signals, 
+follow the provided pseudo code lines below.
+
+```python
+import numpy as np
+
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs[0]) * (np.exp(outputs[1])-1)
+```
+
+## 2. Pseudocode for loading models in .tar format
+
+(1) First untar the directory as follows `tar -xvf model.tar`. \
+(2) Use the code below in python after appropriately defining `model_dir_untared` and `inputs`. \
+(3) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the number
+of tested sequences, 2114 is the input sequence length and 4 corresponds to ACGT.
+
+Reference: https://www.tensorflow.org/api_docs/python/tf/saved_model/load
+
+```python
+import tensorflow as tf
+
+model = tf.saved_model.load('model_dir_untared')
+outputs = model.signatures['serving_default'](**{'sequence':inputs.astype('float32')})
+```
+
+The variable `outputs` represents a dictionary containing two key-value pairs. The first key
+is `logits_profile_predictions`, holding a value with a shape of (N, 1000). This value corresponds
+to logit predictions for a 1000-base-pair output. The second key, named `logcount_predictions``, 
+is associated with a value of shape (N, 1), representing logcount predictions. To transform these
+predictions into per-base signals, utilize the provided pseudo code lines mentioned below.
+
+```python
+import numpy as np
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs["logits_profile_predictions"]) * (np.exp(outputs["logcount_predictions"])-1)
+```
+
+## Docker image to load and use the models
+- https://hub.docker.com/r/kundajelab/chrombpnet-atlas/ (tag:v1)
+
+## Code for ChromBPNet
+- https://github.com/kundajelab/chrombpnet/
+
+# License & citation
+External data users may freely download, analyze and publish results based on any ENCODE data without restrictions.
+
+Released under the [ENCODE data-use policy](https://www.encodeproject.org/about/data-use-policy/). Please cite the ENCODE Project Consortium and the model software: [ChromBPNet](https://github.com/kundajelab/chrombpnet) (Pampari et al., bioRxiv 2024).

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.args.json

@@ -0,0 +1,42 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "bigwig": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR101QXF/preprocessing/bigWigs/ENCSR101QXF.bigWig",
+    "output_dir": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/groups/akundaje/ziwei75/anaconda3/envs/chrombpnet/lib/python3.8/site-packages/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR101QXF/models/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/models/chrombpnet",
+    "chr": "chr8",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/logs/chrombpnet_model_params.tsv"
+}

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_0/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	0.0
+counts_sum_max_thresh	6583.83
+trainings_pts_post_thresh	173356

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_0/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	22.8
+filters	512
+n_dil_layers	8
+bias_model_path	/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json
+negative_sampling_ratio	0.1

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_model/bias_threshold_0.8/ENCSR101QXF/fold0/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_0/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR101QXF/logfile.modelling.fold_0.ENCSR101QXF.epoch_loss.csv

@@ -0,0 +1,15 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.4245432615280151,732.4028930664062,764.8816528320312,0.31583544611930847,705.1708984375,712.3716430664062
+1,0.35086727142333984,713.5614624023438,721.560546875,0.3206106722354889,701.8521118164062,709.162109375
+2,0.3199237883090973,708.7587280273438,716.052490234375,0.26288434863090515,702.7628173828125,708.75634765625
+3,0.2991192936897278,705.4071655273438,712.227294921875,0.2690565586090088,699.6371459960938,705.7715454101562
+4,0.2850896418094635,703.1844482421875,709.6861572265625,0.2587239742279053,699.5955200195312,705.4939575195312
+5,0.27355051040649414,700.3009643554688,706.5379028320312,0.23794203996658325,700.9358520507812,706.361083984375
+6,0.26390159130096436,698.7745361328125,704.7909545898438,0.2438342124223709,696.6266479492188,702.1859130859375
+7,0.25522905588150024,697.2608642578125,703.0794677734375,0.2715843915939331,698.1710205078125,704.3631591796875
+8,0.24872463941574097,694.71484375,700.385986328125,0.23517268896102905,695.593505859375,700.9552001953125
+9,0.24186241626739502,693.2129516601562,698.7271728515625,0.23135223984718323,698.2536010742188,703.5286865234375
+10,0.24102440476417542,692.2257690429688,697.7213745117188,0.27973058819770813,700.867919921875,707.2456665039062
+11,0.23441874980926514,690.8267822265625,696.1702880859375,0.2345653474330902,698.503662109375,703.8516845703125
+12,0.2319795936346054,689.8657836914062,695.1559448242188,0.25234225392341614,703.0357055664062,708.7893676757812
+13,0.22658494114875793,688.9135131835938,694.0803833007812,0.22877883911132812,703.4521484375,708.66796875

fold_0/model.bias_scaled.fold_0.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:68bba7595170a479137380380f1ef86359b6aa0e55a8784a52b964c385b24712
+size 2691928

fold_0/model.bias_scaled.fold_0.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf03080435e97ceaf819923c48ce2acde74d094371880a79e44141b267548eed
+size 32946

fold_0/model.bias_scaled.fold_0.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4086baa1e3c62ff25642424fc6d21a96ea0cc655ae97cb912c3fa732920a5ffa
+size 267277

fold_0/model.bias_scaled.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d070c72a1ca38361b7c13b6fdcb1b72248c5548583821ce18d67c6028189268d
+size 882550

fold_0/model.chrombpnet.fold_0.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:650d10944427f55563bd4c3f8e18e96a3b0681c0072ad7584b31c737c4172750
+size 77538952

fold_0/model.chrombpnet.fold_0.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5688081f7a015924c6aed30a4a80dec5fd5a3b44207f3a3556e05342a09f065
+size 136893

fold_0/model.chrombpnet.fold_0.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bddfc250d542afd2777a125755a3d312640cf635e1c5115ee27ba223994ebad
+size 958726

fold_0/model.chrombpnet.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2442825ef4ee1f5909104cf7b2a4f849e6e2fe5ed9a7be9f98f4f7633e68f36
+size 26415899

fold_0/model.chrombpnet_nobias.fold_0.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6fbc91c25485cea292423f03fbf7bf7244fc8241920468853427fe48ee7dd63f
+size 25582648

fold_0/model.chrombpnet_nobias.fold_0.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_0/model.chrombpnet_nobias.fold_0.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_0/model.chrombpnet_nobias.fold_0.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a02aa0d4edb2166254365b811c1818360118cb0bb5ba1cc80ce357eb76474cf
+size 25531097

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR101QXF/preprocessing/bigWigs/ENCSR101QXF.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR101QXF/models/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/models/chrombpnet",
+    "bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr12",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/logs/chrombpnet_model_params.tsv"
+}

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_1/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	0.0
+counts_sum_max_thresh	6665.96
+trainings_pts_post_thresh	175179

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_1/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	22.6
+filters	512
+n_dil_layers	8
+bias_model_path	/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json
+negative_sampling_ratio	0.1

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_1/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR101QXF/fold_1/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR101QXF/logfile.modelling.fold_1.ENCSR101QXF.epoch_loss.csv

@@ -0,0 +1,15 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.3360637426376343,719.1681518554688,749.3629760742188,0.413046658039093,820.2916870117188,829.6265258789062
+1,0.35782721638679504,700.3919677734375,708.477783203125,0.3131366968154907,811.6851806640625,818.761474609375
+2,0.328370600938797,695.0847778320312,702.5055541992188,0.31977617740631104,807.6278076171875,814.8543090820312
+3,0.30350011587142944,691.5202026367188,698.3807373046875,0.2643977701663971,807.6477661132812,813.6236572265625
+4,0.2879190146923065,688.8529663085938,695.3593139648438,0.259735107421875,806.0514526367188,811.9210205078125
+5,0.27547571063041687,686.2496337890625,692.4749145507812,0.2583315968513489,810.2735595703125,816.1115112304688
+6,0.267013281583786,684.1057739257812,690.1405029296875,0.2567386329174042,804.4125366210938,810.2149658203125
+7,0.25641748309135437,682.7015991210938,688.4966430664062,0.2716881334781647,807.1250610351562,813.2643432617188
+8,0.24857072532176971,680.6449584960938,686.263427734375,0.267223984003067,803.9347534179688,809.9739990234375
+9,0.24599996209144592,678.7297973632812,684.2894897460938,0.27654606103897095,812.5654907226562,818.8161010742188
+10,0.23814477026462555,677.5377197265625,682.9198608398438,0.24492888152599335,813.45263671875,818.9886474609375
+11,0.23382511734962463,674.7103881835938,679.9944458007812,0.24062588810920715,811.1280517578125,816.566162109375
+12,0.2289593517780304,673.8653564453125,679.039794921875,0.24520371854305267,812.0867919921875,817.6283569335938
+13,0.2279932051897049,672.8222045898438,677.9752197265625,0.2441021203994751,810.410400390625,815.9274291992188

fold_1/model.bias_scaled.fold_1.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b27260ad2960b6081c5b57c461fca73e84e5c756ad2b5d1fb21fddeeba0f99e
+size 2691928

fold_1/model.bias_scaled.fold_1.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf03080435e97ceaf819923c48ce2acde74d094371880a79e44141b267548eed
+size 32946

fold_1/model.bias_scaled.fold_1.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4086baa1e3c62ff25642424fc6d21a96ea0cc655ae97cb912c3fa732920a5ffa
+size 267277

fold_1/model.bias_scaled.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40114413c6668ab29dbf89937d72bc1e78c50d041fffe3aa7ccd501d9b336e35
+size 882550

fold_1/model.chrombpnet.fold_1.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3422dce3e2fc19566c27282ea1e884472e3d9c415c3dc6d32bf69a48ad508400
+size 77538840

fold_1/model.chrombpnet.fold_1.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d4163199e79cf54ed21f564752486f50c9eadc2a896c41813dd29a14677c528
+size 136725

fold_1/model.chrombpnet.fold_1.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bddfc250d542afd2777a125755a3d312640cf635e1c5115ee27ba223994ebad
+size 958726

fold_1/model.chrombpnet.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1448748b2af60643a53026e69037ef5d4aa6babbbf639051a036f1d4a05f713
+size 26415899

fold_1/model.chrombpnet_nobias.fold_1.ENCSR101QXF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d23c0536eb691aba3fd631984a585c4d0fae6c4876a52ad24ed64fab9eb6cec
+size 25582648

fold_1/model.chrombpnet_nobias.fold_1.ENCSR101QXF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_1/model.chrombpnet_nobias.fold_1.ENCSR101QXF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_1/model.chrombpnet_nobias.fold_1.ENCSR101QXF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b9a8b26a49eab12b7d166f469d7db0c6d382160c8125f56a2d7af9c2cf56ca1
+size 25531097

fold_2/logs.models.fold_2.ENCSR101QXF/logfile.modelling.fold_2.ENCSR101QXF.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR101QXF/preprocessing/bigWigs/ENCSR101QXF.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_2.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/oak/stanford/groups/akundaje/ziwei75/chromatin_atlas_bias/DNase_bias_model/bias_threshold_0.8/ENCSR101QXF/models/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2/models/chrombpnet",
+    "bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr22",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR101QXF/fold_2/logs/chrombpnet_model_params.tsv"
+}