Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,18 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+fold_0/model.bias_scaled.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet_nobias.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.bias_scaled.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet_nobias.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.bias_scaled.fold_2.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet.fold_2.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet_nobias.fold_2.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.bias_scaled.fold_3.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet.fold_3.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet_nobias.fold_3.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.bias_scaled.fold_4.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet.fold_4.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet_nobias.fold_4.ENCSR662HMO.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,120 @@
+---
+license: mit
+library_name: chrombpnet
+tags:
+  - encode
+  - chrombpnet
+  - chromatin-accessibility
+  - DNASE
+  - NAMALWA
+  - hg38
+---
+# ENCODE ChromBPNet Atlas
+As part of the ENCODE 4 Project, we trained ChromBPNet models on 1,512 ENCODE DNAse-seq and ATAC-seq across 408 biosamples. Here, we provide all models for open-source use.
+
+For more information about the models, see:
+- Main ENCODE 4 Paper
+- [A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays](https://doi.org/10.5281/zenodo.17123347) (Deshpande et al., Zenodo 2025)
+- [ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants](https://doi.org/10.1101/2024.12.25.630221) (Pampari et al., bioRxiv 2024)
+
+## ChromBPNet model: DNASE in NAMALWA (ENCSR662HMO)
+- Model: ChromBPNet
+- Assay: DNASE-seq
+- Experiment: [ENCSR662HMO](https://www.encodeproject.org/experiments/ENCSR662HMO/)
+- Model annotation: [ENCSR794LQK](https://www.encodeproject.org/annotations/ENCSR794LQK/)
+- Biosample: NAMALWA (Full name: Homo sapiens NAMALWA)
+- Cell slim(s): leukocyte,hematopoietic-cell,B-cell
+- Organ slim(s): bodily-fluid,blood
+- Developmental slim(s): mesoderm
+- System slim(s): immune-system
+- Assembly: hg38
+
+## Directory structure
+- `fold_0`: Model of 5-fold cross-validation: Fold 0
+    - `model.chrombpnet.fold_0.encid.h5`: full chrombpnet model that combines both bias and corrected model in .h5 format
+    - `model.chrombpnet_nobias.fold_0.encid.h5`: bias-corrected accessibility model in .h5 format (Use for all biological discovery)
+    - `model.bias_scaled.fold_0.encid.h5`: bias model in .h5 format
+    - `model.chrombpnet.fold_0.encid.tar`: full chrombpnet model that combines both bias and  corrected model in SavedModel format. After being untarred, it results in a directory named "chrombpnet".
+    - `model.chrombpnet_nobias.fold_0.encid.tar`: bias-corrected accessibility model in SavedModel format (Use for all biological discovery). After being untarred, it results in a directory named "chrombpnet_wo_bias".
+    - `model.bias_scaled.fold_0.encid.tar`: bias model in SavedModel format. After being untarred, it results in a directory named "bias_model_scaled".
+    - `logs.models.fold_0.encid`: folder containing log files for training models
+- `fold_1`: Model of 5-fold coss-validation: Fold 1
+- `fold_2`: Model of 5-fold cross-validation: Fold 2
+- `fold_3`: Model of 5-fold cross-validation: Fold 3
+- `fold_4`: Model of 5-fold cross-validation: Fold 4
+
+# Instructions
+## 1. Pseudocode for loading models in .h5 format 
+
+(1) Use the code in python after appropriately defining `model_in_h5_format` and `inputs`. \
+(2) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the 
+number of tested sequences, 2114 is the input sequence length and 4 corresponds to [A,C,G,T].
+
+```python
+import tensorflow as tf
+from tensorflow.keras.utils import get_custom_objects
+from tensorflow.keras.models import load_model
+
+custom_objects={"tf": tf}
+get_custom_objects().update(custom_objects)
+
+model=load_model(model_in_h5_format,compile=False)
+outputs = model(inputs)
+```
+
+The list `outputs` consists of two elements. The first element has a shape of (N, 1000) and
+contains logit predictions for a 1000-base-pair output. The second element, with a shape of
+(N, 1), contains logcount predictions. To transform these predictions into per-base signals, 
+follow the provided pseudo code lines below.
+
+```python
+import numpy as np
+
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs[0]) * (np.exp(outputs[1])-1)
+```
+
+## 2. Pseudocode for loading models in .tar format
+
+(1) First untar the directory as follows `tar -xvf model.tar`. \
+(2) Use the code below in python after appropriately defining `model_dir_untared` and `inputs`. \
+(3) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the number
+of tested sequences, 2114 is the input sequence length and 4 corresponds to ACGT.
+
+Reference: https://www.tensorflow.org/api_docs/python/tf/saved_model/load
+
+```python
+import tensorflow as tf
+
+model = tf.saved_model.load('model_dir_untared')
+outputs = model.signatures['serving_default'](**{'sequence':inputs.astype('float32')})
+```
+
+The variable `outputs` represents a dictionary containing two key-value pairs. The first key
+is `logits_profile_predictions`, holding a value with a shape of (N, 1000). This value corresponds
+to logit predictions for a 1000-base-pair output. The second key, named `logcount_predictions``, 
+is associated with a value of shape (N, 1), representing logcount predictions. To transform these
+predictions into per-base signals, utilize the provided pseudo code lines mentioned below.
+
+```python
+import numpy as np
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs["logits_profile_predictions"]) * (np.exp(outputs["logcount_predictions"])-1)
+```
+
+## Docker image to load and use the models
+- https://hub.docker.com/r/kundajelab/chrombpnet-atlas/ (tag:v1)
+
+## Code for ChromBPNet
+- https://github.com/kundajelab/chrombpnet/
+
+# License & citation
+External data users may freely download, analyze and publish results based on any ENCODE data without restrictions.
+
+Released under the [ENCODE data-use policy](https://www.encodeproject.org/about/data-use-policy/). Please cite the ENCODE Project Consortium and the model software: [ChromBPNet](https://github.com/kundajelab/chrombpnet) (Pampari et al., bioRxiv 2024).

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR662HMO/preprocessing/bigWigs/ENCSR662HMO.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/reference/HEPG2_DNASE_PE/fold_0/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/models/chrombpnet",
+    "bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr8",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/logs/chrombpnet_model_params.tsv"
+}

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_0/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	62.0
+counts_sum_max_thresh	45891.69
+trainings_pts_post_thresh	170954

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_0/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	54.8
+filters	512
+n_dil_layers	8
+bias_model_path	/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json
+negative_sampling_ratio	0.1

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_0/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_0/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR662HMO/logfile.modelling.fold_0.ENCSR662HMO.epoch_loss.csv

@@ -0,0 +1,13 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.983912706375122,1648.78125,1757.501220703125,0.9093472361564636,1566.6904296875,1616.52294921875
+1,0.7898293733596802,1497.189208984375,1540.47119140625,0.7797073721885681,1509.8521728515625,1552.5809326171875
+2,0.7364985942840576,1456.9805908203125,1497.341064453125,0.7953859567642212,1479.3541259765625,1522.9415283203125
+3,0.7068120837211609,1434.6875,1473.419677734375,0.7189419865608215,1482.863525390625,1522.2607421875
+4,0.6748378872871399,1414.7659912109375,1451.7447509765625,0.726469099521637,1465.9244384765625,1505.7352294921875
+5,0.6527569890022278,1401.40966796875,1437.1798095703125,0.7038435935974121,1452.4195556640625,1490.99072265625
+6,0.6294951438903809,1389.68505859375,1424.179931640625,0.6956288814544678,1441.095703125,1479.216064453125
+7,0.6159062385559082,1382.8211669921875,1416.5721435546875,0.6913480758666992,1460.2584228515625,1498.144775390625
+8,0.5879652500152588,1376.4293212890625,1408.650390625,0.7785226702690125,1460.819580078125,1503.4830322265625
+9,0.5762892961502075,1369.200439453125,1400.7808837890625,0.8496261835098267,1441.7567138671875,1488.3162841796875
+10,0.5563599467277527,1364.612548828125,1395.10009765625,0.6773165464401245,1492.64453125,1529.760986328125
+11,0.5413413643836975,1358.9337158203125,1388.5992431640625,0.7289483547210693,1454.163818359375,1494.110107421875

fold_0/model.bias_scaled.fold_0.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:529b9d255847200cb05e761befee523a2479d98a67014eb49fe6e3c5b3eccdd8
+size 2691928

fold_0/model.bias_scaled.fold_0.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf03080435e97ceaf819923c48ce2acde74d094371880a79e44141b267548eed
+size 32946

fold_0/model.bias_scaled.fold_0.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4086baa1e3c62ff25642424fc6d21a96ea0cc655ae97cb912c3fa732920a5ffa
+size 267277

fold_0/model.bias_scaled.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:624d091184da87485019522d8bfb3a6bbb9a3fb81a84150d3324a2ccb67d0db3
+size 882550

fold_0/model.chrombpnet.fold_0.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa5b6be01206c223b61c4cbda6e30b5f38fd1e9267f8f476c53b70cdb1ff2fd9
+size 77538840

fold_0/model.chrombpnet.fold_0.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d4163199e79cf54ed21f564752486f50c9eadc2a896c41813dd29a14677c528
+size 136725

fold_0/model.chrombpnet.fold_0.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bddfc250d542afd2777a125755a3d312640cf635e1c5115ee27ba223994ebad
+size 958726

fold_0/model.chrombpnet.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fb69128d231c1094e8b63e3f231c9775db116c91168ba429e98e71269876c62
+size 26415899

fold_0/model.chrombpnet_nobias.fold_0.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c246589a8056fe034879694f2557f520ef63f8fc99138cb39f6b8e8a1b98dcc
+size 25582648

fold_0/model.chrombpnet_nobias.fold_0.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_0/model.chrombpnet_nobias.fold_0.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_0/model.chrombpnet_nobias.fold_0.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a320c26d52128f901d954bf91fe65d019ffbff22c60f72335607a5da8229e38d
+size 25531097

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR662HMO/preprocessing/bigWigs/ENCSR662HMO.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/reference/HEPG2_DNASE_PE/fold_1/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/models/chrombpnet",
+    "bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr12",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/logs/chrombpnet_model_params.tsv"
+}

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_1/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	63.0
+counts_sum_max_thresh	49700.09
+trainings_pts_post_thresh	181293

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_1/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	53.7
+filters	512
+n_dil_layers	8
+bias_model_path	/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json
+negative_sampling_ratio	0.1

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_1/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/DNASE/ENCSR662HMO/fold_1/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR662HMO/logfile.modelling.fold_1.ENCSR662HMO.epoch_loss.csv

@@ -0,0 +1,14 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.6653640270233154,1659.259765625,1748.6903076171875,0.8962701559066772,1737.7083740234375,1785.8380126953125
+1,0.7948971390724182,1505.161376953125,1547.845947265625,0.8047567009925842,1691.076171875,1734.292236328125
+2,0.7573521137237549,1463.677734375,1504.3482666015625,0.7823634147644043,1680.1837158203125,1722.1968994140625
+3,0.7203832864761353,1437.5780029296875,1476.262939453125,0.7620982527732849,1634.4271240234375,1675.35107421875
+4,0.6947381496429443,1418.4088134765625,1455.7166748046875,0.7881106734275818,1647.991943359375,1690.31396484375
+5,0.6662838459014893,1404.356201171875,1440.136962890625,0.7857915759086609,1677.0950927734375,1719.292236328125
+6,0.6516382694244385,1393.2891845703125,1428.2823486328125,0.7234703302383423,1692.46728515625,1731.31787109375
+7,0.6343039274215698,1382.9644775390625,1417.02490234375,0.7063127756118774,1590.8311767578125,1628.76025390625
+8,0.6134116649627686,1375.0439453125,1407.9825439453125,0.6874262094497681,1620.4498291015625,1657.3651123046875
+9,0.5974845290184021,1368.0380859375,1400.12158203125,0.696205198764801,1636.24560546875,1673.6309814453125
+10,0.5781579613685608,1363.385009765625,1394.4302978515625,0.6951830983161926,1620.3095703125,1657.642333984375
+11,0.5621033906936646,1357.0760498046875,1387.2613525390625,0.6887058019638062,1645.2193603515625,1682.20361328125
+12,0.5521084070205688,1352.1790771484375,1381.8255615234375,0.6834102869033813,1602.4483642578125,1639.14794921875

fold_1/model.bias_scaled.fold_1.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:daf83816343d2aa9330d5c86ccfc8f4c8daf9e660b6142ffc081a8603a4c15d5
+size 2691928

fold_1/model.bias_scaled.fold_1.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf03080435e97ceaf819923c48ce2acde74d094371880a79e44141b267548eed
+size 32946

fold_1/model.bias_scaled.fold_1.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4086baa1e3c62ff25642424fc6d21a96ea0cc655ae97cb912c3fa732920a5ffa
+size 267277

fold_1/model.bias_scaled.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:038c8b8ecdf7a2b858694f0788efbbef127cc2c0c2b0d104b614590182cc0697
+size 882550

fold_1/model.chrombpnet.fold_1.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59c21f0a3912ce94ea51d2e08e4557154d0344007e16055be0c07815b2118687
+size 77538840

fold_1/model.chrombpnet.fold_1.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d4163199e79cf54ed21f564752486f50c9eadc2a896c41813dd29a14677c528
+size 136725

fold_1/model.chrombpnet.fold_1.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bddfc250d542afd2777a125755a3d312640cf635e1c5115ee27ba223994ebad
+size 958726

fold_1/model.chrombpnet.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9660bffed0d8f0ed3ec49d61fde2ddfe938290e47fd1dca53c8bf5736a8ddbaf
+size 26415899

fold_1/model.chrombpnet_nobias.fold_1.ENCSR662HMO.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1610fc1f27a4d0361c69311e9a15413d5b20f0cd70dacdd7667853eaf251e770
+size 25582648

fold_1/model.chrombpnet_nobias.fold_1.ENCSR662HMO.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_1/model.chrombpnet_nobias.fold_1.ENCSR662HMO.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_1/model.chrombpnet_nobias.fold_1.ENCSR662HMO.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ffc7171e9c6693db2491e8a16186a131efe5e196ed2799179f47628e2c0b495b
+size 25531097

fold_2/logs.models.fold_2.ENCSR662HMO/logfile.modelling.fold_2.ENCSR662HMO.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/DNASE/ENCSR662HMO/preprocessing/bigWigs/ENCSR662HMO.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2",
+    "data_type": "DNASE",
+    "peaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_2.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/reference/HEPG2_DNASE_PE/fold_2/bias.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2/models/chrombpnet",
+    "bigwig": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr22",
+    "pwm_width": 24,
+    "params": "/oak/stanford/groups/akundaje/vhecht/chromatin_atlas_bias_corrected/DNASE_model/ENCSR662HMO/fold_2/logs/chrombpnet_model_params.tsv"
+}