todteera commited on
Commit
310b0c1
·
verified ·
1 Parent(s): f683aef

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +44 -0
  2. model.pt +3 -0
README.md CHANGED
@@ -1,3 +1,47 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - audio
7
+ - audio-to-audio
8
+ - speech
9
+ - declipping
10
+ - audio-restoration
11
+ - flow-matching
12
+ pipeline_tag: audio-to-audio
13
+ library_name: pytorch
14
  ---
15
+
16
+ # audio-restore
17
+
18
+ Repairs speech recordings damaged by clippings. A
19
+ generative model reconstructs the samples that were destroyed.
20
+
21
+ ## Usage
22
+
23
+ ```bash
24
+ git clone https://github.com/tdstt22/audio-restore
25
+ cd audio-restore && uv sync
26
+ python restore.py recording.wav restored.wav
27
+ ```
28
+
29
+ ## Components
30
+
31
+ | File | Description |
32
+ |---|---|
33
+ | `model.pt` | 2D U-Net, 48.9M params — flow-matching velocity predictor over complex STFT. EMA weights plus architecture config |
34
+
35
+ The model works on spectrograms at 24 kHz mono. It is given the damaged audio
36
+ and a mask marking which samples the clipping destroyed, so it never has to
37
+ guess where the damage is. Rather than emitting audio directly, it predicts the
38
+ direction from noise toward clean speech, and sampling follows that direction
39
+ over to arrive at the reconstruction.
40
+
41
+ ## Limitations
42
+
43
+ - **24 kHz** — higher-rate files are converted in and out, so repaired regions
44
+ carry nothing above 12 kHz. Audible as dullness on sibilants.
45
+ - **Speech only** — music and general audio are out of distribution.
46
+ - **Hard clipping only** — only focused on hard clippings that require regeneration
47
+ - **Degradations above ~30% clipped** — did not optimize for these situations during training
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62c0a5c318ffc26d3023d6a67d48cab73718bac613104739970b00ca731298a0
3
+ size 195700955