Upload from Ropedia Academy
Browse files- README.md +44 -3
- figure.png +0 -0
- gaussians.pt +2 -2
- metrics.json +11 -11
README.md
CHANGED
|
@@ -1,13 +1,54 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
| 3 |
tags:
|
| 4 |
- ropedia-academy
|
| 5 |
- educational
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
-
#
|
| 9 |
|
| 10 |
-
|
| 11 |
|
|
|
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
library_name: pytorch
|
| 4 |
tags:
|
| 5 |
- ropedia-academy
|
| 6 |
- educational
|
| 7 |
+
- gaussian-splatting
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# 2D Gaussian Splatting
|
| 11 |
|
| 12 |
+
Reconstructs an image with anisotropic 2D Gaussians (with densification) — the 2D analogue of 3D Gaussian Splatting.
|
| 13 |
|
| 14 |
+
Trained from scratch in **[Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/)** — an interactive, bilingual course on embodied & spatial AI. **Educational model:** small and quick to train; the value is the *method* and a reproducible pipeline, not a leaderboard score.
|
| 15 |
|
| 16 |
+
| | |
|
| 17 |
+
|---|---|
|
| 18 |
+
| **Task** | differentiable image fitting |
|
| 19 |
+
| **Data** | procedural target image |
|
| 20 |
+
| **Track** | B · 3D & rendering |
|
| 21 |
+
| **Notebook** | [](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/B_gaussian_splatting_2d.ipynb) |
|
| 22 |
+
|
| 23 |
+
## Results
|
| 24 |
+
|
| 25 |
+
| metric | value |
|
| 26 |
+
|---|---|
|
| 27 |
+
| psnr (final) | 55.94 |
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+

|
| 31 |
+
|
| 32 |
+
## How to use
|
| 33 |
+
|
| 34 |
+
```python
|
| 35 |
+
import torch
|
| 36 |
+
state = torch.load("model.pt", map_location="cpu") # some labs save pose.pt / gaussians.pt / transform.pt
|
| 37 |
+
# Rebuild the model class from the Ropedia Academy notebook (linked above), then:
|
| 38 |
+
# model.load_state_dict(state)
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
## Files
|
| 42 |
+
|
| 43 |
+
- `figure.png`
|
| 44 |
+
- `gaussians.pt`
|
| 45 |
+
- `metrics.json`
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
## Reproduce / train your own
|
| 49 |
+
|
| 50 |
+
Open the [lab notebook in Colab](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/B_gaussian_splatting_2d.ipynb) → **Runtime → GPU → Run all**, then its *Publish to the Hugging Face Hub* cell. Browse every lab in the [Ropedia Academy Labs tab](https://chaoyue0307.github.io/ropedia-academy/labs).
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
---
|
| 54 |
+
*Part of the [Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/) trained-model collection.*
|
figure.png
CHANGED
|
|
gaussians.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:166c08be34b605197f3fca73f061b7322bc0ff24cc7bf14ca6dc941dd46acbb8
|
| 3 |
+
size 32047
|
metrics.json
CHANGED
|
@@ -2,47 +2,47 @@
|
|
| 2 |
"psnr": [
|
| 3 |
[
|
| 4 |
0,
|
| 5 |
-
|
| 6 |
],
|
| 7 |
[
|
| 8 |
80,
|
| 9 |
-
|
| 10 |
],
|
| 11 |
[
|
| 12 |
160,
|
| 13 |
-
40.
|
| 14 |
],
|
| 15 |
[
|
| 16 |
240,
|
| 17 |
-
|
| 18 |
],
|
| 19 |
[
|
| 20 |
320,
|
| 21 |
-
|
| 22 |
],
|
| 23 |
[
|
| 24 |
400,
|
| 25 |
-
|
| 26 |
],
|
| 27 |
[
|
| 28 |
480,
|
| 29 |
-
|
| 30 |
],
|
| 31 |
[
|
| 32 |
560,
|
| 33 |
-
|
| 34 |
],
|
| 35 |
[
|
| 36 |
640,
|
| 37 |
-
|
| 38 |
],
|
| 39 |
[
|
| 40 |
720,
|
| 41 |
-
|
| 42 |
],
|
| 43 |
[
|
| 44 |
800,
|
| 45 |
-
|
| 46 |
]
|
| 47 |
]
|
| 48 |
}
|
|
|
|
| 2 |
"psnr": [
|
| 3 |
[
|
| 4 |
0,
|
| 5 |
+
11.97
|
| 6 |
],
|
| 7 |
[
|
| 8 |
80,
|
| 9 |
+
34.73
|
| 10 |
],
|
| 11 |
[
|
| 12 |
160,
|
| 13 |
+
40.3
|
| 14 |
],
|
| 15 |
[
|
| 16 |
240,
|
| 17 |
+
45.37
|
| 18 |
],
|
| 19 |
[
|
| 20 |
320,
|
| 21 |
+
48.11
|
| 22 |
],
|
| 23 |
[
|
| 24 |
400,
|
| 25 |
+
49.83
|
| 26 |
],
|
| 27 |
[
|
| 28 |
480,
|
| 29 |
+
52.06
|
| 30 |
],
|
| 31 |
[
|
| 32 |
560,
|
| 33 |
+
51.92
|
| 34 |
],
|
| 35 |
[
|
| 36 |
640,
|
| 37 |
+
54.22
|
| 38 |
],
|
| 39 |
[
|
| 40 |
720,
|
| 41 |
+
53.28
|
| 42 |
],
|
| 43 |
[
|
| 44 |
800,
|
| 45 |
+
55.94
|
| 46 |
]
|
| 47 |
]
|
| 48 |
}
|