add readme.md

This commit is contained in:
cf23659d 2021-12-16 16:36:45 +01:00
parent 76d1f13666
commit 75027505c8
1 changed files with 84 additions and 0 deletions

84
readme.md Normal file
View File

@ -0,0 +1,84 @@
# dreadarchive
archive of dread forums at http://dreadytofatroptsdj6io7l3xptbet6onoyno2yv7jicoxknyazubrad.onion
only posts older than one week are published here
generated by [dreadspider](http://it7otdanqu7ktntxzm427cba6i53w6wlanlh23v5i3siqmos47pzhvyd.onion/cf23659d/dreadspider) project
## stats
```
posts:
125614
subs:
377
raw size:
692M
compressed size:
89M
```
## download
```
darktea=http://it7otdanqu7ktntxzm427cba6i53w6wlanlh23v5i3siqmos47pzhvyd.onion
torsocks git clone $darktea/cf23659d/dreadarchive
cd dreadarchive
```
## extract
```
cd dreadarchive
7z x d.2021-12-16.init.7z.001
```
## update
```
cd dreadarchive
git pull --rebase
# todo extract updates
```
## browse
the archive is compressed, so online browsing is not possible
there will be an offline browser with the usual search and sort functions.
feel free to contribute : )
possible solutions for offline browser:
* https://github.com/LemmyNet/lemmy
* https://git.sr.ht/~vpzom/lotide
* https://github.com/mariusor/go-littr
* https://fediverse.party/en/miscellaneous -> link sharing
## search
```
cd dreadarchive
grep -r -i -E 'some.*search.*regex'
```
still better than no search function : P
todo: use a proper offline search engine (elasticsearch, etc)
## contribute
feel free to contribute patches and scripts
what i will not accept is scrapes from other people,
simply because i trust no one,
and i cannot verify the data offline,
because there are no signatures or checksums
this would be much easier,
if forum admins would publish the forum database
as an append-only "blockchain" (git, ipfs, orbitdb, ...)