• Member Since 15th Jun, 2013
  • offline last seen 5 hours ago

Fimfarchive


Third-party archival project, do not contact Fimfiction staff for support.

More Blog Posts47

Dec
1st
2016

Fimfarchive 20161201 released! · 7:42pm Dec 1st, 2016

Fifteenth release with 145295 stories.


The complete archive.
Name: fimfarchive-20161201.zip
Size: 4.5 GB
Torrent: Takiri
Direct: Sweden
Magnet: magnet:?xt=urn:btih:bbac0709dbe0e31fb7c2f63913240debce495fc0
MD5: dc848734d535e9db07a97f70beeba2d0

The xdelta3 patch.
Name: fimfarchive-20160901-to-20161201.xdelta3
Size: 0.4 GB
Torrent: Takiri
Direct: Sweden
Magnet: magnet:?xt=urn:btih:71875b5d4cb7fd3d6849b7eff922178147f62de9
MD5: 9b5bf36c4f871b1779bcdcbb2177a249


I will be replying to comments on Saturday.

Report Fimfarchive · 693 views ·
Comments ( 7 )

As usual, thanks for continuing to do this. It's been useful multiple times and I expect it to be in the future.

4324971

You're welcome! :twilightsmile:

Not even 5gig yet? I'm actually shocked. How are they stored in the archive? Plain text?

4326603

Stories are stored as EPUB (zipped HTML), plus a bit of compressed JSON for the metadata. There are no images, so 4.5 GB is actually insanely much for something like this. Uncompressed the archive contains about 12.4 GB of HTML and JSON. :rainbowwild:

The word count is currently at 1 750 140 233, which is the same as 9 320 copies of The Fellowship of the Ring.

4327441 Ah, epub. I thought they were stored plain text or html, and thus why I was shocked it was so small. But yeah, epubs would let it be that small. Add in the lack of cover images too. What about those stories that had images in them?

4327900

Those aren't included in the archive, but the links to the images are. Many have requested to also include images. If I ever get around to it, a version also containing images would most likely be release alongside the main version. However, with my busy schedule and low personal interest in story images, that isn't likely to happen anytime soon. There are also many other things I want to fix with the archive before I would even consider doing that.

Building such a thing would be relatively simple using the current archive as a base though. One would basically just have to read the EPUB files, find all the img tags, fetch the images, include them in the EPUB file, and then edit the img tags. Broken URLs and sites that tries to prevent bots from reading would be a bit problematic, but not impossible to work around.

I currently have no plans to do this myself in the near future, but there really isn't anything stopping anyone else from building a version where images are included. For example, TatchM used to create a version of the archive where all the Mature-rated stories had been removed.

I kind of wish I had the energy to do this myself, but at the moment I really don't.

Login or register to comment