• Member Since 15th Jun, 2013
  • offline last seen Saturday

Fimfarchive


Third-party archival project, do not contact Fimfiction staff for support.

More Blog Posts36

Mar
1st
2021

Fimfarchive 20210301 released! · 1:37pm March 1st

Thirty-first release with 194575 stories.


The complete archive.
Name: fimfarchive-20210301.zip
Size: 6.7 GB
Torrent: Official (SE)
Direct: Official (SE)
Magnet: magnet:?xt=urn:btih:190e5c10cab0eafc496706d969e87d7bc8309963
SHA1: 0f2dc5f39dee255f72eca6415f4db3b29d5b8c02

The xdelta3 patch.
Name: fimfarchive-20201201-to-20210301.xdelta3
Size: 0.5 GB
Torrent: Official (SE)
Direct: Official (SE)
Magnet: magnet:?xt=urn:btih:aa56d9ccfff4f19a4d8a21492e938287fd7f5bd9
SHA1: 6724514797f9c580f5e9fa2f3da8cc50bbfec51d


This is not an official Fimfiction project!

Do not contact Fimfiction staff for support regarding this archive.

Post questions as a comment or private message to this account instead!


Thanks to hawthornbunny for looking through the archive prior to this release.

Happy pronking!

Report Fimfarchive · 1,026 views ·
Comments ( 18 )

To a new year of pony stories :raritystarry:

5464318

Indeed! Let's hope it's a very fruitful one! :twilightsmile:

Posted #3 · March 1st · · 1 ·

Neither rain nor snow or even pandemics can stop the Fimfarchive!

Thanks again for your efforts.

Cheers!

Nearly at 200,000 stories to be archived. Crazy to think. Thank you again, but thanks especially for maintaining the project for so long!

5464365

I'm persistent if nothing else! :twilightblush:

5464368

Floofs!

5464395

We should reach 200 000 for the archive before the end of the year. :rainbowwild:

You're welcome. Hopefully I'll be able to keep this up for a long time!

Where can I find the site

5473537

There's no website!

5464799

From the bottom of my heart, thank you. :heart:

Given current events and knighty's blog, would it be wise to release an updated version slightly early?

So thankful for this, this gives me peace of mind. :twilightsmile:

Given the possible ramifications of the EU copyright law, I have to ask: Is it possible for you to back up the whole site, such as comments, blogposts, groups, and cover images? It would be a horrible shame to permanently lose all that stuff!

Also, two general questions:
1) What if stories are removed from the site, and you release a new version of the archive? Do the new versions simply add new stories, or is it an image taken of the site in its current form, thus deleting stories that were deleted between archive releases?

2) Does your current archive system keep the descriptions of stories and the metadata such as likes and dislikes, author, author's notes, and story/chapter publication dates? If not, can you add this functionality?

5513933

An update is already in progress, and is planned for release on the 1:st of June. :twilightsmile:

I'll be sticking to that schedule for now! I'm not worried anything drastic will happen to the site.

5514743

You're welcome! I'm glad it's helping!

5516433

Mush of that is out of scope for what I'd like to do. :unsuresweetie:

I'm focusing on story contents which I'm collecting through the Fimfiction APIv2. I'm not really interested in collecting blog posts, group posts and comments for this archive. What I would like to have is metadata about which groups a story belong since that's very useful for classifying them. That information isn't available through the API though, which means that I can't really include it in the archive (for various reasons).

Story-related images have long been in the pipeline, but isn't something I'm likely to do get to anytime soon. These would have to be released outside of the main archive due to size concerns. The "good news" there is that the archive already contains links to all images that should have been included. So, there's nothing stopping anyone else from collecting them using this archive.

5516436

The archive is cumulative, so stories that have made it into the archive will stay in the archive even if they're removed from the site. There are some exceptions to this though, such as when there's a deletion request or if content was both created and deleted between releases. My scripts don't keep a constant watch on the site, but goes through all stories once with every release.

The archive contains all metadata that the Fimfiction APIv2 exports for stories. You can see an example of this in the readme. This is stuffed into a big JSON file which is easy to play around with for programmers. It's unfortunately not very easy for other people to use, but I do have a (less complete) version as CSV or ODS spreadsheets as well.

5517259
Thanks for the response! I'm less worried now as well, seeing as it looks like Subscribestar is going to be our go-to. Best of luck!

Comment posted by Theagames10 deleted May 24th

Uh I'm new to this. What's the patch for and what does it do?

And are removed stories included?

Login or register to comment