• Member Since 15th Jun, 2013
  • offline last seen Yesterday

Fimfarchive


Ensuring that history is preserved.

Fimfarchive

Fimfarchive is a project which aims to release all stories available on Fimfiction, together with their metadata, as a single archive. The archive is organized by author and could be used for backup, offline reading, or data mining.

A new version will be released each season via BitTorrent, approximately once every three months. When suitable, an xdelta3 patch will also be provided for users who do not wish to redownload unchanged stories.

Note that the archive contains a large number of files. Unzipping it to your file system may not be necessary if the archive is to be used together with some application. If you are a developer, reading directly from the ZIP-file may be preferable.

See the README for more information.

Jun
1st
2017

Fimfarchive 20170601 released! · 5:58pm June 1st

Sixteenth release with 153547 stories.


The complete archive.
Name: fimfarchive-20170601.zip
Size: 4.8 GB
Torrent: Takiri
Direct: Sweden
Magnet: magnet:?xt=urn:btih:2bd209d4bb2ad85560fbf812cce081031905150a
MD5: 88c5a6032e8a9c1480d086e6cbf33006

The xdelta3 patch.
Name: fimfarchive-20170301-to 20170601.xdelta3
Size: 0.4 GB
Torrent: Takiri
Direct: Sweden
Magnet: magnet:?xt=urn:btih:d326058620546255f9c6ff16d49a8278230f36f1
MD5: ece7a5e3498d241a5c6c6da4aee87b84


Now with a dedicated BitTorrent tracker for quicker announces!

Report Fimfarchive · 133 views ·
Comments ( 141 )
  • Viewing 122 - 141 of 141

So much thanks for this!

I've always got the files pinned on my seedbox! <3

2355019

Great! You're welcome! :twilightsmile:

Thanks to your older work, I've been able to uncover the original version of a story, before the lyrics ban was implemented. Thank you!

2352300
For now I have the basic solution that works with ePub and make searches very quick (DocFetcher). I found three stories I was looking for with it, and I can recommend it to others for similar purposes. So having opportunity to use more powerful search tools would be nice, but it's very low priority.

2351733

Other than writing a crude tool myself, I don't really know of any that could do that. I usually convert things with Calibre, but that really is not quick.

However, if you'd like I can try converting all of them to FB2.

Hello.First of all let me thank you for your work.

I was trying to use fimfarchive to find stories that I've read but can't remember the name by looking for some combination of keywords (or strings) that I can remember.

I ended up using DocFetcher. It spends a few hours to build it's own database about the archive's size but after that it searches almost instantly. For now I found stories I was looking for.
Does anyone have a better solution for full text search of the archive?
Alternatively - to work with the plaintext I can name a few much better tools than DocFetcher. If space on the disk is not the issue, can you recommend some batch converter which would be able to convert entire archive to some plaintext format (presumably conversion from ePub yo HTML will be fastest, but I may be mistaken)? Preferably in a few hours, and not in a few days.

2337861

Very unlikely unless it exactly matches the description of a story. :unsuresweetie:

If I give you a description would you be able to find the story?

2316933 that should be very helpful. And it will help me go in the right direction with my plans. Thank you.

2316887

Chinchillax usually creates spreadsheets for people to use. I haven't seen any for this release though, so I dusted off an old TSV exporter script. Below you'll find an ODS file which you should be able to open in any modern spreadsheet application. It may not contain all the data, but I hope it helps a bit. :twilightsmile:

http://jocketf.se/files/fimfarchive/fimfarchive-20160901-index.ods

2316877 okay, that site helped immensely in finding the name and author of a removed fic I was searching for. Thank you. I wtill wanna make a searchable index that is user friendly

2316877 hmmm... Maybe a programmer is what is needed... Got a good friend who can write a working OS out on a napkin, too.
It would be nice to have the ability to sort...
Sounds like something to be done in MS Excel... Or maybe in the Google Drive version of.
If i can find an approptiate reader, I might be able to mine the data and come up with a means to sort...

Will take friggin forever, but it is a challenge I feel compelled to accept.

2316706

Sorry, there really isn't any documentation other than what's in the README. To get any actual use of the index file you pretty much have to be a programmer. Fimfarchive isn't exactly user friendly at this moment. Feel free to PM me titles or any other information, that way I can see if I find anything for you.

If you're just looking for single stories you might be better off using Fimfetch.

yeah, your link to www.fimficarchive.net redirects directly to here. Tried it in three different browsers.
Now, I would like to see some sort of tutorial for how to actually use the index. That way, I can at least attempt to find certain fics I am looking for when I have no clue what the name of the author was.

Can anyone tell me how this works, im using Bit torrent but have no idea how to get the magnet link to download the archive through there.

2288338

It's an old favourite of mine. Recovered many old '90s websites with it.

One of the more advanced methods of data retrieval, which might interest you, is putting in a partial url, and a * both after it and in the date part of the url.
https://web.archive.org/web/*/http://www.fimfiction.net/story/16146/*
Here you immediately see that the site has no chapters saved for that story; only the index page. This works no matter where you cut it off at the end; it'll search for whatever it has that starts with that part.

In this case here, it also immediately gives you the name of the fic :)

2281978

Thanks! Using archive.org is a good idea if I need to fix some of the broken data. :ajsmug:

2280926

Agreed. Hopefully they'll be included in exported stories someday.

  • Viewing 122 - 141 of 141
Login or register to comment