• Member Since 15th Jun, 2013
  • offline last seen Monday

Fimfarchive


Ensuring that history is preserved.

Fimfarchive

Fimfarchive is a project which aims to release all stories available on Fimfiction, together with their metadata, as a single archive. The archive is organized by author and could be used for backup, offline reading, or data mining.

A new version will be released each season via BitTorrent, approximately once every three months. When suitable, an xdelta3 patch will also be provided for users who do not wish to redownload unchanged stories.

Note that the archive contains a large number of files. Unzipping it to your file system may not be necessary if the archive is to be used together with some application. If you are a developer, reading directly from the ZIP-file may be preferable.

See the README for more information.

Jun
1st
2017

Fimfarchive 20170601 released! · 5:58pm June 1st

Sixteenth release with 153547 stories.


The complete archive.
Name: fimfarchive-20170601.zip
Size: 4.8 GB
Torrent: Takiri
Direct: Sweden
Magnet: magnet:?xt=urn:btih:2bd209d4bb2ad85560fbf812cce081031905150a
MD5: 88c5a6032e8a9c1480d086e6cbf33006

The xdelta3 patch.
Name: fimfarchive-20170301-to 20170601.xdelta3

Read More

Report Fimfarchive · 320 views ·
Comments ( 144 )
  • Viewing 125 - 144 of 144

2482936

The sixteenth release contains 153 547 stories.

2408606 how many stories do you have?

So much thanks for this!

I've always got the files pinned on my seedbox! <3

2355019

Great! You're welcome! :twilightsmile:

Thanks to your older work, I've been able to uncover the original version of a story, before the lyrics ban was implemented. Thank you!

2352300
For now I have the basic solution that works with ePub and make searches very quick (DocFetcher). I found three stories I was looking for with it, and I can recommend it to others for similar purposes. So having opportunity to use more powerful search tools would be nice, but it's very low priority.

2351733

Other than writing a crude tool myself, I don't really know of any that could do that. I usually convert things with Calibre, but that really is not quick.

However, if you'd like I can try converting all of them to FB2.

Hello.First of all let me thank you for your work.

I was trying to use fimfarchive to find stories that I've read but can't remember the name by looking for some combination of keywords (or strings) that I can remember.

I ended up using DocFetcher. It spends a few hours to build it's own database about the archive's size but after that it searches almost instantly. For now I found stories I was looking for.
Does anyone have a better solution for full text search of the archive?
Alternatively - to work with the plaintext I can name a few much better tools than DocFetcher. If space on the disk is not the issue, can you recommend some batch converter which would be able to convert entire archive to some plaintext format (presumably conversion from ePub yo HTML will be fastest, but I may be mistaken)? Preferably in a few hours, and not in a few days.

2337861

Very unlikely unless it exactly matches the description of a story. :unsuresweetie:

If I give you a description would you be able to find the story?

2316933 that should be very helpful. And it will help me go in the right direction with my plans. Thank you.

2316887

Chinchillax usually creates spreadsheets for people to use. I haven't seen any for this release though, so I dusted off an old TSV exporter script. Below you'll find an ODS file which you should be able to open in any modern spreadsheet application. It may not contain all the data, but I hope it helps a bit. :twilightsmile:

http://jocketf.se/files/fimfarchive/fimfarchive-20160901-index.ods

2316877 okay, that site helped immensely in finding the name and author of a removed fic I was searching for. Thank you. I wtill wanna make a searchable index that is user friendly

2316877 hmmm... Maybe a programmer is what is needed... Got a good friend who can write a working OS out on a napkin, too.
It would be nice to have the ability to sort...
Sounds like something to be done in MS Excel... Or maybe in the Google Drive version of.
If i can find an approptiate reader, I might be able to mine the data and come up with a means to sort...

Will take friggin forever, but it is a challenge I feel compelled to accept.

2316706

Sorry, there really isn't any documentation other than what's in the README. To get any actual use of the index file you pretty much have to be a programmer. Fimfarchive isn't exactly user friendly at this moment. Feel free to PM me titles or any other information, that way I can see if I find anything for you.

If you're just looking for single stories you might be better off using Fimfetch.

yeah, your link to www.fimficarchive.net redirects directly to here. Tried it in three different browsers.
Now, I would like to see some sort of tutorial for how to actually use the index. That way, I can at least attempt to find certain fics I am looking for when I have no clue what the name of the author was.

Can anyone tell me how this works, im using Bit torrent but have no idea how to get the magnet link to download the archive through there.

  • Viewing 125 - 144 of 144
Login or register to comment