sigizmund
3e1f0dd53b
Fixing screwed Google Analytics tracking code. I don't know how, but it nearly disappeared and our impressions went down from 250+ a day to around 30.
2011-05-06 11:24:27 +01:00
Jim Miller
f75abaad72
3-0-2 Add convert link feature. Remove title page table(for convert). Make favicon.ico work.
2011-05-02 13:54:48 -05:00
Jim Miller
bdaea79875
Previous change to elim newlines in debug sometimes output breaks download.
...
Cheap fix, comment out debugs.
2011-05-02 13:12:16 -05:00
Jim Miller
7420d27652
More log clean up, better handling of bad URL in ficwad, missing story in ffnet.
2011-04-26 17:22:51 -05:00
Jim Miller
1426626d0a
Strip leading newline so it doesn't (falsely) show up in appengine logs as error.
2011-04-25 19:57:40 -05:00
Jim Miller
666e9666cd
Attempting to help with ffnet failures. Increase fetch deadline, add retries with backoff, 1/2 sleep.
...
Also remove <> from error message--HTML eats it.
2011-04-22 17:03:43 -05:00
Jim Miller
1c2c1a5d62
Add support for twiwrite.net. Requires User/Pass like twilighted.net.
2011-04-20 22:34:59 -05:00
Jim Miller
7c5aaa36d5
Save recent downloads longer(5 days, was 2). Fix some redirects.
...
Reduces log errors and makes auto-re-login more transparent.
2011-04-20 17:32:30 -05:00
sigizmund
13b96946d1
Improving logging, can dump the data which was downloaded if download fails.
2011-04-19 12:49:37 +01:00
sigizmund
1119ba52a0
Replaced ad block
2011-04-18 11:07:56 +01:00
Jim Miller
b058477b97
Fix so recent, but pre-compress mobis will still download.
2011-04-03 16:55:51 -05:00
Jim Miller
1f303013bd
Fix to allow retrying, compress mobi chunks, Working/Finished/Failed in status.html title, keep 3 days worth.
2011-04-03 16:47:08 -05:00
Jim Miller
302a8f12a3
Removing storage for old version. Fixes for whofic meta data.
2011-04-01 22:14:05 -05:00
retiefjimm
3e381dd33f
Still tweaking the clean up cron.
2011-03-24 22:09:11 -05:00
retiefjimm
bd82311d51
Mobi improvements: Mark TOC so reader can find it, don't let reader eat every 4096th char, don't prettify. Remove debug outputs from whofic. Increase fetch size of remover.
2011-03-24 12:57:38 -05:00
retiefjimm
efb521c829
Added tag fanficdownloader-0.5 for changeset 0f08ff79de17
2011-03-22 19:45:47 -05:00
retiefjimm
925324bd13
Improved (but not perfected) mobi file output. Reduce cron clean up time to 2 days.
2011-03-22 19:17:41 -05:00
retiefjimm
1d1ed1ef71
Add support for www.whofic.com.
2011-03-22 19:11:17 -05:00
retiefjimm
389fc010f2
After merging QueueProc changes, tweaks clean up cron times and change appspot instance name.
2011-03-22 12:59:12 -05:00
Jim Miller
5ab5991d6e
Merging QueueProc changes to trunk.
2011-03-22 12:48:17 -05:00
retiefjimm
8c606e45fd
Remove 2 sec sleep before making live version.
2011-03-17 17:03:25 -05:00
retiefjimm
e645c054d8
adastrafanfic can have chapters with tags (<i>) in them. Allow get as well as post.
2011-03-15 14:49:16 -05:00
retiefjimm
e6ebd956f8
Datastore max size is 1,000,000, not 1M(=2^20).
2011-03-10 14:30:42 -06:00
retiefjimm
ef5e7700b9
Back out some changes I didn't actually mean to commit. Just some custom stuff.
2011-03-10 13:14:51 -06:00
retiefjimm
53e2a0f204
First version with background queue processing and support for stories >1M.
2011-03-10 13:00:11 -06:00
retiefjimm
0e9d992e13
Make Branch for conversion to Queue Processing.
2011-03-04 11:58:53 -06:00
retiefjimm
790aca39da
Add epubmerge.py, a standalone CLI program to merge multiple epubs together into one.
2011-02-24 18:02:49 -06:00
retiefjimm
7064873b4e
Put title, author and publisher into mobi files properly as meta data. Also strips non-ascii chars from t,a,p--caused problems with mobi gen.
...
Calibre's book reader cannot read the mobi files produced from fanficdownloader, either before or after these changes.
2011-01-23 13:37:29 -06:00
retiefjimm
95e7ba636d
Add commas to word counts.
2011-01-15 10:41:28 -06:00
sigizmund
fe557bbce5
Fixed downloading mobi from fdown
2011-01-03 20:35:15 +00:00
retiefjimm
783a614345
Enable collection of user's own user/password again. Only used by twilighted.net.
2010-12-27 11:29:12 -06:00
retiefjimm
a32ccf7dac
Work around an SGMLParser/BeautifulStoneSoup entity bug--incorrectly inserts (;) when it shouldn't, "AT&T" becomes "AT&T;". Also update to latest BeautifulSoup: has one minor, unrelated change.
2010-12-19 12:21:55 -06:00
retiefjimm
d3abfbf5d6
Add Star Trek fanfic site adastrafanfic.com, plus add filename(linenum) to logger output for CLI.
2010-12-13 23:31:35 -06:00
retiefjimm
d95c72f447
Split info line in ffnet by ' - ' instead of just '-' so Sci-Fi doesn't become just 'Sci'. fpcom already does.
2010-12-08 17:40:10 -06:00
retiefjimm
e05749678e
Move status->subject into output.py as per Bill's suggestion.
2010-12-06 15:03:07 -06:00
retiefjimm
f7d94105ee
Correct example URL.
2010-12-05 21:40:04 -06:00
retiefjimm
50b0573033
Add status (In-Progress or Completed) to metadata as a Subject tag.
2010-12-05 21:38:16 -06:00
wsuetholz
48b882c745
2 second sleep was in Mediaminer as well.
2010-12-05 21:21:44 -06:00
wsuetholz
3fdd079b97
Merge with 8d1772310e5c4ad1772a92b1f0408952b0b370e2
2010-12-05 20:58:38 -06:00
wsuetholz
e674f7c7df
There was still a 2 second sleep between chapters for the fictonpress adapter.. Keep in mind that if you do a lot of downloading from fanfiction.net or fictionpress.com it is possible that your IP address could be locked without the sleep in place.
2010-12-05 20:52:13 -06:00
retiefjimm
8f58164dde
Added tag fanficdownloader-0.4 for changeset f23fd0e4cbc3
2010-12-02 17:36:52 -06:00
wsuetholz
4c99fdbcc1
Removed some leftover functions that were left from using ffnet.py as a base for fpcom.py and mediaminer.py.
2010-11-30 15:17:00 -06:00
wsuetholz
c6b79cb57b
Changed the "Title Page" reference in the TOC and CONTENT epub files to be title_page instead.
2010-11-30 15:11:20 -06:00
wsuetholz
f114a2438e
This one might be controversial..
...
Since none of the EBook readers are really for update-able stories I added tags/subjects in for Last Update Year/Month and Last Update, which at least in FBReader I can order by, and see all stories updated for a certain month, or a certain date. This will let you know to reread the story.
2010-11-30 14:06:12 -06:00
wsuetholz
2f0bb31e24
Take out adding the id: field as a subject.
2010-11-30 13:56:18 -06:00
wsuetholz
30455bfda2
Updated the processing for fictionpress.com of the information line to correctly extract the Updated and Published dates, and the Completion status
2010-11-30 12:13:00 -06:00
wsuetholz
cfb218f21e
Moved the check for a completed story higher in the code, this makes the continue's that are in that portion of the if statement not skip that check.
2010-11-29 18:45:47 -06:00
retiefjimm
617dc21eb9
Kludge fix for uniode in story descs in appengine.
2010-11-27 17:32:31 -06:00
retiefjimm
2d7f6c2e5c
Correct story status for ficwad, change story status for fictionalley to 'Unknown' (site doesn't tell us status), change mobi file output mode to 'wb'(binary) so it works on windows.
2010-11-26 19:36:53 -06:00
sigizmund
719aed32a9
Tiny static changes - preparing for doing some SEO
2010-11-26 15:55:04 +00:00
sigizmund