scrape_r_rational/data/cache2/3a3g5d.md

## Please give me feedback: App for indexing web fiction - proof of concept

* Author: u/el-seed *
* URL: http://webfiction.co/hello
* Score: 10

* Created: 2015-06-16T22:44:13

### Post:

[Link to content](http://webfiction.co/hello)

### Comments:

> **u/Empiricist_or_not** [+7]  *Aspiring polite Hegemonizing swarm* (an hour later)
> 
> 1.  You know the library is too small.  Don't require me to send you an email if my book isn't found send me to a form: where I can give you the link and you can scrape the chapters.  Requiring human interaction on your part prevents this from scaling, and just ban behavior.
> 
> 2.  You need a TOS to define bad behavior, much let users know what you are doing with the throw away email addresses we had to make since you didn't have one and the associated passwords.

>> **u/el-seed** [+1]  (2 hours later)
>> 
>> Cool thanks. Those are both excellent. I will work on them tomorrow. I'll put a link to the TOS on the landing page and full signup form. Anywhere else?

>>> **u/Empiricist_or_not** [+2]  *Aspiring polite Hegemonizing swarm* (3 hours later)
>>> 
>>> You probably want to keep an open mind on the TOS, and because of that may need to have a NSFW tag or stuff that isn't listed in the top index.  *Metamorphosis of the Prime Intellect* comes to mind, and it is both a non-trivial part of our cannon, and an opening path to things other people might find pretty icky.

>>>> **u/el-seed** [+1]  (4 hours later)
>>>> 
>>>> Do you know of another site that has a good one that I could use as a starting point?

>>>>> **u/Empiricist_or_not** [+2]  *Aspiring polite Hegemonizing swarm* (4 hours later)
>>>>> 
>>>>> Java ranch or something: be nice. Or Reddit don't be a jerk.

>>>>>> **u/Empiricist_or_not** [+2]  *Aspiring polite Hegemonizing swarm* (5 hours later)
>>>>>> 
>>>>>> As far as what you do with people's info being honest and plainspoken is better than legaleese IMHO.

>>>> **u/None** [+1]  (23 hours later)
>>>> 
>>>> Metamorphosis of the Prime Intellect? What's it about, and what makes it icky?

>>>>> **u/Empiricist_or_not** [+1]  *Aspiring polite Hegemonizing swarm* (a day later)
>>>>> 
>>>>> Poorly written AI (with Asmov's 3 laws) (fragile architecture in the story and some conceptual errors) reaches the singularity and makes everyone immortal. The first person it made immortal is a dying centenarian who becomes involved in sex and death games and becomes significant to the rest of the plot.

>> **u/el-seed** [+1]  (18 hours later)
>> 
>> Ok, I made a user agreement and privacy policy and linked to it on the landing, login, and signup pages. How do they look?

>>> **u/Empiricist_or_not** [+1]  *Aspiring polite Hegemonizing swarm* (2 days later)
>>> 
>>> Looks good.  Needs a password reset process for valiant testers who forget their throw away password (apparently chrome doesn't rember it for password caching which is good for security and bad for ease of use, like most things good for security) and you can't reset your password by re-registering.

>>>> **u/el-seed** [+1]  (5 days later)
>>>> 
>>>> Sad! I'll add that pronto and ping you when it is done.

>>>> **u/el-seed** [+1]  (10 days later)
>>>> 
>>>> Sorry I haven't gotten to this yet. I got deep into the rabbit hole on user-added books. It's next on my list.

>> **u/el-seed** [+1]  (10 days later)
>> 
>> You can now add books by clicking a button in the sidebar or the library: http://webfiction.co/app#/books. What do you think?

>>> **u/Empiricist_or_not** [+1]  *Aspiring polite Hegemonizing swarm* (10 days later)
>>> 
>>> Dunno I can't log in. I'm not complaining but I would offer as constructive criticism I think that was a nice to have feature added before a **minumum viable product** feature was finished.

>>>> **u/el-seed** [+1]  (13 days later)
>>>> 
>>>> Yeah, I should have done the pw reset first. Sorry it took me so long. It's up now. Try resetting and let me know if you have any issues.

>>>>> **u/Empiricist_or_not** [+1]  *Aspiring polite Hegemonizing swarm* (14 days later)
>>>>> 
>>>>> No worries your a braver one than I to do front end work for fun.

> **u/el-seed** [+2]  (5 minutes later)
> 
> I have a fairly polished proof of concept ready. It hasn't launched yet, and I'd like to get feedback from readers and especially authors before launching. If you have any concerns, please bring them to my attention! 
> 
> The app is working, so if you'd like to poke around before the launch, feel free to put in your email on [the sign up page](http://webfiction.co/hello). Any feedback is welcome! Here are some links to the working app: (although you need to sign up to get bookmarking and notifications). 
> 
> - [The (temporarily) small selection](http://webfiction.co/app#/books)
> - [HPMOR Book Page](http://webfiction.co/app#/books/7c800565-3055-4b95-bf52-337c9f1da08a)
> - [Three Worlds Collide Book Page](http://webfiction.co/app#/books/622b5643-d6bc-4723-b263-16771980f1d9)
> 
> **For readers:**
> 
> - Would you use this? 
> - What is missing or what would you change?
> - Which books should I add?
> 
> **For authors:**
> 
> - What could an index do that would help you?
> - Do you have any concerns? 
> - What can I do to help facilitate your work?
> 
> Thanks for checking it out. Especially thanks to Wildbow for pointing out some issues with permission and art, which I've fixed, and to Eliezer who gave me permission to feature HPMoR.

> **u/PeridexisErrant** [+2]  *put aside fear for courage, and death for life* (an hour later)
> 
> It's a good start - the indexing model seems solid and I like the style.  I think there are two critical aspects to get it off the ground:
> 
> 1. Discovery - if you can get a (moderated?) system of tags and recommendations working, the site has real value.  
> 
> 2. Content - some combination of automated scraping and moderator/admin review.  What degree of curation do you want to enforce?

>> **u/el-seed** [+3]  (4 hours later)
>> 
>> 1. Yeah! I'll see what I can come up with.
>> 
>> 2. Hmm... I'm torn about this. I want to encourage anyone to write, because that's what's cool about self-publishing in the first place. But it would also be nice to have some kind of list you can trust: everything on it is pretty good. Maybe some kind of "top page" vs "new" thing like reddit.

>>> **u/PeridexisErrant** [+2]  *put aside fear for courage, and death for life* (9 hours later)
>>> 
>>> > Hmm... I'm torn about this. I want to encourage anyone to write, because that's what's cool about self-publishing in the first place. But it would also be nice to have some kind of list you can trust: everything on it is pretty good. Maybe some kind of "top page" vs "new" thing like reddit.
>>> 
>>> Maybe have public and private listings?  Public listings are curated (to some degree); private listings can be scraped on demand.

>>>> **u/el-seed** [+1]  (23 hours later)
>>>> 
>>>> So I've been talking with authors and it seems like they would much prefer if we ask them permission before listing them on the site. 
>>>> 
>>>> Maybe that could be part of the moderation process? Someone can list a new book, and it goes in to a "review" stage where we tweak and fix things. We could reach out to the author as a part of this and ask them to review it (and give them moderator rights).

> **u/hyenagrins** [+2]  (4 hours later)
> 
> Bookmarking is a great feature to have if it works reliably.
> 
> Suggestion:
> 
> match users following the same story *and* in the same progress (chapter) - facilitate spoiler free discussion. 
> 
> EDIT:
> 
> Also cool technology, will surely study source to improve my haskell-fu.

>> **u/el-seed** [+1]  (15 hours later)
>> 
>> Cool thanks for the idea!  I wouldn't take my haskell as gospel though :) Feel free to contribute if you want.

---