wassname/talk
1
0
Fork 0
mirror of https://github.com/wassname/talk.git synced 2026-07-29 11:28:24 +08:00
Code Issues Packages Projects Releases Wiki Activity

Scraper improvements

Browse Source 
- added support for changing the scraper headers
- added a Coral-Talk/${version} user agent header by default
This commit is contained in:
Wyatt Johnson
2018-03-23 16:00:09 -06:00
parent e39e0b7875
commit 45b570e163
7 changed files with 309 additions and 114 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/source/02-02-advanced-configuration.md
+8 -1
View File
@@ -521,4 +521,11 @@ Sets the logging level for the context logger (from [Bunyan](https://github.com/
- `warn`
- `info`
- `debug`
- `trace`
- `trace`
## TALK_SCRAPER_HEADERS
A JSON string representing the configuration passed to the
[fetch](https://www.npmjs.com/package/node-fetch) call for the scraper. It
can be used to set an authorization header, or change the user agent. (Default
`{}`)