Does anyone use this to scrape and save/monitor Jow Forums?
github.com
Jow Forums's read-only JSON API
Leo Lewis
Other urls found in this thread:
Luke Johnson
Only a monumental nerd would build a custom interface to Jow Forums.
Austin Edwards
floenfag btfo
Jason Edwards
Parker Gonzalez
A local dataset would make it easier to look for patterns and take action in an automated way.
Logan Ward
Just write your own webscraper
Jack Turner
Parker Brown
Yes
gopher://khzae.net/1/phourchan/g
Eli Ramirez
Interesting. Thanks!
. torsocks on
gopher gopher://khzae.net/1/phourchan/g
Matthew Harris
Are either of these especially useful for maintaining a local database?
Ryan Brooks
Yes.
Cooper Kelly
Yeah, what kind of question is that?
The native extension even uses the API so, pretty much everyone uses it.
I look over the entire site for interesting things using the API. Some of it is pretty great.
John Long
>what kind of question is that?
what kind of question is that?
Lincoln Morris
too fucking bad that it still pulls entire thread with every auto refresh.
but i don't expect it to be fixed before 2020
Lincoln Hernandez
hmmm first post is demotivational literally less then 10 seconds after OP's post really makes someone think
Ayden Brooks
If you want to only pull new posts in your queries just use if-modified-since. I don't know if the native extension makes use of if-modified-since though.
David Foster
Is there some sort of documentation for posting to Jow Forums? I want to make a emacs mode for it, and I should be able to use webkit to render any necessary recaptchca.
Noah James
You don't need to render anything, just use the noscript captcha.
Turn it on and make a post in your browser with the network monitor on, you should be able to figure out the rest from there.
Connor Davis
I see
Josiah Gonzalez
I used it while learning python, but haven't used it recently. It's pretty good desu
Landon Turner
>Does anyone use this to scrape and save/monitor /d/?
correct version