Learn html and make a ruby script using nokogiri And prepare to see things breaking every other week
Easton Green
>ruby
user...
Owen Hughes
Automate The Boring Stuff With Python had a pretty good chapter on web scraping
Liam King
is scraping with python?
what's a 1337 way you search github for specific things you want? or just search one category and hope to find what you want
Jacob Diaz
Requests + BeautifulSoup
Cameron Harris
what you want is not scraping, well its a part but interacting with a website like adding stuff to basket is way beyond scraping and obviously needs custom solutions per site
for scraping, use scrapy framework
Alexander Sanchez
What are you, black?
Ethan Anderson
i've never heard of requests. i'll look into it
niggers aren't welcome & no
thank youi'll look into the custom solutions part if i can figure it out. i wrote down scrapy framework
Julian Sanders
Imacros
Oliver Hill
>Imacros that shit looks pretty cool man thank you for this. what stuff have you made?
Juan Flores
After requests+BeautifulSoup, you can try selenium
Justin Clark
what have you made before senpai?
Jack Evans
If you want to make money online, then content strategies don't actually work.
Caleb Price
Make anything you want. It's a Javascript interface. Your welcome. Defcon recommended by a botnet operator.
Andrew Bailey
you just want to add stuff to your shopping cart? >lrn 2 selenium
Sebastian Butler
You know those global Craigslist aggregators? I made one of those to autoreply to worldwide coding jobs on the gigs board. It didn't web scrape in the final version although I did experiment with web scraping and the libraries mentioned by other Anons. In the end it used RSS feeds, which is sort of like legal web scraping. That's really the only experience I have with web scraping.
You can make money with imacros buying tickets from ticket master and scalping them on stub hub if you aren't retarded and have money to start with.
If you want advice from a old fag then limit your time on 4chin, this place makes you retarded and it's addicting.
Also, you can grow social media accounts wicked fast by just following shit loads of people on imacros and unfollowing later. There are outdated imacros scripts for that on black hat world.
Godspeed faggot.
Adrian Myers
>inventing the wheel
It's already invented, imacros faggot
Do you write a port scanner instead of us
John Sullivan
>supreme nigger detected
Nathaniel Kelly
>web scrape Well first of all there's people who actually hire for this: scrapinghub.com/jobs
Third, you just on Upwork or whatever other shitty freelance style website and look for data scraping/exfiltration or other manipulation type gigs. Almost all of them want you to rape amazon and then prepare some kind of excel spreadsheet. Well if you watch the 'data science walkthrough' at the end of that practical data science course that's exactly what they do
Christian Walker
python + selenium is fucking awesome, but it makes you appreciate the more normie friendly stuff like imacros, which handles lots of stuff under the hood.
Grayson Reyes
>supreme >shoes
Literally what is with you fucking people and your stupid shoebots?
Jesus fuck.
Julian Flores
How do i make money scraping? i know programming but i'm retarded with earning money.
Jackson Anderson
I scraped facebook to make a graph database of friendship