I hate web scraping.

What are you using to scrape?

I've done it with Node.js + Request + Cheerio. Easy as pie

What are you web scraping for?

Scraping is beautiful. I'm always using perl for that

I'm using cheerio. But it's not framework that's bothering me. It's the web scraping itself. I hate doing it.

You should try web scraping with python

I used Python request or urllib2 and beautifulsoup..
And you can good amount if you are in your clg enough for monthly as side pocket money.. lots of startup pay for scrapping. And once you are good in it, it's like minute DOM selector parse change and you earn the same amount but every iterative time, doing less effort.. and you can eventually end up making a more generic your own scrapping framework handling different types of websites...

And once during an internship at a startup, I crawled the entire LinkedIn member and companies directory and stored it in my Local drive...

@beriba
Yay first time time I see anyone using perl here :)
Having done scraping in both python and perl, I'll take perl if I can choose.
It takes a third of the code and it runs 3 times faster

I'm using Python with requests as far as it gets me. Sometimes I need to use Selenium with PhantomJS headless browser, if the website uses JS to dynamically update the HTML.

use perl Web::Scraper module on cpan

@nbamaral All true. I love perl