ScraperWiki

Scraping is considered by most a devious or malicious art that is only for those who wish to steal data, However this is not true, the problem is most websites offer great data however lack a real nice way of getting just the data. Some of the websites offer an api but most dont so what can you do?

Well you could manually visit each website and extract the data yourself...OR  you could write a program todo it for you maybe in something like pthon or maybe php even javascript and that would be all fine and dandy OR you could have the cloud scrape for you...Enter Scraperwiki.

One of the best scraper services on the web allowing you to leverage python, ruby and even php to write scrapers that you can manage and run when you need it or let it run daily so you have the latest data

Either way you spin it if you want to scrape some data and want a great online

service to manage it look no further then Scraperwiki

Want a small example?

The only thing you need to worry about is choosing which library your going to use

for python you can choose from

• lxml
• html5lib
• Beautiful Soup
• Beautiful Soup v4
• ..so many more

and ruby offers

• Nokogiri
• Hpricot
• LibXML
• mechanize
• ...a few more

and php offers only a few

all languages implement a library called Scraperwiki that expose a number of functions that will also help you. 

Ill admit when I started writing this post I only knew of a few of these features and they have alot more...more then I can explain just head on over and start grabbing data today.

Reddit Link grabber

Here is a small script I wrote to extract links from reddit its not bullet-proof but the point was to avoid regular expression
and rely on CSS Selectors. I also chose to use Sizzle because it gives the power of jquerys selectors minus all the stuff we dont need

SOPA & PIPA

On Jan 24th, Congress will vote to pass internet censorship in the Senate, even though the vast majority of Americans are opposed. We need to kill the bill - PIPA in the Senate and SOPA in the House - to protect our rights to free speech, privacy, and prosperity. We need internet companies to follow Reddit's lead and stand up for the web, as we internet users are doing every day.

because of this I urge any site that is not already fighting sopa and pipa todo immediiatly.
by going to http://sopastrike.com

Python script to Stop/Sniff Popups

Create a new File called myhosts and fill it with the DNS redirects you want then run the script
What this does is creates a psuedo web server that responds with a script to close the window
later i will modify it to load in a html script so you can respond with whatever you wish!