scrapin-a-livin

This script helps you screen scrape the most common job sites and save the lists on you local computer. You can then use other tools to display updates, send out resumes or search your LinkedIn account to see who you may know at that company. Please feel free to contribute make. All suggestions are welcome. Hopefully this will help you find the career you are looking for.

Thanks goes out to Igvita.com for posting this article http://www.igvita.com/2007/02/04/ruby-screen-scraper-in-60-seconds/

Installing

# Install the gem
$ sudo gem install scrapin-a-livin

Using

To use the require the scrapin-a-livin library and then use the static methods for the site you want data from.

require 'scrapin-a-livin'

# Create a url for the request
url = HotjobsSearch.query("Raleigh+NC", "Software")

# Use the query to retrieve the job listings
listings = HotjobsSearch.get_listings(url)

# Now you can use the job listing information
listings.each { |job|
  puts job.title
  puts job.company
}

The current support for creating the html query for the both Dice and Yahoo Hotjobs is quite limited. If you would like to have a more advanced search, you can go the either site, create the search using the advanced search editor, and them copy the url from the resulting query. Then just substitute this string in the code above to retrieve the listings.

Note on Patches/Pull Requests

  • Fork the project.
  • Make your feature addition or bug fix.
  • Add tests for it. This is important so I don't break it in a future version unintentionally.
  • Commit, do not mess with rakefile, version, or history. (if you want to have your own version, that is fine but bump version in a commit by itself I can ignore when I pull)
  • Send me a pull request. Bonus points for topic branches.

Copyright (c) 2009 Kevin S Kirkup. See LICENSE for details.