Mortar Development Framework
Mortar is a platform as a service for Hadoop. With Mortar, you can run jobs on Hadoop using Apache Spark and Python without any special training.
The Mortar Development Framework lets you develop Mortar Hadoop jobs directly on your local computer without installing any Hadoop libraries. Lots more info can be found on the Mortar wiki.
Setup
Dependencies
Installation
sudo gem install mortar --bindir /usr/local/bin
Development
To develop on the gem, install the bundle, and then use bundle exec to run mortar:
gem install bundler
bundle install
bundle exec mortar <command> <args>
If you want to run the modified mortar
from a different directory (e.g. from dd-analytics
), you need to do it like this:
BUNDLE_GEMFILE="/path/to/mortar/Gemfile" bundle exec mortar
Tests
You can run all the RSpec tests with rake:
rake spec
To run tests for a single file using:
rspec path/to/test_file