Support for Spark SQL#16

Open

craiig wants to merge 5 commits intoamplab:masterfrom

Commits on Dec 9, 2015

first working version using spark sql - only query 1a tested
craiig
committed

Commits on Jan 11, 2016

modified run query to avoid a problem where grep treats the files as binary
craiig
committed

Commits on Jan 14, 2016

fixed bug encountered on the m4.4xlarge instance types
craiig
committed

Commits on Apr 5, 2016

changes to work better with newer spark and hadoop
craig
committed
fixed bug in skip_upload options
craig
committed