Monday, June 16, 2014


Contributing to Spark


https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark

http://spark.apache.org/

http://spark-summit.org/2013

https://spark-summit.org/talk/administering-spark

http://spark.apache.org/downloads.html
  1. Download Spark: spark-1.1.0.tgz
http://spark.apache.org/docs/latest/building-with-maven.html

build with maven

export PATH=/Users/Irene/Downloads/maven/apache-maven-3.2.3/bin:$PATH
export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package

SPARK SQL

https://spark.apache.org/docs/1.1.0/sql-programming-guide.html

No comments:

Post a Comment