RDD笛卡尔操作Cartesian

import org.apache.spark.rdd.RDD import org.apache.spark.{SparkContext, SparkConf} object Cartesian{ def main(args: Array[String]) { val conf = new SparkConf().setMaster("local").setAppName("Cartesian ") val sc = new SparkContext(conf) var arr1 = sc.parallelize(Array(1,2,3)) var arr2 = sc.parallelize(Array(4,5,6)) val result: RDD[(Int, Int)] = arr1.cartesian(arr2) result.foreach(print) }

}

结果：(1,4)(1,5)(1,6)(2,4)(2,5)(2,6)(3,4)(3,5)(3,6)

笛卡尔操作原理如图：