我必須將下面的代碼轉換為 spark,但我不明白 Seq 在這段代碼中究竟執行了什么?
val tempFactDF = unionTempDF.join(fact.select("x","y","d","f","s"),
Seq("x","y","d","f")).dropDuplicates
uj5u.com熱心網友回復:
這里它在多個列上執行連接操作,它被定義為Seq("x","y","d","f").
它相當于:
val joiningTable = fact.select("x","y","d","f","s")
unionTempDF.join(joiningTable, unionTempDF("x") === joiningTable("x") &&
unionTempDF("y") === joiningTable("y") &&
unionTempDF("d") === joiningTable("d") &&
unionTempDF("f") === joiningTable("f"))
轉載請註明出處,本文鏈接:https://www.uj5u.com/shujuku/526707.html
標籤:斯卡拉阿帕奇火花
