select
t.valid,
t.remote_addr,
t.remote_user,
t.time_local,
substring(t.time_local,0,10),
substring(t.time_local,11),
substring(t.time_local,6,2),
substring(t.time_local,9,2),
substring(t.time_local,12,2),
t.request,
t.status,
t.body_bytes_sent,
t.http_referer,
t.host,
t.path,
t.query,
t.query_id,
t.http_user_agent
from(
select
a.*,
b.*
from qm1711.ods_weblog_origin a
lateral view parse_url_tuple(regexp_replace(http_referer,'\"',''),'HOST','PATH','QUERY','QUERY:id') b as host,path,query,query_id
)t;"
用SparkSession 執行這句的時候給的LOG提示說parse_url_tuple 函式既不是永久函式也不是臨時函式
但是直接在HIVE中執行這句就可以用
求解決辦法
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/50588.html
標籤：Spark