Submit Spark SQL queries that write results to Iceberg tables.
submit_spark_sql(options)
Submit a Spark SQL query that writes its result to an Iceberg output table. Returns run info immediately; use get_run() or submit_spark_sql_and_wait() to poll status.
from oleander_sdk import SparkSqlSubmitOptionssubmitted = await client.submit_spark_sql(SparkSqlSubmitOptions( namespace="my-namespace", name="nightly-agg", query="SELECT day, count(*) AS n FROM oleander.default.events GROUP BY day", output_table="default.daily_counts",))print(submitted.run_id, submitted.state) # "..." SUBMITTED
Submit a Spark SQL query and poll until the run reaches a terminal state (COMPLETE, FAIL, or ABORT). Raises TimeoutError if the timeout is exceeded.
from oleander_sdk import SubmitSparkSqlAndWaitOptionsresult = await client.submit_spark_sql_and_wait(SubmitSparkSqlAndWaitOptions( namespace="my-namespace", name="nightly-agg", query="SELECT day, count(*) AS n FROM oleander.default.events GROUP BY day", output_table="default.daily_counts", write_mode="APPEND",))if result.state != "COMPLETE": raise Exception(f"Run {result.run_id} ended with state: {result.state}")
Accepts all submit_spark_sql options plus:
int
default:"10000"
Milliseconds between status polls. Must be greater than 0.
int
default:"600000"
Maximum time to wait in milliseconds before raising TimeoutError.