User Guides

Welcome to the Ilum User Guides! Here you'll find comprehensive resources to help you harness the full potential of Ilum.

Jobs

Learn different ways to run and manage Spark jobs in Ilum.

Run via Ilum UI

Run via Ilum API

Run via Spark Submit

Run via Spark Connect

Run in Different Namespaces

Run dbt Job

Orchestrate dbt with Airflow

Schedule Jobs

Interactive Services

Work with interactive Spark sessions and notebooks.

Write Interactive Jobs

Interactive Job Service

Interactive Code Service

Connect VS Code (Jupyter)

Connect VS Code (MinIO)

Infrastructure & Setup

Set up and configure your Ilum clusters and storage.

Create Storage

Create Local Cluster

Create Remote Cluster

Air-Gapped Setup

CI/CD with GitLab

Management & Configuration

Manage dependencies and configure your Spark environment.

Manage Dependencies

Manage Secrets

GitOps with Argo CD

Service Management (CI/CD)