Ilum is a Spark cluster manager that can take advantage of Kubernetes to provide speed and control never seen before.
With Ilum, you can start, stop, or restart your Spark jobs with just a few clicks. You can also view the progress of your jobs and get real-time feedback on their status.
It allows you to create, manage, and monitor your Spark jobs without ever having to leave the comfort of your browser.
Installation
To set up Ilum within a Kubernetes cluster, you must use Helm.
Check our ArtifactHUB.
Haven't got a Kubernetes cluster? Look into Minikube or Microk8s!
$ helm repo add ilum https://charts.ilum.cloud
$ helm install ilum ilum/ilum
All necessary services should launch within two minutes.
Access
Ilum is installed with a user-friendly UI that can be accessed through service or port forwarding. Use admin/admin as default credentials. You can change them during the deployment process.
$ kubectl port-forward svc/ilum-ui 9777:9777
Visit localhost:9777 to reach an ilum-ui
Ilum will add your Kubernetes cluster to the configuration.
That's all you need to start! Now you can use UI or API to work with Ilum. Check our blog post on how to start with your first spark job on kubernetes.
If you're looking for a way to improve your big data processing, Apache Spark on Kubernetes is a great option to consider.
Get Started - It's free