Choose a deployment
Polars Nanook runs in your infrastructure. Queries are the same in every deployment, apart from the context they run on.
-
AWS
EC2 compute that Polars Nanook starts in your AWS account after you deploy a CloudFormation stack once.
Choose it when your data is in S3 and each job should get its own compute.
-
Helm chart
Polars Nanook on your Kubernetes cluster: EKS, GKE, AKS or any CNCF-conformant distribution.
Choose it when you already operate Kubernetes, on any cloud or your own hardware.
-
Bare-metal
A cluster on your own Linux servers.
Choose it when you run servers without Kubernetes, for example an HPC cluster scheduled with Slurm.
Compare the deployments
| AWS | Helm chart | Bare-metal | |
|---|---|---|---|
| You run | Nothing | The chart on your Kubernetes cluster | polars-nanook-compute on each server |
| Client | ComputeContext |
ClusterContext |
ClusterContext |
| Configure in | Portal | Helm values | TOML file |
| Compute on demand | stops when idle | ||
| Autoscaling | fixed cluster_size |
scaling service | |
| GPU queries | unstable | unstable | |
| HDFS | experimental | experimental | |
| OpenLineage | |||
| Checkpointing | |||
| Air-gapped | Enterprise | Enterprise |
Security and data boundaries
| AWS | A connected cluster you run | An air-gapped cluster | |
|---|---|---|---|
| Leaves your infrastructure | Query plans, execution status and profiling data | Query plans, profiling data and cluster metadata, plus license verification | Nothing: no inbound or outbound connection to the Polars control plane |
| Stays in your infrastructure | The data your queries read and write, the compute | Query data, the compute, the cluster | Everything |
| Query history and profiles | In the portal | In the portal and in the cluster's observatory | Only in the cluster's observatory |
On AWS, the CloudFormation stack creates the IAM roles listed on Set up AWS. With the Helm chart, the pods use the cloud provider's workload identity, and on bare-metal the servers use the credentials you give them.
The Trust Center has the security and compliance documentation of Polars.