Enhance Authentik and Newt configurations to support Open WebUI integration. Add necessary environment variables and secrets management for Open WebUI in .env.sample and Ansible tasks. Update README to clarify setup steps for automating HTTP resources with Pangolin, ensuring consistency with new branding and deployment practices.
This commit is contained in:
15
.env.sample
15
.env.sample
@@ -12,13 +12,21 @@ PANGOLIN_ENDPOINT=
|
|||||||
NEWT_ID=
|
NEWT_ID=
|
||||||
NEWT_SECRET=
|
NEWT_SECRET=
|
||||||
|
|
||||||
|
# Optional: Pangolin Integration API — automate public HTTP resources + Traefik targets (**noble_pangolin_sync_http_resources=true** in **group_vars**; see **clusters/noble/bootstrap/newt/README.md** §4).
|
||||||
|
# NOBLE_PANGOLIN_API_BASE=https://api.your-pangolin.example/v1
|
||||||
|
# NOBLE_PANGOLIN_ORG_ID=
|
||||||
|
# NOBLE_PANGOLIN_API_TOKEN=
|
||||||
|
# NOBLE_PANGOLIN_SITE_ID=
|
||||||
|
# NOBLE_PANGOLIN_TRAEFIK_IP=192.168.50.211
|
||||||
|
# NOBLE_PANGOLIN_TRAEFIK_PORT=443
|
||||||
|
|
||||||
# Velero — when **noble_velero_install=true**, set bucket + S3 API URL and credentials (see clusters/noble/bootstrap/velero/README.md).
|
# Velero — when **noble_velero_install=true**, set bucket + S3 API URL and credentials (see clusters/noble/bootstrap/velero/README.md).
|
||||||
NOBLE_VELERO_S3_BUCKET=
|
NOBLE_VELERO_S3_BUCKET=
|
||||||
NOBLE_VELERO_S3_URL=
|
NOBLE_VELERO_S3_URL=
|
||||||
NOBLE_VELERO_AWS_ACCESS_KEY_ID=
|
NOBLE_VELERO_AWS_ACCESS_KEY_ID=
|
||||||
NOBLE_VELERO_AWS_SECRET_ACCESS_KEY=
|
NOBLE_VELERO_AWS_SECRET_ACCESS_KEY=
|
||||||
|
|
||||||
# Authentik + OIDC — when **noble_authentik_install=true**, Ansible installs Authentik and reconfigures Argo CD, Grafana, Headlamp (native OIDC) and Prometheus/Alertmanager/Longhorn via oauth2-proxy (OIDC to Authentik + Traefik ForwardAuth). See **ansible/roles/noble_authentik/README.md**.
|
# Authentik + OIDC — when **noble_authentik_install=true**, Ansible installs Authentik and reconfigures Argo CD, Grafana, Headlamp, **Open WebUI** (native OIDC) and Prometheus/Alertmanager/Longhorn via oauth2-proxy (OIDC to Authentik + Traefik ForwardAuth). See **ansible/roles/noble_authentik/README.md**.
|
||||||
NOBLE_AUTHENTIK_SECRET_KEY=
|
NOBLE_AUTHENTIK_SECRET_KEY=
|
||||||
NOBLE_AUTHENTIK_POSTGRES_PASSWORD=
|
NOBLE_AUTHENTIK_POSTGRES_PASSWORD=
|
||||||
NOBLE_AUTHENTIK_BOOTSTRAP_TOKEN=
|
NOBLE_AUTHENTIK_BOOTSTRAP_TOKEN=
|
||||||
@@ -28,6 +36,11 @@ NOBLE_AUTHENTIK_CLIENT_SECRET_ARGOCD=
|
|||||||
NOBLE_AUTHENTIK_CLIENT_SECRET_GRAFANA=
|
NOBLE_AUTHENTIK_CLIENT_SECRET_GRAFANA=
|
||||||
NOBLE_AUTHENTIK_CLIENT_SECRET_HEADLAMP=
|
NOBLE_AUTHENTIK_CLIENT_SECRET_HEADLAMP=
|
||||||
NOBLE_AUTHENTIK_CLIENT_SECRET_OAUTH2_PROXY=
|
NOBLE_AUTHENTIK_CLIENT_SECRET_OAUTH2_PROXY=
|
||||||
|
# Open WebUI (Argo app **clusters/noble/apps/open-webui**) — OIDC client secret + app secrets (see **clusters/noble/apps/open-webui/values.yaml**).
|
||||||
|
NOBLE_AUTHENTIK_CLIENT_SECRET_OPEN_WEBUI=
|
||||||
|
NOBLE_OPEN_WEBUI_OPENAI_API_KEY=
|
||||||
|
# e.g. openssl rand -hex 32
|
||||||
|
NOBLE_OPEN_WEBUI_WEBUI_SECRET_KEY=
|
||||||
# Random secret for oauth2-proxy session cookie (see oauth2-proxy Helm chart docs; e.g. openssl rand -base64 32 | head -c 32 | base64)
|
# Random secret for oauth2-proxy session cookie (see oauth2-proxy Helm chart docs; e.g. openssl rand -base64 32 | head -c 32 | base64)
|
||||||
NOBLE_AUTHENTIK_OAUTH2_PROXY_COOKIE_SECRET=
|
NOBLE_AUTHENTIK_OAUTH2_PROXY_COOKIE_SECRET=
|
||||||
# S3 media — **separate** bucket from Velero backups (**NOBLE_VELERO_S3_BUCKET**). Endpoint and keys default to the Velero vars above unless you set the Authentik-specific overrides.
|
# S3 media — **separate** bucket from Velero backups (**NOBLE_VELERO_S3_BUCKET**). Endpoint and keys default to the Velero vars above unless you set the Authentik-specific overrides.
|
||||||
|
|||||||
@@ -30,4 +30,6 @@ noble_authentik_install: true
|
|||||||
# Optional: public (or extra) Authentik hostnames on the same IdP — list of FQDNs. Pangolin: CNAME + resource → Newt → Traefik (see noble_authentik README).
|
# Optional: public (or extra) Authentik hostnames on the same IdP — list of FQDNs. Pangolin: CNAME + resource → Newt → Traefik (see noble_authentik README).
|
||||||
noble_authentik_ingress_extra_hosts:
|
noble_authentik_ingress_extra_hosts:
|
||||||
- auth.nikflix.ca
|
- auth.nikflix.ca
|
||||||
|
# Open WebUI — public Ingress host (Pangolin → Newt → Traefik). Must match **clusters/noble/apps/open-webui/values.yaml** **ingress.host** and Authentik redirect URI (Ansible uses this var).
|
||||||
|
noble_open_webui_public_host: webui.nikflix.ca
|
||||||
noble_authentik_blueprints_enabled: true
|
noble_authentik_blueprints_enabled: true
|
||||||
@@ -225,7 +225,7 @@
|
|||||||
- role: noble_cert_manager
|
- role: noble_cert_manager
|
||||||
tags: [cert_manager, certs]
|
tags: [cert_manager, certs]
|
||||||
- role: noble_newt
|
- role: noble_newt
|
||||||
tags: [newt]
|
tags: [newt, pangolin]
|
||||||
- role: noble_argocd
|
- role: noble_argocd
|
||||||
tags: [argocd, gitops]
|
tags: [argocd, gitops]
|
||||||
- role: noble_platform
|
- role: noble_platform
|
||||||
|
|||||||
@@ -28,6 +28,8 @@ To expose the **same** Authentik instance on an **internet-facing** FQDN (while
|
|||||||
|
|
||||||
Then in **Pangolin**: link the domain, create an **HTTP** resource for that hostname, and set the **target** to your **Newt** site with **`ip:port`** pointing at the cluster **Traefik** HTTPS entry (same pattern as **`clusters/noble/bootstrap/newt/README.md`** — typically the MetalLB / LAN VIP and **443**). One Newt tunnel can front many hostnames.
|
Then in **Pangolin**: link the domain, create an **HTTP** resource for that hostname, and set the **target** to your **Newt** site with **`ip:port`** pointing at the cluster **Traefik** HTTPS entry (same pattern as **`clusters/noble/bootstrap/newt/README.md`** — typically the MetalLB / LAN VIP and **443**). One Newt tunnel can front many hostnames.
|
||||||
|
|
||||||
|
**Open WebUI (public hostname only):** Set **`noble_open_webui_public_host`** in **`group_vars`** to the same FQDN as **`clusters/noble/apps/open-webui/values.yaml`** **`ingress.host`** (for example **`webui.example.com`**). Add a **Pangolin** HTTP resource for that hostname to the same Newt target. Point **`OPENID_PROVIDER_URL`** in **`values.yaml`** at your **public** Authentik host (usually the first **`noble_authentik_ingress_extra_hosts`** entry, e.g. **`https://auth.example.com/application/o/open-webui/.well-known/openid-configuration`**), and set **`OPENID_REDIRECT_URI`** / **`WEBUI_URL`** to **`https://<noble_open_webui_public_host>/…`**. After changing **`noble_open_webui_public_host`**, re-run **`ansible-playbook playbooks/noble.yml --tags authentik`** so Authentik’s OAuth2 redirect URI matches.
|
||||||
|
|
||||||
### Split routing, two Brands, and optional blueprints
|
### Split routing, two Brands, and optional blueprints
|
||||||
|
|
||||||
This role supports a **single Authentik deployment** with **two hostnames** (lab + public) and **different Brands** per **`Host`**, without Authentik’s separate-database **Tenancy** feature (see [Tenancy](https://docs.goauthentik.io/sys-mgmt/tenancy) — alpha / licensing). [Brands](https://docs.goauthentik.io/brands/) choose default **authentication** (and related) **flows** and branding for each FQDN.
|
This role supports a **single Authentik deployment** with **two hostnames** (lab + public) and **different Brands** per **`Host`**, without Authentik’s separate-database **Tenancy** feature (see [Tenancy](https://docs.goauthentik.io/sys-mgmt/tenancy) — alpha / licensing). [Brands](https://docs.goauthentik.io/brands/) choose default **authentication** (and related) **flows** and branding for each FQDN.
|
||||||
@@ -110,7 +112,7 @@ Authentik **tenancy** (multiple isolated tenants in one deployment, **`AUTHENTIK
|
|||||||
|
|
||||||
## IdP configuration
|
## IdP configuration
|
||||||
|
|
||||||
When **`noble_authentik_configure_idp`** is true, Ansible creates/updates OAuth2 providers and applications for **argocd**, **grafana**, **headlamp**, and **oauth2-proxy** using either the **worker ORM path** (default **`noble_authentik_oidc_provision_via: worker`**: **`kubectl exec`** + **`ak shell`** + **`files/worker_upsert_oauth_oidc.py`**, which avoids **2026+** REST **403** on **`GET …/providers/oauth2/**`) or the **REST-only path** (**`noble_authentik_oidc_provision_via: rest`**: **`files/configure_authentik.py`** needs a token that can list/patch OAuth2 providers). With the worker path and a bootstrap email, it also runs **`files/worker_add_bootstrap_user_groups.py`** so **`User.groups.add`** does not depend on **`GET …/core/users/**`. It then runs **`configure_authentik.py`** with **`AUTHENTIK_SKIP_OIDC_REST`** / **`AUTHENTIK_SKIP_USER_GROUP_REST`** when those worker steps ran, so the script only calls **`ensure_group`** over the API (skipped when **`AUTHENTIK_NOBLE_*_GROUP_PK`** are set).
|
When **`noble_authentik_configure_idp`** is true, Ansible creates/updates OAuth2 providers and applications for **argocd**, **grafana**, **headlamp**, **open-webui**, and **oauth2-proxy** using either the **worker ORM path** (default **`noble_authentik_oidc_provision_via: worker`**: **`kubectl exec`** + **`ak shell`** + **`files/worker_upsert_oauth_oidc.py`**, which avoids **2026+** REST **403** on **`GET …/providers/oauth2/**`) or the **REST-only path** (**`noble_authentik_oidc_provision_via: rest`**: **`files/configure_authentik.py`** needs a token that can list/patch OAuth2 providers). With the worker path and a bootstrap email, it also runs **`files/worker_add_bootstrap_user_groups.py`** so **`User.groups.add`** does not depend on **`GET …/core/users/**`. It then runs **`configure_authentik.py`** with **`AUTHENTIK_SKIP_OIDC_REST`** / **`AUTHENTIK_SKIP_USER_GROUP_REST`** when those worker steps ran, so the script only calls **`ensure_group`** over the API (skipped when **`AUTHENTIK_NOBLE_*_GROUP_PK`** are set).
|
||||||
|
|
||||||
## RBAC notes
|
## RBAC notes
|
||||||
|
|
||||||
@@ -136,7 +138,7 @@ When **`noble_authentik_configure_idp`** is true, Ansible creates/updates OAuth2
|
|||||||
- **Headlamp OIDC authorize fails / `invalid_scope`**: Authentik often has no separate **`groups`** ScopeMapping (groups live under **`profile`**). Default **`noble_authentik_headlamp_oidc_scopes`** omits **`groups`**; add a **`groups`** mapping to the provider in Authentik and set **`noble_authentik_headlamp_oidc_scopes`** to include **`groups`** if you need that scope by name.
|
- **Headlamp OIDC authorize fails / `invalid_scope`**: Authentik often has no separate **`groups`** ScopeMapping (groups live under **`profile`**). Default **`noble_authentik_headlamp_oidc_scopes`** omits **`groups`**; add a **`groups`** mapping to the provider in Authentik and set **`noble_authentik_headlamp_oidc_scopes`** to include **`groups`** if you need that scope by name.
|
||||||
- **Headlamp OIDC: Authentik flashes then back at login / page refresh**: Headlamp **does** support normal browser OAuth (redirect to Authentik and return to **`/oidc-callback`**). If the callback fails, the UI looks like it “drops” auth. Common causes: **`X-Forwarded-Proto`** not reaching Headlamp (callback built as **`http`** — see [Headlamp OIDC docs](https://headlamp.dev/docs/latest/installation/in-cluster/oidc)); **Traefik ForwardAuth** on the same Ingress (do not combine with native OIDC); **PKCE** state issues — this role defaults **`noble_authentik_headlamp_oidc_use_pkce: false`** for Authentik confidential clients (set **`true`** in **`group_vars`** if you need PKCE).
|
- **Headlamp OIDC: Authentik flashes then back at login / page refresh**: Headlamp **does** support normal browser OAuth (redirect to Authentik and return to **`/oidc-callback`**). If the callback fails, the UI looks like it “drops” auth. Common causes: **`X-Forwarded-Proto`** not reaching Headlamp (callback built as **`http`** — see [Headlamp OIDC docs](https://headlamp.dev/docs/latest/installation/in-cluster/oidc)); **Traefik ForwardAuth** on the same Ingress (do not combine with native OIDC); **PKCE** state issues — this role defaults **`noble_authentik_headlamp_oidc_use_pkce: false`** for Authentik confidential clients (set **`true`** in **`group_vars`** if you need PKCE).
|
||||||
- **Headlamp UI: `/me` works but `/clusters/main/version` (and other K8s calls) return 401**: Headlamp forwards your **OIDC id_token** to **kube-apiserver**. The API server must be configured with **OIDC** flags for the same **issuer** and **`oidc-client-id`** as Headlamp (see **`talos/talconfig.yaml`** patch and [Kubernetes OIDC authentication](https://kubernetes.io/docs/reference/access-authn-authz/authentication/#openid-connect-tokens)). Apply regenerated Talos configs to control plane nodes, then **`kubectl apply -k clusters/noble/bootstrap/headlamp`** (or **`--tags authentik`**) for **`oidc-noble-admins-clusterrolebinding.yaml`**. Ensure your user is in Authentik group **`noble-admins`** and the id_token includes a **`groups`** claim if you rely on that binding.
|
- **Headlamp UI: `/me` works but `/clusters/main/version` (and other K8s calls) return 401**: Headlamp forwards your **OIDC id_token** to **kube-apiserver**. The API server must be configured with **OIDC** flags for the same **issuer** and **`oidc-client-id`** as Headlamp (see **`talos/talconfig.yaml`** patch and [Kubernetes OIDC authentication](https://kubernetes.io/docs/reference/access-authn-authz/authentication/#openid-connect-tokens)). Apply regenerated Talos configs to control plane nodes, then **`kubectl apply -k clusters/noble/bootstrap/headlamp`** (or **`--tags authentik`**) for **`oidc-noble-admins-clusterrolebinding.yaml`**. Ensure your user is in Authentik group **`noble-admins`** and the id_token includes a **`groups`** claim if you rely on that binding.
|
||||||
- **Headlamp + Traefik ForwardAuth (`oauth2-proxy-forward-auth`)**: Do **not** put ForwardAuth on the **Headlamp** Ingress while using **native Headlamp OIDC**. Auth runs on **`/oidc-callback`** before Headlamp can finish the code exchange; ForwardAuth returns **401** and breaks login. Use **either** native OIDC (this repo’s **`values-authentik-oidc.yaml`**) **or** terminate auth at oauth2-proxy only (no **`config.oidc`**), not both.
|
- **Headlamp + Traefik ForwardAuth (`oauth2-proxy-forward-auth`)**: Do **not** put ForwardAuth on the **Headlamp** Ingress while using **native Headlamp OIDC**. Auth runs on **`/oidc-callback`** before Headlamp can finish the code exchange; ForwardAuth returns **401** and breaks login. Use **either** native OIDC (this repo’s **`values-authentik-oidc.yaml`**) **or** terminate auth at oauth2-proxy only (no **`config.oidc`**), not both. The same applies to **Open WebUI** native OIDC (**`/oauth/oidc/callback`** in **`clusters/noble/apps/open-webui/values.yaml`**).
|
||||||
|
|
||||||
### Fix admin access manually (worker shell, no Ansible)
|
### Fix admin access manually (worker shell, no Ansible)
|
||||||
|
|
||||||
|
|||||||
@@ -122,6 +122,7 @@ noble_authentik_client_id_argocd: argocd
|
|||||||
noble_authentik_client_id_grafana: grafana
|
noble_authentik_client_id_grafana: grafana
|
||||||
noble_authentik_client_id_headlamp: headlamp
|
noble_authentik_client_id_headlamp: headlamp
|
||||||
noble_authentik_client_id_oauth2_proxy: oauth2-proxy
|
noble_authentik_client_id_oauth2_proxy: oauth2-proxy
|
||||||
|
noble_authentik_client_id_open_webui: open-webui
|
||||||
|
|
||||||
# Headlamp **OIDC_SCOPES** for Secret **headlamp-oidc**. Omit **groups** unless the Authentik OAuth2 provider
|
# Headlamp **OIDC_SCOPES** for Secret **headlamp-oidc**. Omit **groups** unless the Authentik OAuth2 provider
|
||||||
# includes a separate **groups** ScopeMapping (2026.x defaults often embed groups in **profile** only; requesting
|
# includes a separate **groups** ScopeMapping (2026.x defaults often embed groups in **profile** only; requesting
|
||||||
@@ -143,8 +144,15 @@ noble_authentik_client_secret_argocd: ""
|
|||||||
noble_authentik_client_secret_grafana: ""
|
noble_authentik_client_secret_grafana: ""
|
||||||
noble_authentik_client_secret_headlamp: ""
|
noble_authentik_client_secret_headlamp: ""
|
||||||
noble_authentik_client_secret_oauth2_proxy: ""
|
noble_authentik_client_secret_oauth2_proxy: ""
|
||||||
|
noble_authentik_client_secret_open_webui: ""
|
||||||
noble_authentik_oauth2_proxy_cookie_secret: ""
|
noble_authentik_oauth2_proxy_cookie_secret: ""
|
||||||
|
|
||||||
|
# **open-webui** namespace — Secret **open-webui-secrets** (Ansible **--tags authentik**). See **clusters/noble/apps/open-webui/values.yaml**.
|
||||||
|
noble_open_webui_openai_api_key: ""
|
||||||
|
noble_open_webui_webui_secret_key: ""
|
||||||
|
# Public FQDN for Open WebUI (Ingress + OIDC **redirect_uri**). Set in **group_vars** (e.g. **webui.example.com**); must match GitOps **values.yaml** **ingress.host** and **OPENID_REDIRECT_URI** / **WEBUI_URL**.
|
||||||
|
noble_open_webui_public_host: ""
|
||||||
|
|
||||||
# Optional: OAuth2 provider flow PKs (UUID strings). When **both** are set, **configure_authentik.py**
|
# Optional: OAuth2 provider flow PKs (UUID strings). When **both** are set, **configure_authentik.py**
|
||||||
# skips **GET /flows/instances/** (avoids 403 if the API token cannot view flows). If unset, the role
|
# skips **GET /flows/instances/** (avoids 403 if the API token cannot view flows). If unset, the role
|
||||||
# tries **kubectl exec** into **authentik-worker** + **ak shell** to read the same slugs from the DB.
|
# tries **kubectl exec** into **authentik-worker** + **ak shell** to read the same slugs from the DB.
|
||||||
|
|||||||
@@ -195,6 +195,69 @@
|
|||||||
- (noble_authentik_cs_o2_from_env.stdout | default('') | trim | length) > 0
|
- (noble_authentik_cs_o2_from_env.stdout | default('') | trim | length) > 0
|
||||||
no_log: true
|
no_log: true
|
||||||
|
|
||||||
|
- name: Load NOBLE_AUTHENTIK_CLIENT_SECRET_OPEN_WEBUI from .env when unset
|
||||||
|
ansible.builtin.shell: |
|
||||||
|
set -a
|
||||||
|
. "{{ noble_repo_root }}/.env"
|
||||||
|
set +a
|
||||||
|
printf '%s' "${NOBLE_AUTHENTIK_CLIENT_SECRET_OPEN_WEBUI:-}"
|
||||||
|
register: noble_authentik_cs_ow_from_env
|
||||||
|
when:
|
||||||
|
- noble_authentik_dotenv_stat.stat.exists | default(false)
|
||||||
|
- noble_authentik_client_secret_open_webui | default('') | length == 0
|
||||||
|
changed_when: false
|
||||||
|
no_log: true
|
||||||
|
|
||||||
|
- name: Apply NOBLE_AUTHENTIK_CLIENT_SECRET_OPEN_WEBUI from .env
|
||||||
|
ansible.builtin.set_fact:
|
||||||
|
noble_authentik_client_secret_open_webui: "{{ noble_authentik_cs_ow_from_env.stdout | trim }}"
|
||||||
|
when:
|
||||||
|
- noble_authentik_cs_ow_from_env is defined
|
||||||
|
- (noble_authentik_cs_ow_from_env.stdout | default('') | trim | length) > 0
|
||||||
|
no_log: true
|
||||||
|
|
||||||
|
- name: Load NOBLE_OPEN_WEBUI_OPENAI_API_KEY from .env when unset
|
||||||
|
ansible.builtin.shell: |
|
||||||
|
set -a
|
||||||
|
. "{{ noble_repo_root }}/.env"
|
||||||
|
set +a
|
||||||
|
printf '%s' "${NOBLE_OPEN_WEBUI_OPENAI_API_KEY:-}"
|
||||||
|
register: noble_open_webui_openai_from_env
|
||||||
|
when:
|
||||||
|
- noble_authentik_dotenv_stat.stat.exists | default(false)
|
||||||
|
- noble_open_webui_openai_api_key | default('') | length == 0
|
||||||
|
changed_when: false
|
||||||
|
no_log: true
|
||||||
|
|
||||||
|
- name: Apply NOBLE_OPEN_WEBUI_OPENAI_API_KEY from .env
|
||||||
|
ansible.builtin.set_fact:
|
||||||
|
noble_open_webui_openai_api_key: "{{ noble_open_webui_openai_from_env.stdout | trim }}"
|
||||||
|
when:
|
||||||
|
- noble_open_webui_openai_from_env is defined
|
||||||
|
- (noble_open_webui_openai_from_env.stdout | default('') | trim | length) > 0
|
||||||
|
no_log: true
|
||||||
|
|
||||||
|
- name: Load NOBLE_OPEN_WEBUI_WEBUI_SECRET_KEY from .env when unset
|
||||||
|
ansible.builtin.shell: |
|
||||||
|
set -a
|
||||||
|
. "{{ noble_repo_root }}/.env"
|
||||||
|
set +a
|
||||||
|
printf '%s' "${NOBLE_OPEN_WEBUI_WEBUI_SECRET_KEY:-}"
|
||||||
|
register: noble_open_webui_webui_secret_from_env
|
||||||
|
when:
|
||||||
|
- noble_authentik_dotenv_stat.stat.exists | default(false)
|
||||||
|
- noble_open_webui_webui_secret_key | default('') | length == 0
|
||||||
|
changed_when: false
|
||||||
|
no_log: true
|
||||||
|
|
||||||
|
- name: Apply NOBLE_OPEN_WEBUI_WEBUI_SECRET_KEY from .env
|
||||||
|
ansible.builtin.set_fact:
|
||||||
|
noble_open_webui_webui_secret_key: "{{ noble_open_webui_webui_secret_from_env.stdout | trim }}"
|
||||||
|
when:
|
||||||
|
- noble_open_webui_webui_secret_from_env is defined
|
||||||
|
- (noble_open_webui_webui_secret_from_env.stdout | default('') | trim | length) > 0
|
||||||
|
no_log: true
|
||||||
|
|
||||||
- name: Load NOBLE_AUTHENTIK_OAUTH2_PROXY_COOKIE_SECRET from .env when unset
|
- name: Load NOBLE_AUTHENTIK_OAUTH2_PROXY_COOKIE_SECRET from .env when unset
|
||||||
ansible.builtin.shell: |
|
ansible.builtin.shell: |
|
||||||
set -a
|
set -a
|
||||||
|
|||||||
@@ -22,9 +22,16 @@
|
|||||||
- noble_authentik_client_secret_grafana | default('') | length > 0
|
- noble_authentik_client_secret_grafana | default('') | length > 0
|
||||||
- noble_authentik_client_secret_headlamp | default('') | length > 0
|
- noble_authentik_client_secret_headlamp | default('') | length > 0
|
||||||
- noble_authentik_client_secret_oauth2_proxy | default('') | length > 0
|
- noble_authentik_client_secret_oauth2_proxy | default('') | length > 0
|
||||||
|
- noble_authentik_client_secret_open_webui | default('') | length > 0
|
||||||
- noble_authentik_oauth2_proxy_cookie_secret | default('') | length > 0
|
- noble_authentik_oauth2_proxy_cookie_secret | default('') | length > 0
|
||||||
|
- noble_open_webui_openai_api_key | default('') | length > 0
|
||||||
|
- noble_open_webui_webui_secret_key | default('') | length > 0
|
||||||
|
- noble_open_webui_public_host | default('') | trim | length > 0
|
||||||
fail_msg: >-
|
fail_msg: >-
|
||||||
Authentik requires secrets in .env (see ansible/roles/noble_authentik/README.md) or matching -e extra-vars.
|
Authentik requires secrets in .env (see ansible/roles/noble_authentik/README.md) or matching -e extra-vars.
|
||||||
|
Includes Open WebUI: NOBLE_AUTHENTIK_CLIENT_SECRET_OPEN_WEBUI, NOBLE_OPEN_WEBUI_OPENAI_API_KEY,
|
||||||
|
NOBLE_OPEN_WEBUI_WEBUI_SECRET_KEY (see .env.sample). Set **noble_open_webui_public_host** (must match
|
||||||
|
**clusters/noble/apps/open-webui/values.yaml** ingress host; see README Pangolin section).
|
||||||
|
|
||||||
- name: Require Authentik S3 media settings (same endpoint/keys as Velero; dedicated bucket)
|
- name: Require Authentik S3 media settings (same endpoint/keys as Velero; dedicated bucket)
|
||||||
ansible.builtin.assert:
|
ansible.builtin.assert:
|
||||||
@@ -566,6 +573,32 @@
|
|||||||
no_log: true
|
no_log: true
|
||||||
changed_when: true
|
changed_when: true
|
||||||
|
|
||||||
|
- name: Ensure open-webui namespace exists (Secret before Argo first sync)
|
||||||
|
ansible.builtin.shell: |
|
||||||
|
set -euo pipefail
|
||||||
|
kubectl create namespace open-webui --dry-run=client -o yaml | kubectl apply -f -
|
||||||
|
environment:
|
||||||
|
KUBECONFIG: "{{ noble_kubeconfig }}"
|
||||||
|
when: noble_authentik_configure_idp | default(true) | bool
|
||||||
|
changed_when: true
|
||||||
|
|
||||||
|
- name: Create Open WebUI secrets (OpenAI + WEBUI + OIDC client secret)
|
||||||
|
ansible.builtin.shell: |
|
||||||
|
set -euo pipefail
|
||||||
|
kubectl -n open-webui create secret generic open-webui-secrets \
|
||||||
|
--from-literal=OPENAI_API_KEY="${OPENAI_API_KEY}" \
|
||||||
|
--from-literal=WEBUI_SECRET_KEY="${WEBUI_SECRET_KEY}" \
|
||||||
|
--from-literal=OAUTH_CLIENT_SECRET="${OAUTH_CLIENT_SECRET}" \
|
||||||
|
--dry-run=client -o yaml | kubectl apply -f -
|
||||||
|
environment:
|
||||||
|
KUBECONFIG: "{{ noble_kubeconfig }}"
|
||||||
|
OPENAI_API_KEY: "{{ noble_open_webui_openai_api_key }}"
|
||||||
|
WEBUI_SECRET_KEY: "{{ noble_open_webui_webui_secret_key }}"
|
||||||
|
OAUTH_CLIENT_SECRET: "{{ noble_authentik_client_secret_open_webui }}"
|
||||||
|
no_log: true
|
||||||
|
when: noble_authentik_configure_idp | default(true) | bool
|
||||||
|
changed_when: true
|
||||||
|
|
||||||
- name: Create oauth2-proxy credentials Secret (OIDC to Authentik; not BasicAuth)
|
- name: Create oauth2-proxy credentials Secret (OIDC to Authentik; not BasicAuth)
|
||||||
ansible.builtin.shell: |
|
ansible.builtin.shell: |
|
||||||
set -euo pipefail
|
set -euo pipefail
|
||||||
|
|||||||
@@ -22,5 +22,11 @@
|
|||||||
"client_id": {{ noble_authentik_client_id_oauth2_proxy | to_json }},
|
"client_id": {{ noble_authentik_client_id_oauth2_proxy | to_json }},
|
||||||
"client_secret": {{ noble_authentik_client_secret_oauth2_proxy | to_json }},
|
"client_secret": {{ noble_authentik_client_secret_oauth2_proxy | to_json }},
|
||||||
"redirect_uri": "https://{{ noble_authentik_oauth2_proxy_host }}/oauth2/callback"
|
"redirect_uri": "https://{{ noble_authentik_oauth2_proxy_host }}/oauth2/callback"
|
||||||
|
},
|
||||||
|
"open-webui": {
|
||||||
|
"name": "Open WebUI",
|
||||||
|
"client_id": {{ noble_authentik_client_id_open_webui | to_json }},
|
||||||
|
"client_secret": {{ noble_authentik_client_secret_open_webui | to_json }},
|
||||||
|
"redirect_uri": "https://{{ noble_open_webui_public_host | trim }}/oauth/oidc/callback"
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -27,6 +27,12 @@
|
|||||||
"client_id": {{ noble_authentik_client_id_oauth2_proxy | to_json }},
|
"client_id": {{ noble_authentik_client_id_oauth2_proxy | to_json }},
|
||||||
"client_secret": {{ noble_authentik_client_secret_oauth2_proxy | to_json }},
|
"client_secret": {{ noble_authentik_client_secret_oauth2_proxy | to_json }},
|
||||||
"redirect_uri": "https://{{ noble_authentik_oauth2_proxy_host }}/oauth2/callback"
|
"redirect_uri": "https://{{ noble_authentik_oauth2_proxy_host }}/oauth2/callback"
|
||||||
|
},
|
||||||
|
"open-webui": {
|
||||||
|
"name": "Open WebUI",
|
||||||
|
"client_id": {{ noble_authentik_client_id_open_webui | to_json }},
|
||||||
|
"client_secret": {{ noble_authentik_client_secret_open_webui | to_json }},
|
||||||
|
"redirect_uri": "https://{{ noble_open_webui_public_host | trim }}/oauth/oidc/callback"
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -1,3 +1,11 @@
|
|||||||
---
|
---
|
||||||
# Set true after creating the newt-pangolin-auth Secret (see role / cluster docs).
|
# Set true after creating the newt-pangolin-auth Secret (see role / cluster docs).
|
||||||
noble_newt_install: true
|
noble_newt_install: true
|
||||||
|
|
||||||
|
# Pangolin Integration API — idempotent HTTP resources + Traefik targets (see clusters/noble/bootstrap/newt/README.md §4).
|
||||||
|
noble_pangolin_sync_http_resources: false
|
||||||
|
# Extra FQDNs to sync (in addition to **noble_authentik_ingress_extra_hosts** + **noble_open_webui_public_host** when set).
|
||||||
|
noble_pangolin_http_fqdns_extra: []
|
||||||
|
# Traefik HTTPS backend for Pangolin targets (MetalLB / LAN VIP). Empty → **kubectl** discovers the Traefik Service.
|
||||||
|
noble_pangolin_traefik_target_ip: ""
|
||||||
|
noble_pangolin_traefik_target_port: 443
|
||||||
|
|||||||
@@ -3,7 +3,12 @@
|
|||||||
ansible.builtin.debug:
|
ansible.builtin.debug:
|
||||||
msg: "noble_newt_install is false — set PANGOLIN_ENDPOINT, NEWT_ID, NEWT_SECRET in repo .env (or create the Secret manually) and set noble_newt_install=true to deploy Newt."
|
msg: "noble_newt_install is false — set PANGOLIN_ENDPOINT, NEWT_ID, NEWT_SECRET in repo .env (or create the Secret manually) and set noble_newt_install=true to deploy Newt."
|
||||||
when: not (noble_newt_install | bool)
|
when: not (noble_newt_install | bool)
|
||||||
|
tags: [newt]
|
||||||
|
|
||||||
|
- name: Deploy Newt (Pangolin tunnel) and optional Pangolin HTTP resource sync
|
||||||
|
when: noble_newt_install | bool
|
||||||
|
tags: [newt, pangolin]
|
||||||
|
block:
|
||||||
- name: Create Newt namespace
|
- name: Create Newt namespace
|
||||||
ansible.builtin.command:
|
ansible.builtin.command:
|
||||||
argv:
|
argv:
|
||||||
@@ -13,12 +18,10 @@
|
|||||||
- "{{ noble_repo_root }}/clusters/noble/bootstrap/newt/namespace.yaml"
|
- "{{ noble_repo_root }}/clusters/noble/bootstrap/newt/namespace.yaml"
|
||||||
environment:
|
environment:
|
||||||
KUBECONFIG: "{{ noble_kubeconfig }}"
|
KUBECONFIG: "{{ noble_kubeconfig }}"
|
||||||
when: noble_newt_install | bool
|
|
||||||
changed_when: true
|
changed_when: true
|
||||||
|
|
||||||
- name: Apply Newt Pangolin auth Secret from repository .env (optional)
|
- name: Apply Newt Pangolin auth Secret from repository .env (optional)
|
||||||
ansible.builtin.include_tasks: from_env.yml
|
ansible.builtin.include_tasks: from_env.yml
|
||||||
when: noble_newt_install | bool
|
|
||||||
|
|
||||||
- name: Install Newt chart
|
- name: Install Newt chart
|
||||||
ansible.builtin.command:
|
ansible.builtin.command:
|
||||||
@@ -38,5 +41,8 @@
|
|||||||
- --wait
|
- --wait
|
||||||
environment:
|
environment:
|
||||||
KUBECONFIG: "{{ noble_kubeconfig }}"
|
KUBECONFIG: "{{ noble_kubeconfig }}"
|
||||||
when: noble_newt_install | bool
|
|
||||||
changed_when: true
|
changed_when: true
|
||||||
|
|
||||||
|
- name: Optional Pangolin Integration API (HTTP resources + Traefik targets)
|
||||||
|
ansible.builtin.include_tasks: pangolin_sync.yml
|
||||||
|
when: noble_pangolin_sync_http_resources | default(false) | bool
|
||||||
|
|||||||
95
ansible/roles/noble_newt/tasks/pangolin_sync.yml
Normal file
95
ansible/roles/noble_newt/tasks/pangolin_sync.yml
Normal file
@@ -0,0 +1,95 @@
|
|||||||
|
---
|
||||||
|
# Pangolin Integration API — public HTTP resources → Newt site → Traefik (see clusters/noble/bootstrap/newt/README.md §4).
|
||||||
|
# Included only when **noble_pangolin_sync_http_resources** is true.
|
||||||
|
- name: Build Pangolin HTTP FQDN list
|
||||||
|
ansible.builtin.set_fact:
|
||||||
|
noble_pangolin_http_fqdns_effective: >-
|
||||||
|
{{
|
||||||
|
(
|
||||||
|
noble_pangolin_http_fqdns_extra | default([])
|
||||||
|
+ (noble_authentik_ingress_extra_hosts | default([]))
|
||||||
|
+ ([noble_open_webui_public_host | trim] if (noble_open_webui_public_host | default('') | trim | length) > 0 else [])
|
||||||
|
) | unique | list
|
||||||
|
}}
|
||||||
|
|
||||||
|
- name: Discover Traefik LoadBalancer IP for Pangolin targets (when not set explicitly)
|
||||||
|
ansible.builtin.command:
|
||||||
|
argv:
|
||||||
|
- kubectl
|
||||||
|
- get
|
||||||
|
- svc
|
||||||
|
- -n
|
||||||
|
- traefik
|
||||||
|
- -l
|
||||||
|
- app.kubernetes.io/name=traefik
|
||||||
|
- -o
|
||||||
|
- jsonpath={.items[0].status.loadBalancer.ingress[0].ip}
|
||||||
|
environment:
|
||||||
|
KUBECONFIG: "{{ noble_kubeconfig }}"
|
||||||
|
register: noble_pangolin_traefik_lb_ip
|
||||||
|
changed_when: false
|
||||||
|
failed_when: false
|
||||||
|
when:
|
||||||
|
- noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
- noble_pangolin_traefik_target_ip | default('') | trim | length == 0
|
||||||
|
|
||||||
|
- name: Resolve Traefik IP for Pangolin sync
|
||||||
|
ansible.builtin.set_fact:
|
||||||
|
noble_pangolin_traefik_ip_resolved: >-
|
||||||
|
{{
|
||||||
|
(noble_pangolin_traefik_target_ip | default('') | trim)
|
||||||
|
if (noble_pangolin_traefik_target_ip | default('') | trim | length > 0)
|
||||||
|
else (noble_pangolin_traefik_lb_ip.stdout | default('') | trim)
|
||||||
|
}}
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
|
||||||
|
- name: Require Traefik IP for Pangolin sync
|
||||||
|
ansible.builtin.assert:
|
||||||
|
that:
|
||||||
|
- noble_pangolin_traefik_ip_resolved | length > 0
|
||||||
|
fail_msg: >-
|
||||||
|
Set **noble_pangolin_traefik_target_ip** in inventory (Traefik Service LoadBalancer / MetalLB IP), or ensure
|
||||||
|
**kubectl** can read **traefik** Services (see **clusters/noble/bootstrap/traefik/**).
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
|
||||||
|
- name: Stat repository .env for Pangolin API credentials
|
||||||
|
ansible.builtin.stat:
|
||||||
|
path: "{{ noble_repo_root }}/.env"
|
||||||
|
register: noble_pangolin_env_file
|
||||||
|
changed_when: false
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
|
||||||
|
- name: Require .env for Pangolin Integration API secrets
|
||||||
|
ansible.builtin.assert:
|
||||||
|
that:
|
||||||
|
- noble_pangolin_env_file.stat.exists | default(false)
|
||||||
|
fail_msg: >-
|
||||||
|
Pangolin sync needs **.env** at the repo root with **NOBLE_PANGOLIN_*** variables (see **.env.sample**).
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
|
||||||
|
- name: Sync Pangolin public HTTP resources (Integration API)
|
||||||
|
ansible.builtin.command:
|
||||||
|
argv:
|
||||||
|
- python3
|
||||||
|
- "{{ noble_repo_root }}/clusters/noble/bootstrap/newt/scripts/sync_pangolin_http_resources.py"
|
||||||
|
- "--env-file"
|
||||||
|
- "{{ noble_repo_root }}/.env"
|
||||||
|
- "--fqdns"
|
||||||
|
- "{{ noble_pangolin_http_fqdns_effective | join(',') }}"
|
||||||
|
- "--traefik-ip"
|
||||||
|
- "{{ noble_pangolin_traefik_ip_resolved }}"
|
||||||
|
- "--traefik-port"
|
||||||
|
- "{{ noble_pangolin_traefik_target_port | int | string }}"
|
||||||
|
register: noble_pangolin_sync_cmd
|
||||||
|
changed_when: >-
|
||||||
|
'[create]' in (noble_pangolin_sync_cmd.stdout | default(''))
|
||||||
|
or '[target]' in (noble_pangolin_sync_cmd.stdout | default(''))
|
||||||
|
or 'target created' in (noble_pangolin_sync_cmd.stdout | default(''))
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length > 0
|
||||||
|
|
||||||
|
- name: Skip Pangolin sync (no public FQDNs configured)
|
||||||
|
ansible.builtin.debug:
|
||||||
|
msg: >-
|
||||||
|
noble_pangolin_sync_http_resources is true but the FQDN list is empty
|
||||||
|
(set **noble_authentik_ingress_extra_hosts**, **noble_open_webui_public_host**, and/or **noble_pangolin_http_fqdns_extra**).
|
||||||
|
when: noble_pangolin_http_fqdns_effective | length == 0
|
||||||
@@ -2,4 +2,5 @@
|
|||||||
apiVersion: kustomize.config.k8s.io/v1beta1
|
apiVersion: kustomize.config.k8s.io/v1beta1
|
||||||
kind: Kustomization
|
kind: Kustomization
|
||||||
resources:
|
resources:
|
||||||
|
- namespace.yaml
|
||||||
- application.yaml
|
- application.yaml
|
||||||
|
|||||||
6
clusters/noble/apps/open-webui/namespace.yaml
Normal file
6
clusters/noble/apps/open-webui/namespace.yaml
Normal file
@@ -0,0 +1,6 @@
|
|||||||
|
apiVersion: v1
|
||||||
|
kind: Namespace
|
||||||
|
metadata:
|
||||||
|
name: open-webui
|
||||||
|
labels:
|
||||||
|
app.kubernetes.io/name: open-webui
|
||||||
@@ -1,10 +1,10 @@
|
|||||||
# Open WebUI — https://github.com/open-webui/helm-charts (chart **open-webui**).
|
# Open WebUI — https://github.com/open-webui/helm-charts (chart **open-webui**).
|
||||||
# Ingress: Traefik + cert-manager (same pattern as **`clusters/noble/apps/homepage/values.yaml`**).
|
# Ingress: Traefik + cert-manager (same pattern as **`clusters/noble/apps/homepage/values.yaml`**).
|
||||||
#
|
#
|
||||||
# After sync: set an OpenAI-compatible API key (**`openaiApiKey`** below or **`openaiApiKeyExistingSecret`**),
|
# **Secrets** (**`OPENAI_API_KEY`**, **`WEBUI_SECRET_KEY`**, **`OAUTH_CLIENT_SECRET`**) are created in-cluster by
|
||||||
# or enable in-cluster **Ollama** / **Pipelines** in this file. Chart defaults ship a placeholder key — override before use.
|
# **`ansible-playbook … --tags authentik`** as **`open-webui/open-webui-secrets`** (see **noble_authentik** role and **`.env.sample`**).
|
||||||
#
|
# **OIDC** uses Authentik provider slug **`open-webui`** (issuer **`…/application/o/open-webui/`**). Do **not** put ForwardAuth on this Ingress while using native OIDC (same pattern as Headlamp).
|
||||||
# Optional: protect with ForwardAuth like **`clusters/noble/bootstrap/longhorn/values-authentik-forwardauth.yaml`**.
|
# **Public host only** (Pangolin → Newt → Traefik): keep **ingress.host**, **OPENID_PROVIDER_URL**, **OPENID_REDIRECT_URI**, and **WEBUI_URL** in sync with **`noble_open_webui_public_host`** in Ansible **group_vars** (see **noble_authentik** README).
|
||||||
#
|
#
|
||||||
ollama:
|
ollama:
|
||||||
enabled: false
|
enabled: false
|
||||||
@@ -12,7 +12,6 @@ ollama:
|
|||||||
pipelines:
|
pipelines:
|
||||||
enabled: false
|
enabled: false
|
||||||
|
|
||||||
# External Ollama (when not using the subchart), e.g. `http://ollama.ollama.svc.cluster.local:11434`
|
|
||||||
ollamaUrls: []
|
ollamaUrls: []
|
||||||
|
|
||||||
ingress:
|
ingress:
|
||||||
@@ -20,7 +19,7 @@ ingress:
|
|||||||
class: traefik
|
class: traefik
|
||||||
annotations:
|
annotations:
|
||||||
cert-manager.io/cluster-issuer: letsencrypt-prod
|
cert-manager.io/cluster-issuer: letsencrypt-prod
|
||||||
host: open-webui.apps.noble.lab.pcenicni.dev
|
host: webui.nikflix.ca
|
||||||
additionalHosts: []
|
additionalHosts: []
|
||||||
tls: true
|
tls: true
|
||||||
existingSecret: ""
|
existingSecret: ""
|
||||||
@@ -28,8 +27,38 @@ ingress:
|
|||||||
enableOpenaiApi: true
|
enableOpenaiApi: true
|
||||||
openaiBaseApiUrl: "https://api.openai.com/v1"
|
openaiBaseApiUrl: "https://api.openai.com/v1"
|
||||||
openaiApiKey: ""
|
openaiApiKey: ""
|
||||||
# openaiApiKeyExistingSecret: open-webui-openai
|
openaiApiKeyExistingSecret: open-webui-secrets
|
||||||
# openaiApiKeyExistingSecretKey: api-key
|
openaiApiKeyExistingSecretKey: OPENAI_API_KEY
|
||||||
|
|
||||||
|
extraEnvVars:
|
||||||
|
- name: ENABLE_OAUTH_SIGNUP
|
||||||
|
value: "true"
|
||||||
|
- name: OAUTH_MERGE_ACCOUNTS_BY_EMAIL
|
||||||
|
value: "true"
|
||||||
|
- name: OAUTH_PROVIDER_NAME
|
||||||
|
value: "Authentik"
|
||||||
|
- name: OAUTH_CLIENT_ID
|
||||||
|
value: "open-webui"
|
||||||
|
- name: OPENID_PROVIDER_URL
|
||||||
|
value: "https://auth.nikflix.ca/application/o/open-webui/.well-known/openid-configuration"
|
||||||
|
- name: OAUTH_SCOPES
|
||||||
|
value: "openid email profile offline_access"
|
||||||
|
- name: OPENID_REDIRECT_URI
|
||||||
|
value: "https://webui.nikflix.ca/oauth/oidc/callback"
|
||||||
|
- name: WEBUI_URL
|
||||||
|
value: "https://webui.nikflix.ca"
|
||||||
|
- name: ENABLE_OAUTH_PERSISTENT_CONFIG
|
||||||
|
value: "false"
|
||||||
|
- name: WEBUI_SECRET_KEY
|
||||||
|
valueFrom:
|
||||||
|
secretKeyRef:
|
||||||
|
name: open-webui-secrets
|
||||||
|
key: WEBUI_SECRET_KEY
|
||||||
|
- name: OAUTH_CLIENT_SECRET
|
||||||
|
valueFrom:
|
||||||
|
secretKeyRef:
|
||||||
|
name: open-webui-secrets
|
||||||
|
key: OAUTH_CLIENT_SECRET
|
||||||
|
|
||||||
persistence:
|
persistence:
|
||||||
enabled: true
|
enabled: true
|
||||||
|
|||||||
@@ -88,6 +88,26 @@ curl -sS -X PUT -H "Authorization: Bearer ${TOKEN}" -H 'Content-Type: applicatio
|
|||||||
|
|
||||||
Exact JSON fields and IDs differ by domain type (**ns** vs **cname** vs **wildcard**); see [Common API routes](https://docs.pangolin.net/manage/common-api-routes) and Swagger.
|
Exact JSON fields and IDs differ by domain type (**ns** vs **cname** vs **wildcard**); see [Common API routes](https://docs.pangolin.net/manage/common-api-routes) and Swagger.
|
||||||
|
|
||||||
|
## 4. Automate HTTP resources (Integration API + Ansible)
|
||||||
|
|
||||||
|
You still **link domains** in Pangolin and create **CNAME** records at your DNS host manually (Pangolin does not replace your registrar). After that, this repository can **ensure** public **HTTP** resources and **Traefik** targets exist for the same FQDNs you use in GitOps / Ansible:
|
||||||
|
|
||||||
|
- **`noble_authentik_ingress_extra_hosts`** (e.g. **`auth.example.com`**)
|
||||||
|
- **`noble_open_webui_public_host`** when set (e.g. **`webui.example.com`**)
|
||||||
|
- Optional extra list **`noble_pangolin_http_fqdns_extra`** in **`ansible/inventory/group_vars/all.yml`**
|
||||||
|
|
||||||
|
Steps:
|
||||||
|
|
||||||
|
1. In Pangolin, create an **organization API key** with permission to manage domains, resources, and targets ([Integration API](https://docs.pangolin.net/manage/integration-api)).
|
||||||
|
2. Add to repository **`.env`** (never commit secrets): **`NOBLE_PANGOLIN_API_BASE`**, **`NOBLE_PANGOLIN_ORG_ID`**, **`NOBLE_PANGOLIN_API_TOKEN`**, **`NOBLE_PANGOLIN_SITE_ID`** (numeric site that owns your **Newt** pair). Optionally **`NOBLE_PANGOLIN_TRAEFIK_IP`** / **`NOBLE_PANGOLIN_TRAEFIK_PORT`** — if unset, Ansible uses **`kubectl`** to read the Traefik Service **LoadBalancer** IP.
|
||||||
|
3. Set **`noble_pangolin_sync_http_resources: true`** in **`ansible/inventory/group_vars/all.yml`** (or pass **`-e noble_pangolin_sync_http_resources=true`**).
|
||||||
|
4. Run **`ansible-playbook playbooks/noble.yml --tags newt`** (or a full **`noble.yml`**) with **`KUBECONFIG`** pointed at the cluster.
|
||||||
|
|
||||||
|
Implementation: **`clusters/noble/bootstrap/newt/scripts/sync_pangolin_http_resources.py`** (stdlib **Python 3**). Dry run:
|
||||||
|
`python3 clusters/noble/bootstrap/newt/scripts/sync_pangolin_http_resources.py --env-file .env --fqdns auth.example.com,webui.example.com --traefik-ip 192.168.50.211 --dry-run`
|
||||||
|
|
||||||
|
The script matches each FQDN to the **longest** linked **`baseDomain`** in Pangolin, creates the HTTP resource if missing, then adds a **target** (**`siteId`** + Traefik **`ip`:`port`**, **`method`:** **`http`**) if none matches. Pangolin’s API is still evolving — if a call fails, compare with [Swagger](https://api.pangolin.net/v1/docs) for your deployment version.
|
||||||
|
|
||||||
### Authentik on a public name
|
### Authentik on a public name
|
||||||
|
|
||||||
Use **`noble_authentik_ingress_extra_hosts`** (see **`ansible/roles/noble_authentik/README.md`**) so the Authentik Ingress (and **cert-manager** SANs) include your public FQDN, then create the Pangolin **HTTP** resource + **target** to the same Traefik **:443** endpoint as other apps. One Newt site can carry many hostnames.
|
Use **`noble_authentik_ingress_extra_hosts`** (see **`ansible/roles/noble_authentik/README.md`**) so the Authentik Ingress (and **cert-manager** SANs) include your public FQDN, then create the Pangolin **HTTP** resource + **target** to the same Traefik **:443** endpoint as other apps. One Newt site can carry many hostnames.
|
||||||
|
|||||||
Binary file not shown.
331
clusters/noble/bootstrap/newt/scripts/sync_pangolin_http_resources.py
Executable file
331
clusters/noble/bootstrap/newt/scripts/sync_pangolin_http_resources.py
Executable file
@@ -0,0 +1,331 @@
|
|||||||
|
#!/usr/bin/env python3
|
||||||
|
"""
|
||||||
|
Idempotently create Pangolin public HTTP resources + Traefik targets via the Integration API.
|
||||||
|
|
||||||
|
Docs: https://docs.pangolin.net/manage/integration-api
|
||||||
|
Walkthrough: https://docs.pangolin.net/manage/common-api-routes
|
||||||
|
|
||||||
|
Environment (or --env-file) can set:
|
||||||
|
NOBLE_PANGOLIN_API_BASE, NOBLE_PANGOLIN_ORG_ID, NOBLE_PANGOLIN_API_TOKEN,
|
||||||
|
NOBLE_PANGOLIN_SITE_ID, NOBLE_PANGOLIN_TRAEFIK_IP, NOBLE_PANGOLIN_TRAEFIK_PORT (default 443)
|
||||||
|
|
||||||
|
CLI overrides env. FQDNs: --fqdns a.example.com,b.example.com (required).
|
||||||
|
"""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import json
|
||||||
|
import os
|
||||||
|
import sys
|
||||||
|
import urllib.error
|
||||||
|
import urllib.request
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
|
def load_dotenv(path: str) -> dict[str, str]:
|
||||||
|
out: dict[str, str] = {}
|
||||||
|
with open(path, encoding="utf-8") as f:
|
||||||
|
for raw in f:
|
||||||
|
line = raw.strip()
|
||||||
|
if not line or line.startswith("#"):
|
||||||
|
continue
|
||||||
|
if "=" not in line:
|
||||||
|
continue
|
||||||
|
k, v = line.split("=", 1)
|
||||||
|
k = k.strip()
|
||||||
|
v = v.strip().strip('"').strip("'")
|
||||||
|
if k:
|
||||||
|
out[k] = v
|
||||||
|
return out
|
||||||
|
|
||||||
|
|
||||||
|
def api_request(
|
||||||
|
method: str,
|
||||||
|
url: str,
|
||||||
|
token: str,
|
||||||
|
body: dict[str, Any] | None = None,
|
||||||
|
) -> dict[str, Any]:
|
||||||
|
data = None if body is None else json.dumps(body).encode("utf-8")
|
||||||
|
req = urllib.request.Request(
|
||||||
|
url,
|
||||||
|
data=data,
|
||||||
|
method=method,
|
||||||
|
headers={
|
||||||
|
"Authorization": f"Bearer {token}",
|
||||||
|
"Accept": "application/json",
|
||||||
|
**({"Content-Type": "application/json"} if body is not None else {}),
|
||||||
|
},
|
||||||
|
)
|
||||||
|
try:
|
||||||
|
with urllib.request.urlopen(req, timeout=120) as resp:
|
||||||
|
payload = resp.read().decode("utf-8")
|
||||||
|
except urllib.error.HTTPError as e:
|
||||||
|
detail = e.read().decode("utf-8", errors="replace")
|
||||||
|
raise SystemExit(f"HTTP {e.code} {method} {url}\n{detail}") from e
|
||||||
|
if not payload:
|
||||||
|
return {}
|
||||||
|
return json.loads(payload)
|
||||||
|
|
||||||
|
|
||||||
|
def unwrap(resp: dict[str, Any]) -> Any:
|
||||||
|
if resp.get("error") or resp.get("success") is False:
|
||||||
|
raise SystemExit(f"Pangolin API error: {resp!r}")
|
||||||
|
return resp.get("data")
|
||||||
|
|
||||||
|
|
||||||
|
def normalize_fqdn(s: str) -> str:
|
||||||
|
return s.lower().strip().rstrip(".")
|
||||||
|
|
||||||
|
|
||||||
|
def resolve_domain(
|
||||||
|
fqdn: str, domains: list[dict[str, Any]]
|
||||||
|
) -> tuple[str, str | None]:
|
||||||
|
"""Return (domainId, subdomain) for an HTTP resource. subdomain is None for apex / cname-only domains."""
|
||||||
|
fqdn = normalize_fqdn(fqdn)
|
||||||
|
best: tuple[str, str | None, int] | None = None
|
||||||
|
for d in domains:
|
||||||
|
bd = (d.get("baseDomain") or "").strip()
|
||||||
|
if not bd:
|
||||||
|
continue
|
||||||
|
bd_n = normalize_fqdn(bd)
|
||||||
|
if fqdn == bd_n:
|
||||||
|
cand = (str(d["domainId"]), None, len(bd_n))
|
||||||
|
elif fqdn.endswith("." + bd_n):
|
||||||
|
sub = fqdn[: -(len(bd_n) + 1)]
|
||||||
|
if not sub:
|
||||||
|
continue
|
||||||
|
cand = (str(d["domainId"]), sub, len(bd_n))
|
||||||
|
else:
|
||||||
|
continue
|
||||||
|
if best is None or cand[2] > best[2]:
|
||||||
|
best = cand
|
||||||
|
if best is None:
|
||||||
|
avail = ", ".join(sorted({normalize_fqdn(d.get("baseDomain") or "") for d in domains if d.get("baseDomain")}))
|
||||||
|
raise SystemExit(
|
||||||
|
f"No linked Pangolin domain matches FQDN {fqdn!r}. "
|
||||||
|
f"Link the parent domain in Pangolin first. Known baseDomain values: {avail or '(none)'}"
|
||||||
|
)
|
||||||
|
return best[0], best[1]
|
||||||
|
|
||||||
|
|
||||||
|
def list_all_resources(api_base: str, org_id: str, token: str) -> list[dict[str, Any]]:
|
||||||
|
out: list[dict[str, Any]] = []
|
||||||
|
page = 1
|
||||||
|
page_size = 100
|
||||||
|
while True:
|
||||||
|
url = f"{api_base.rstrip('/')}/org/{org_id}/resources?page={page}&pageSize={page_size}"
|
||||||
|
data = unwrap(api_request("GET", url, token))
|
||||||
|
if isinstance(data, list):
|
||||||
|
out.extend(data)
|
||||||
|
break
|
||||||
|
if not isinstance(data, dict):
|
||||||
|
break
|
||||||
|
batch = data.get("resources") or data.get("items") or []
|
||||||
|
if not isinstance(batch, list):
|
||||||
|
break
|
||||||
|
out.extend(batch)
|
||||||
|
pag = data.get("pagination") or {}
|
||||||
|
total = pag.get("total")
|
||||||
|
if isinstance(total, int) and len(out) >= total:
|
||||||
|
break
|
||||||
|
if len(batch) < page_size:
|
||||||
|
break
|
||||||
|
page += 1
|
||||||
|
if page > 500:
|
||||||
|
raise SystemExit("Pagination safety stop (>500 pages)")
|
||||||
|
return out
|
||||||
|
|
||||||
|
|
||||||
|
def resource_public_fqdn(res: dict[str, Any]) -> str | None:
|
||||||
|
fd = res.get("fullDomain")
|
||||||
|
if isinstance(fd, str) and fd.strip():
|
||||||
|
return normalize_fqdn(fd)
|
||||||
|
sub = res.get("subdomain")
|
||||||
|
dom = res.get("domain") or {}
|
||||||
|
bd = dom.get("baseDomain") if isinstance(dom, dict) else None
|
||||||
|
if isinstance(bd, str) and bd.strip():
|
||||||
|
bd_n = normalize_fqdn(bd)
|
||||||
|
if sub is None or sub == "":
|
||||||
|
return bd_n
|
||||||
|
if isinstance(sub, str):
|
||||||
|
return normalize_fqdn(f"{sub}.{bd_n}")
|
||||||
|
return None
|
||||||
|
|
||||||
|
|
||||||
|
def find_resource_for_fqdn(resources: list[dict[str, Any]], fqdn: str) -> dict[str, Any] | None:
|
||||||
|
target = normalize_fqdn(fqdn)
|
||||||
|
for r in resources:
|
||||||
|
if not r.get("http"):
|
||||||
|
continue
|
||||||
|
got = resource_public_fqdn(r)
|
||||||
|
if got == target:
|
||||||
|
return r
|
||||||
|
return None
|
||||||
|
|
||||||
|
|
||||||
|
def list_targets(api_base: str, resource_id: int, token: str) -> list[dict[str, Any]]:
|
||||||
|
url = f"{api_base.rstrip('/')}/resource/{resource_id}/targets"
|
||||||
|
data = unwrap(api_request("GET", url, token))
|
||||||
|
if isinstance(data, list):
|
||||||
|
return data
|
||||||
|
if isinstance(data, dict):
|
||||||
|
return data.get("targets") or data.get("items") or []
|
||||||
|
return []
|
||||||
|
|
||||||
|
|
||||||
|
def target_matches(t: dict[str, Any], site_id: int, ip: str, port: int) -> bool:
|
||||||
|
return (
|
||||||
|
int(t.get("siteId") or 0) == site_id
|
||||||
|
and str(t.get("ip") or "") == ip
|
||||||
|
and int(t.get("port") or 0) == port
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
ap = argparse.ArgumentParser(description=__doc__)
|
||||||
|
ap.add_argument("--env-file", help="Parse KEY=value lines (optional overrides for env)")
|
||||||
|
ap.add_argument("--api-base", default=os.environ.get("NOBLE_PANGOLIN_API_BASE", ""))
|
||||||
|
ap.add_argument("--org-id", default=os.environ.get("NOBLE_PANGOLIN_ORG_ID", ""))
|
||||||
|
ap.add_argument("--token", default=os.environ.get("NOBLE_PANGOLIN_API_TOKEN", ""))
|
||||||
|
ap.add_argument("--site-id", default=os.environ.get("NOBLE_PANGOLIN_SITE_ID", ""))
|
||||||
|
ap.add_argument("--traefik-ip", default=os.environ.get("NOBLE_PANGOLIN_TRAEFIK_IP", ""))
|
||||||
|
ap.add_argument(
|
||||||
|
"--traefik-port",
|
||||||
|
type=int,
|
||||||
|
default=int(os.environ.get("NOBLE_PANGOLIN_TRAEFIK_PORT", "443") or 443),
|
||||||
|
)
|
||||||
|
ap.add_argument(
|
||||||
|
"--fqdns",
|
||||||
|
required=True,
|
||||||
|
help="Comma-separated public FQDNs (must match linked Pangolin domains / SANs)",
|
||||||
|
)
|
||||||
|
ap.add_argument(
|
||||||
|
"--dry-run",
|
||||||
|
action="store_true",
|
||||||
|
help="Print actions only; do not call mutating endpoints",
|
||||||
|
)
|
||||||
|
args = ap.parse_args()
|
||||||
|
|
||||||
|
if args.env_file:
|
||||||
|
for k, v in load_dotenv(args.env_file).items():
|
||||||
|
if k.startswith("NOBLE_PANGOLIN_"):
|
||||||
|
os.environ.setdefault(k, v)
|
||||||
|
args.api_base = args.api_base or os.environ.get("NOBLE_PANGOLIN_API_BASE", "")
|
||||||
|
args.org_id = args.org_id or os.environ.get("NOBLE_PANGOLIN_ORG_ID", "")
|
||||||
|
args.token = args.token or os.environ.get("NOBLE_PANGOLIN_API_TOKEN", "")
|
||||||
|
args.site_id = args.site_id or os.environ.get("NOBLE_PANGOLIN_SITE_ID", "")
|
||||||
|
args.traefik_ip = args.traefik_ip or os.environ.get("NOBLE_PANGOLIN_TRAEFIK_IP", "")
|
||||||
|
|
||||||
|
missing = [
|
||||||
|
n
|
||||||
|
for n, v in [
|
||||||
|
("NOBLE_PANGOLIN_API_BASE", args.api_base),
|
||||||
|
("NOBLE_PANGOLIN_ORG_ID", args.org_id),
|
||||||
|
("NOBLE_PANGOLIN_API_TOKEN", args.token),
|
||||||
|
("NOBLE_PANGOLIN_SITE_ID", args.site_id),
|
||||||
|
("NOBLE_PANGOLIN_TRAEFIK_IP", args.traefik_ip),
|
||||||
|
]
|
||||||
|
if not str(v).strip()
|
||||||
|
]
|
||||||
|
if missing:
|
||||||
|
raise SystemExit(f"Missing required settings: {', '.join(missing)}")
|
||||||
|
|
||||||
|
fqdns = [normalize_fqdn(x) for x in args.fqdns.split(",") if x.strip()]
|
||||||
|
if not fqdns:
|
||||||
|
raise SystemExit("No FQDNs in --fqdns")
|
||||||
|
|
||||||
|
api_base = str(args.api_base).rstrip("/")
|
||||||
|
org_id = str(args.org_id).strip()
|
||||||
|
token = str(args.token).strip()
|
||||||
|
site_id = int(str(args.site_id).strip())
|
||||||
|
traefik_ip = str(args.traefik_ip).strip()
|
||||||
|
traefik_port = int(args.traefik_port)
|
||||||
|
|
||||||
|
dom_url = f"{api_base}/org/{org_id}/domains"
|
||||||
|
domains_raw = unwrap(api_request("GET", dom_url, token))
|
||||||
|
domains: list[dict[str, Any]] = []
|
||||||
|
if isinstance(domains_raw, list):
|
||||||
|
domains = domains_raw
|
||||||
|
elif isinstance(domains_raw, dict):
|
||||||
|
domains = domains_raw.get("domains") or []
|
||||||
|
if not isinstance(domains, list):
|
||||||
|
raise SystemExit(f"Unexpected domains response: {domains_raw!r}")
|
||||||
|
|
||||||
|
resources = list_all_resources(api_base, org_id, token)
|
||||||
|
|
||||||
|
for fqdn in fqdns:
|
||||||
|
domain_id, subdomain = resolve_domain(fqdn, domains)
|
||||||
|
res = find_resource_for_fqdn(resources, fqdn)
|
||||||
|
if res is None:
|
||||||
|
body = {
|
||||||
|
"name": f"noble {fqdn}",
|
||||||
|
"http": True,
|
||||||
|
"protocol": "tcp",
|
||||||
|
"domainId": domain_id,
|
||||||
|
**({"subdomain": subdomain} if subdomain is not None else {"subdomain": None}),
|
||||||
|
}
|
||||||
|
print(f"[create] resource {fqdn!r} domainId={domain_id} subdomain={subdomain!r}")
|
||||||
|
if args.dry_run:
|
||||||
|
continue
|
||||||
|
created = unwrap(
|
||||||
|
api_request(
|
||||||
|
"PUT",
|
||||||
|
f"{api_base}/org/{org_id}/resource",
|
||||||
|
token,
|
||||||
|
body,
|
||||||
|
)
|
||||||
|
)
|
||||||
|
rid = int(str(created.get("resourceId", "")).strip() or 0)
|
||||||
|
if not rid:
|
||||||
|
raise SystemExit(f"Create resource response missing resourceId: {created!r}")
|
||||||
|
print(f" -> resourceId={rid}")
|
||||||
|
resources.append(
|
||||||
|
{
|
||||||
|
"resourceId": rid,
|
||||||
|
"http": True,
|
||||||
|
"fullDomain": fqdn,
|
||||||
|
"subdomain": subdomain,
|
||||||
|
}
|
||||||
|
)
|
||||||
|
res = find_resource_for_fqdn(resources, fqdn)
|
||||||
|
else:
|
||||||
|
rid = int(str(res.get("resourceId", "")).strip() or 0)
|
||||||
|
if not rid:
|
||||||
|
raise SystemExit(f"Resource missing resourceId: {res!r}")
|
||||||
|
print(f"[exists] resource {fqdn!r} resourceId={rid}")
|
||||||
|
|
||||||
|
if res is None:
|
||||||
|
raise SystemExit("internal: resource missing after create")
|
||||||
|
rid = int(str(res.get("resourceId", "")).strip() or 0)
|
||||||
|
if not rid:
|
||||||
|
raise SystemExit(f"Resource missing resourceId: {res!r}")
|
||||||
|
|
||||||
|
targets = list_targets(api_base, rid, token)
|
||||||
|
if any(target_matches(t, site_id, traefik_ip, traefik_port) for t in targets):
|
||||||
|
print(f" -> target OK site={site_id} {traefik_ip}:{traefik_port}")
|
||||||
|
continue
|
||||||
|
tbody = {
|
||||||
|
"siteId": site_id,
|
||||||
|
"ip": traefik_ip,
|
||||||
|
"port": traefik_port,
|
||||||
|
"method": "http",
|
||||||
|
}
|
||||||
|
print(f"[target] PUT /resource/{rid}/target {tbody}")
|
||||||
|
if args.dry_run:
|
||||||
|
continue
|
||||||
|
api_request(
|
||||||
|
"PUT",
|
||||||
|
f"{api_base}/resource/{rid}/target",
|
||||||
|
token,
|
||||||
|
tbody,
|
||||||
|
)
|
||||||
|
print(" -> target created")
|
||||||
|
|
||||||
|
print("Done.")
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
try:
|
||||||
|
main()
|
||||||
|
except KeyboardInterrupt:
|
||||||
|
sys.exit(130)
|
||||||
Reference in New Issue
Block a user