Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Argo App of Apps for Kubeflow monitoring #60

Open
wants to merge 75 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
75 commits
Select commit Hold shift + click to select a range
a2835b4
adds new team yoda
arunvthangaraj May 11, 2024
812532f
updates team yoda dev kustomization file
arunvthangaraj May 11, 2024
c903c6b
correct apiversion of kustomization file for team yoda dev
arunvthangaraj May 11, 2024
78db292
reverts back kustomization changes for team yoda
arunvthangaraj May 11, 2024
8e26e2e
delete kustomization for team yoda
arunvthangaraj May 12, 2024
73524b3
udates templates
arunvthangaraj May 12, 2024
8eb44b7
updates templates
arunvthangaraj May 12, 2024
112879e
use kustomized-helm plugin
arunvthangaraj May 13, 2024
789734b
updates templates
arunvthangaraj May 13, 2024
497feaf
updates kustomization
arunvthangaraj May 14, 2024
1666a9f
add kustomize folder
arunvthangaraj May 14, 2024
49f9968
updates templates
arunvthangaraj May 14, 2024
2dc5b93
adds dex
arunvthangaraj May 14, 2024
340c927
updates templates
arunvthangaraj May 14, 2024
6524946
updates templates
arunvthangaraj May 14, 2024
44a20c3
remove kustomize ref from values file
arunvthangaraj May 14, 2024
b407ff0
only use kustomization for team yoda
arunvthangaraj May 15, 2024
56c20ab
adds oidc-authservice
arunvthangaraj May 16, 2024
07c8634
adds app of apps for kubeflow monitoring
arunvthangaraj May 16, 2024
c200178
force delete charts for kubeflow-monitoring
arunvthangaraj May 16, 2024
7f647bb
adds back charts for kubeflow monitoring
arunvthangaraj May 16, 2024
4572354
updates values files for kubeflow monitoring
arunvthangaraj May 16, 2024
dd89b99
fixes ns in kubeflow-monitoring templates
arunvthangaraj May 16, 2024
a7a2d3d
updates apps to sync from upstream kubeflow repo
arunvthangaraj May 17, 2024
da753e5
move around files and restructure folder
arunvthangaraj May 17, 2024
673ffd7
uses patches instead of patchesStrategicMerge
arunvthangaraj May 17, 2024
a951898
updates kustomization and patch files
arunvthangaraj May 17, 2024
1d385cc
updates overlay kustomization for all envs
arunvthangaraj May 17, 2024
aae9fb9
updates patch files for all envs for team-yoda
arunvthangaraj May 17, 2024
d42f579
updates prod overlay for team-yoda
arunvthangaraj May 19, 2024
78a036b
installs istio using kubeflow upstream repo
arunvthangaraj May 19, 2024
75c52f3
fixes kustomization for team yoda
arunvthangaraj May 19, 2024
5daaac4
adds kubeflow-issuer
arunvthangaraj May 19, 2024
9c4fff2
adds kubeflow issuer to kustomization
arunvthangaraj May 19, 2024
1c72775
adds apps for knative serving, eventing and kserve
arunvthangaraj May 29, 2024
d21515d
installs kserve from upstream repo
arunvthangaraj May 29, 2024
1a9cac7
install from upstream v1.8.1
arunvthangaraj May 29, 2024
eb37437
adds models web app
arunvthangaraj May 29, 2024
6e6c2d8
fixes file name for models web app
arunvthangaraj May 29, 2024
4c668c1
adds central-dashboard
arunvthangaraj May 29, 2024
0610fbf
updates namespace for central-dashboard config map
arunvthangaraj May 29, 2024
2b5a562
fixes central dashboard config
arunvthangaraj May 29, 2024
cac16ea
adds kubeflow pipeline
arunvthangaraj May 29, 2024
77f9e42
adds admission web hook
arunvthangaraj May 29, 2024
f51b859
attempts to install central dashboard from a in repo kustomization
arunvthangaraj May 30, 2024
41d844e
adds jupyter web app
arunvthangaraj May 30, 2024
7dcd964
adds notebook controller
arunvthangaraj May 30, 2024
24eae2d
adds volumes web app
arunvthangaraj May 30, 2024
62188e7
adds training operator
arunvthangaraj May 30, 2024
37a0dba
adds katib
arunvthangaraj May 30, 2024
a5c026b
adds tensorboards web app
arunvthangaraj May 30, 2024
d906253
adds tensorboard controller
arunvthangaraj May 30, 2024
6892f9f
adds profiles and kfam
arunvthangaraj May 30, 2024
e30e0bd
adds user namespace
arunvthangaraj May 30, 2024
de64513
adds ack sagemaker controller
arunvthangaraj May 30, 2024
dfca8a7
attempts to fix sync error with pipeline argo app
arunvthangaraj May 30, 2024
c10e551
adds app to mount token for notebook
arunvthangaraj May 30, 2024
2c43654
Changes to move apps to aws-observability-accelerator
arunvthangaraj Jun 5, 2024
5e390bf
attempts to install v1.9.0-rc.1
arunvthangaraj Jun 12, 2024
ca378d4
revert back to version 1.8.1
arunvthangaraj Jun 12, 2024
476bd1c
adds argo config map to kubeflow monitoring
arunvthangaraj Jun 13, 2024
1f50912
adds argo sync wave for apps
arunvthangaraj Jun 13, 2024
71cb7aa
updates path for oidc auth service
arunvthangaraj Jun 13, 2024
13682f4
updates argoConfig to a helm chart
arunvthangaraj Jun 13, 2024
b27b99e
adds values.yaml file for argo config
arunvthangaraj Jun 13, 2024
242b54d
fixes typo in file name
arunvthangaraj Jun 13, 2024
427a69f
removes argoConfig map chart
arunvthangaraj Jun 15, 2024
f81f042
attempts to use kubeflow version 1.7.0
arunvthangaraj Jul 17, 2024
4901f28
attempts to use version 1.8.0
arunvthangaraj Jul 17, 2024
107d96b
use kubeflow 1.7.0
arunvthangaraj Jul 18, 2024
9610907
updates oidc auth service path
arunvthangaraj Jul 18, 2024
84270f8
use v1.8.0 just for knative-serving
arunvthangaraj Jul 18, 2024
30ac50c
attempts to use version 1.8.0
arunvthangaraj Jul 18, 2024
e6d77a4
updates oidc path and reverts back to 1.7.0
arunvthangaraj Jul 18, 2024
ea4ec25
move upstream apps from aws-observability-accelator repo
arunvthangaraj Jul 22, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions kubeflow-monitoring/envs/dev/Chart.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
apiVersion: v1
appVersion: "1.0"
name: kubeflow-monitoring-dev-applications
description: App of apps chart for the dev EKS kubeflow monitoring.
version: 0.1.0
21 changes: 21 additions & 0 deletions kubeflow-monitoring/envs/dev/templates/team-yoda.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
name: kubeflow
namespace: argocd
finalizers:
- resources-finalizer.argocd.argoproj.io
spec:
project: default
destination:
namespace: argocd
server: {{ .Values.spec.destination.server }}
source:
repoURL: {{ .Values.spec.source.repoURL }}
targetRevision: {{ .Values.spec.source.targetRevision }}
path: teams/team-yoda/kustomize/overlays/dev
syncPolicy:
automated:
prune: true
selfHeal: true
allowEmpty: false
6 changes: 6 additions & 0 deletions kubeflow-monitoring/envs/dev/values.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
spec:
destination:
server: https://kubernetes.default.svc
source:
repoURL: https://github.com/arunvthangaraj/eks-blueprints-workloads.git
targetRevision: main
5 changes: 5 additions & 0 deletions kubeflow-monitoring/envs/prod/Chart.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
apiVersion: v1
appVersion: "1.0"
name: kubeflow-monitoring-prod-applications
description: App of apps chart for the prod EKS kubeflow monitoring.
version: 0.1.0
21 changes: 21 additions & 0 deletions kubeflow-monitoring/envs/prod/templates/team-yoda.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
name: kubeflow
namespace: argocd
finalizers:
- resources-finalizer.argocd.argoproj.io
spec:
project: default
destination:
namespace: argocd
server: {{ .Values.spec.destination.server }}
source:
repoURL: {{ .Values.spec.source.repoURL }}
targetRevision: {{ .Values.spec.source.targetRevision }}
path: teams/team-yoda/kustomize/overlays/prod
syncPolicy:
automated:
prune: true
selfHeal: true
allowEmpty: false
6 changes: 6 additions & 0 deletions kubeflow-monitoring/envs/prod/values.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
spec:
destination:
server: https://kubernetes.default.svc
source:
repoURL: https://github.com/arunvthangaraj/eks-blueprints-workloads.git
targetRevision: main
5 changes: 5 additions & 0 deletions kubeflow-monitoring/envs/test/Chart.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
apiVersion: v1
appVersion: "1.0"
name: kubeflow-monitoring-test-applications
description: App of apps chart for the test EKS kubeflow monitoring.
version: 0.1.0
21 changes: 21 additions & 0 deletions kubeflow-monitoring/envs/test/templates/team-yoda.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
name: kubeflow
namespace: argocd
finalizers:
- resources-finalizer.argocd.argoproj.io
spec:
project: default
destination:
namespace: argocd
server: {{ .Values.spec.destination.server }}
source:
repoURL: {{ .Values.spec.source.repoURL }}
targetRevision: {{ .Values.spec.source.targetRevision }}
path: teams/team-yoda/kustomize/overlays/test
syncPolicy:
automated:
prune: true
selfHeal: true
allowEmpty: false
6 changes: 6 additions & 0 deletions kubeflow-monitoring/envs/test/values.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
spec:
destination:
server: https://kubernetes.default.svc
source:
repoURL: https://github.com/arunvthangaraj/eks-blueprints-workloads.git
targetRevision: main
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
resources:
- github.com/kubeflow/manifests/apps/centraldashboard/upstream/overlays/istio?ref=v1.8.1

patches:
- path: patches/configMapPatch.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,131 @@
apiVersion: v1
data:
settings: |-
{
"DASHBOARD_FORCE_IFRAME": true
}
links: |-
{
"menuLinks": [
{
"type": "item",
"link": "/jupyter/",
"text": "Notebooks",
"icon": "book"
},
{
"type": "item",
"link": "/tensorboards/",
"text": "Tensorboards",
"icon": "assessment"
},
{
"type": "item",
"link": "/volumes/",
"text": "Volumes",
"icon": "device:storage"
},
{
"type": "item",
"link": "/kserve-endpoints/",
"text": "Models",
"icon": "kubeflow:models"
},
{
"type": "item",
"link": "/katib/",
"text": "Experiments (AutoML)",
"icon": "kubeflow:katib"
},
{
"type": "item",
"text": "Experiments (KFP)",
"link": "/pipeline/#/experiments",
"icon": "done-all"
},
{
"type": "item",
"link": "/pipeline/#/pipelines",
"text": "Pipelines",
"icon": "kubeflow:pipeline-centered"
},
{
"type": "item",
"link": "/pipeline/#/runs",
"text": "Runs",
"icon": "maps:directions-run"
},
{
"type": "item",
"link": "/pipeline/#/recurringruns",
"text": "Recurring Runs",
"icon": "device:access-alarm"
},
{
"type": "item",
"link": "/pipeline/#/artifacts",
"text": "Artifacts",
"icon": "editor:bubble-chart"
},
{
"type": "item",
"link": "/pipeline/#/executions",
"text": "Executions",
"icon": "av:play-arrow"
}
],
"externalLinks": [ ],
"quickLinks": [
{
"text": "Upload a pipeline",
"desc": "Pipelines",
"link": "/pipeline/"
},
{
"text": "View all pipeline runs",
"desc": "Pipelines",
"link": "/pipeline/#/runs"
},
{
"text": "Create a new Notebook server",
"desc": "Notebook Servers",
"link": "/jupyter/new?namespace=kubeflow"
},
{
"text": "View Katib Experiments",
"desc": "Katib",
"link": "/katib/"
}
],
"documentationItems": [
{
"text": "Getting Started with Kubeflow",
"desc": "Get your machine-learning workflow up and running on Kubeflow",
"link": "https://www.kubeflow.org/docs/started/getting-started/"
},
{
"text": "Kubeflow on AWS",
"desc": "Running Kubeflow on Amazon Elastic Kubernetes Service (Amazon EKS) and Amazon Web Services",
"link": "https://www.kubeflow.org/docs/aws/"
},
{
"text": "Amazon SageMaker Components for Kubeflow Pipelines",
"desc": "Create Machine Learning workflows to run on Amazon SageMaker from Kubeflow Pipelines",
"link": "https://awslabs.github.io/kubeflow-manifests/docs/amazon-sagemaker-integration/sagemaker-components-for-kubeflow-pipelines"
},
{
"text": "Amazon SageMaker Operator for Kubernetes (ACK)",
"desc": "Use SageMaker Operators for Kubernetes (ACK) to manage your SageMaker resources from your Kubernetes cluster directly",
"link": "https://awslabs.github.io/kubeflow-manifests/docs/amazon-sagemaker-integration/sagemaker-operators-ack"
},
{
"text": "Requirements for Kubeflow",
"desc": "Get more detailed information about using Kubeflow and its components",
"link": "https://www.kubeflow.org/docs/started/requirements/"
}
]
}
kind: ConfigMap
metadata:
name: centraldashboard-config
namespace: kubeflow
Loading