📖 Update docs/README.md with beta clusterctl setup #105

jichenjc · 2021-06-09T09:29:49Z

follow this https://github.com/kubernetes-sigs/cluster-api-provider-nested/tree/main/docs (latest code)

and seems the control pane not startup correctly

kubectl logs capn-nested-control-plane-controller-manager-7fcc8c7bd5-k2wtk -n capn-nested-control-plane-system -c manager


E0609 09:09:54.667549       1 nestedcontrollermanager_controller.go:108] controllers/controlplane/NestedControllerManager "msg"="fail to create NestedControllerManager StatefulSet" "error"="fail to generate the Statefulset object: fail to fetch the default template for the NestedControllerManager StatefulSet: open /component-templates/nested-controllermanager/nested-controllermanager-statefulset-template.yaml: permission denied" "nestedcontrollermanager"={"Namespace":"default","Name":"nestedcontrollermanager-sample"}
E0609 09:09:58.042221       1 nestedapiserver_controller.go:117] controllers/controlplane/NestedAPIServer "msg"="fail to create NestedAPIServer StatefulSet" "error"="fail to generate the Statefulset object: fail to fetch the default template for the NestedAPIServer StatefulSet: open /component-templates/nested-apiserver/nested-apiserver-statefulset-template.yaml: permission denied" "nestedapiserver"={"Namespace":"default","Name":"nestedapiserver-sample"}
E0609 09:10:02.748178       1 nestedetcd_controller.go:119] controllers/controlplane/NestedEtcd "msg"="fail to create NestedEtcd StatefulSet" "error"="fail to generate the Statefulset object: fail to fetch the default template for the NestedEtcd StatefulSet: open /component-templates/nested-etcd/nested-etcd-statefulset-template.yaml: permission denied" "nestedetcd"={"Namespace":"default","Name":"nestedetcd-sample"}

any guide in fixing this? thanks

The text was updated successfully, but these errors were encountered:

christopherhein · 2021-06-09T16:20:38Z

Looks like somewhere the RBAC role aren't being generated properly anymore. I would check to see if the code still has the proper // +kubebuilder go comments on the controlplane/nested/controllers/ directory. This should declare that a statefulset permission is needed.

christopherhein · 2021-06-09T16:20:48Z

/kind bug

christopherhein · 2021-06-09T16:21:32Z

/retitle 🐛 Permission Errors trying to create StatefulSet from NCP

christopherhein · 2021-06-09T21:35:12Z

/assign

christopherhein · 2021-06-09T21:35:57Z

It appears this happens because we don't have the serviceAccountName in the Deployment specs as I'm currently doing #61 and experiencing the same issue.

jichenjc · 2021-06-10T05:56:40Z

/reopen

@christopherhein thanks for the PR, however, I updated to latest code , follow the same doc and still get same issue , I am trying to manually apply the rbac and got following
"config/rbac/service_account.yaml": namespaces "system" not found
which makes me curious seems there is no system ns defined at all?

k8s-ci-robot · 2021-06-10T05:56:43Z

@jichenjc: Reopened this issue.

In response to this:

/reopen

@christopherhein thanks for the PR, however, I updated and still get same issue , I am trying to

manually apply the rbac and got following
"config/rbac/service_account.yaml": namespaces "system" not found
which makes me curious seems there is no system ns defined at all?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

christopherhein · 2021-06-10T06:02:58Z

@jichenjc thanks for reopening. Use case wise if I changed this doc to be the published prod images instead of you needing to generate those images from scratch would that suffice for your use case or are you looking for developer docs?

I think we need both but I'm actively working on #54 and which will make this doc even lighter along with that we have published images and manifests as of today. So if you want to just get a working example you can download https://github.com/kubernetes-sigs/cluster-api-provider-nested/releases/download/v0.1.0/cluster-api-provider-nested-components.yaml and apply that to get the CAPN bits deployed and as of today you can download the v0.4 clusterctl binary so that could be updated.

jichenjc · 2021-06-10T06:32:19Z

@jichenjc thanks for reopening. Use case wise if I changed this doc to be the published prod images instead of you needing to generate those images from scratch would that suffice for your use case or are you looking for developer docs?

I think we need both but I'm actively working on #54 and which will make this doc even lighter along with that we have published images and manifests as of today. So if you want to just get a working example you can download https://github.com/kubernetes-sigs/cluster-api-provider-nested/releases/download/v0.1.0/cluster-api-provider-nested-components.yaml and apply that to get the CAPN bits deployed and as of today you can download the v0.4 clusterctl binary so that could be updated.

thanks for the detailed info , appreciate~
I will re-try based on your comments and get back here, thanks

christopherhein · 2021-06-10T17:32:47Z

Hopefully that all worked for you, we just merged kubernetes-sigs/cluster-api#4792 so if you want we can repivot this issue to be about updating the docs/README.md to use the published deployment route, wdyt?

jichenjc · 2021-06-11T13:25:53Z

Thanks for the info, will validate with more tries later on ,currently having following error and will retry after clean up env

# clusterctl init --core cluster-api:v0.4.0-beta.0  --control-plane nested:v0.1.0  --infrastructure nested:v0.1.0 -v 66
No default config file available
Fetching providers
Fetching File="core-components.yaml" Provider="cluster-api" Type="CoreProvider" Version="v0.4.0-beta.0"
Fetching File="bootstrap-components.yaml" Provider="kubeadm" Type="BootstrapProvider" Version="v0.3.19"
Fetching File="control-plane-components.yaml" Provider="nested" Type="ControlPlaneProvider" Version="v0.1.0"
Fetching File="infrastructure-components.yaml" Provider="nested" Type="InfrastructureProvider" Version="v0.1.0"
Fetching File="metadata.yaml" Provider="cluster-api" Type="CoreProvider" Version="v0.4.0-beta.0"
Fetching File="metadata.yaml" Provider="kubeadm" Type="BootstrapProvider" Version="v0.3.19"
Error: current version of clusterctl could install only v1alpha4 providers, detected v1alpha3 for provider bootstrap-kubeadm
sigs.k8s.io/cluster-api/cmd/clusterctl/client/cluster.(*providerInstaller).getProviderContract
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/client/cluster/installer.go:177
sigs.k8s.io/cluster-api/cmd/clusterctl/client/cluster.(*providerInstaller).Validate
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/client/cluster/installer.go:129
sigs.k8s.io/cluster-api/cmd/clusterctl/client.(*clusterctlClient).Init
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/client/init.go:102
sigs.k8s.io/cluster-api/cmd/clusterctl/cmd.runInit
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/cmd/init.go:139
sigs.k8s.io/cluster-api/cmd/clusterctl/cmd.glob..func11
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/cmd/init.go:84
github.com/spf13/cobra.(*Command).execute
        /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:852
github.com/spf13/cobra.(*Command).ExecuteC
        /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:960
github.com/spf13/cobra.(*Command).Execute
        /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:897
sigs.k8s.io/cluster-api/cmd/clusterctl/cmd.Execute
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/cmd/root.go:93
main.main
        /root/cluster-api-provider-nested/cluster-api/cmd/clusterctl/main.go:25
runtime.main
        /usr/local/go/src/runtime/proc.go:225
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1371

christopherhein · 2021-06-11T16:16:34Z

Since 0.4.0 isn't fully released try adding this file:

→ cat ~/.cluster-api/dev-repository/config.yaml
---
providers:
- name: "cluster-api"
  url: "https://github.com/kubernetes-sigs/cluster-api/releases/v0.4.0-beta.0/core-components.yaml"
  type: "CoreProvider"
- name: "kubeadm"
  url: "https://github.com/kubernetes-sigs/cluster-api/releases/v0.4.0-beta.0/bootstrap-components.yaml"
  type: "BootstrapProvider"

And then try using:

→ clusterctl init --core cluster-api:v0.4.0-beta.0  --control-plane nested:v0.1.0  --infrastructure nested:v0.1.0 --config ~/.cluster-api/dev-repository/config.yaml

Also, this route still needs to be build off main for CAPI.

If that doesn't work check out https://cluster-api.sigs.k8s.io/clusterctl/developers.html to see if there are more steps missing. I was able to as long as I added the v0.4.0 binaries to the dev-repository/config.

@vincepri potentially you have a better way of using v0.4.0 binaries for CAPI from clusterctl.

christopherhein · 2021-06-12T15:35:08Z

/retitle 📖 Update docs/README.md with beta clusterctl setup

christopherhein · 2021-06-12T15:35:33Z

/unassign

christopherhein · 2021-06-12T15:55:11Z

This should be much easier now:

# Create Cluster
kind create cluster --name=capn

# Get unreleased clusterctl
git clone [email protected]:kubernetes-sigs/cluster-api.git
cd cluster-api
make clusterctl

# Create Dev Repo
mkdir -p ~/.cluster-api/dev-repository/

# Update config for CAPI Beta
cat <<EOF >>~/.cluster-api/dev-repository/config.yaml
---
providers:
- name: "cluster-api"
  url: "https://github.com/kubernetes-sigs/cluster-api/releases/v0.4.0-beta.0/core-components.yaml"
  type: "CoreProvider"
- name: "kubeadm"
  url: "https://github.com/kubernetes-sigs/cluster-api/releases/v0.4.0-beta.0/bootstrap-components.yaml"
  type: "BootstrapProvider"
EOF

# Init Cluster API
./bin/clusterctl init --core cluster-api:v0.4.0-beta.0  --control-plane nested:v0.1.0  --infrastructure nested:v0.1.0 --config ~/.cluster-api/dev-repository/config.yaml

# Set Name
export CLUSTER_NAME=cluster-sample

./bin/clusterctl generate cluster ${CLUSTER_NAME} --infrastructure=nested:v0.1.0 | kubectl apply -f -

# Get kubeconfig
./bin/clusterctl get kubeconfig ${CLUSTER_NAME} > kubeconfig

# Port Forward Cluster
kubectl port-forward svc/${CLUSTER_NAME}-apiserver 6443:6443

# Update /etc/hosts
127.0.0.1 ${CLUSTER_NAME}-apiserver

# Get resources; Profit 🎉 
kubectl --kubeconfig kubeconfig get all -A

christopherhein · 2021-06-12T15:57:03Z

/help

k8s-ci-robot · 2021-06-12T15:57:04Z

@christopherhein:
This request has been marked as needing help from a contributor.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

christopherhein · 2021-06-12T15:58:41Z

We're looking for someone to use the information from #105 (comment) to update docs/README.md so that the new quick start guide uses the current unreleased clusterctl and is more reliable.

jichenjc · 2021-06-14T03:23:20Z

/assign

I am working on this ,will provide an update soon

jichenjc · 2021-06-14T03:39:45Z

I can move to here already, so should be good now

root@jitest19:~/cluster-api-provider-nested# kubectl --kubeconfig kubeconfig get all -A
NAMESPACE   NAME                 TYPE        CLUSTER-IP   EXTERNAL-IP   PORT(S)   AGE
default     service/kubernetes   ClusterIP   10.32.0.1    <none>        443/TCP   2d1h

k8s-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Jun 9, 2021

k8s-ci-robot changed the title ~~Failed to create~~ 🐛 Permission Errors trying to create StatefulSet from NCP Jun 9, 2021

k8s-ci-robot assigned christopherhein Jun 9, 2021

christopherhein mentioned this issue Jun 9, 2021

🐛 Fix permission issues and wrong control plane image #115

Merged

k8s-ci-robot closed this as completed in #115 Jun 9, 2021

k8s-ci-robot reopened this Jun 10, 2021

k8s-ci-robot changed the title ~~🐛 Permission Errors trying to create StatefulSet from NCP~~ 📖 Update docs/README.md with beta clusterctl setup Jun 12, 2021

christopherhein removed their assignment Jun 12, 2021

k8s-ci-robot added the help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. label Jun 12, 2021

k8s-ci-robot assigned jichenjc Jun 14, 2021

This was referenced Jun 15, 2021

Update README to reflect latest code and way for init #127

Merged

🌱 Support CAPI ClusterResourceSet #41

Open

k8s-ci-robot closed this as completed in #127 Jun 17, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

📖 Update docs/README.md with beta clusterctl setup #105

📖 Update docs/README.md with beta clusterctl setup #105

jichenjc commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

jichenjc commented Jun 10, 2021 •

edited

Loading

k8s-ci-robot commented Jun 10, 2021

christopherhein commented Jun 10, 2021 •

edited

Loading

jichenjc commented Jun 10, 2021

christopherhein commented Jun 10, 2021

jichenjc commented Jun 11, 2021

christopherhein commented Jun 11, 2021

christopherhein commented Jun 12, 2021

christopherhein commented Jun 12, 2021 •

edited

Loading

christopherhein commented Jun 12, 2021 •

edited

Loading

christopherhein commented Jun 12, 2021

k8s-ci-robot commented Jun 12, 2021

christopherhein commented Jun 12, 2021

jichenjc commented Jun 14, 2021

jichenjc commented Jun 14, 2021

📖 Update docs/README.md with beta clusterctl setup #105

📖 Update docs/README.md with beta clusterctl setup #105

Comments

jichenjc commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

christopherhein commented Jun 9, 2021

jichenjc commented Jun 10, 2021 • edited Loading

k8s-ci-robot commented Jun 10, 2021

christopherhein commented Jun 10, 2021 • edited Loading

jichenjc commented Jun 10, 2021

christopherhein commented Jun 10, 2021

jichenjc commented Jun 11, 2021

christopherhein commented Jun 11, 2021

christopherhein commented Jun 12, 2021

christopherhein commented Jun 12, 2021 • edited Loading

christopherhein commented Jun 12, 2021 • edited Loading

christopherhein commented Jun 12, 2021

k8s-ci-robot commented Jun 12, 2021

christopherhein commented Jun 12, 2021

jichenjc commented Jun 14, 2021

jichenjc commented Jun 14, 2021

jichenjc commented Jun 10, 2021 •

edited

Loading

christopherhein commented Jun 10, 2021 •

edited

Loading

christopherhein commented Jun 12, 2021 •

edited

Loading

christopherhein commented Jun 12, 2021 •

edited

Loading