CODEWITHSUNDEEP
kubernetes
angelokh
angelokh

Reputation: 9428

Kubernetes pod failed to update

We have a Gitlab CI/CD to deploy pod via Kubernetes. However, the updated pod is always pending and the deleted pod is always stuck at terminating. enter image description here

The controller and scheduler are both okay. enter image description here

If I described the pending pod, it shows it is scheduled but nothing else. enter image description here

This is the pending pod's logs:

$ kubectl logs -f robo-apis-dev-7b79ccf74b-nr9q2 -n xxx -f Error from server (BadRequest): container "robo-apis-dev" in pod "robo-apis-dev-7b79ccf74b-nr9q2" is waiting to start: ContainerCreating

What could be the issue? Our Kubernetes cluster never had this issue before.

Upvotes: 0

Views: 520

Answers (1)

angelokh
angelokh

Reputation: 9428

Okay, it turns out we used to have an NFS server as PVC. But we have moved to AWS EKS recently, thus cleaning the NFS servers. Maybe there are some resources from nodes that are still on the NFS server. Once we temporarily roll back the NFS server, the pods start to move to RUNNING state.

The issue was discussed here - Orphaned pod https://github.com/kubernetes/kubernetes/issues/60987

Upvotes: 1

Related Questions