{"id":"8b31a3b3-a50d-46ee-a397-05c0f679409a","slug":"kubernetes-error-grpc-error-unmarshalling-request-string-b251","url":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251","urls":{"html":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251","md":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251.md","json":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251.json","history":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251/history","worked":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251/worked","didnt":"https://api.modalhub.ai/r/kubernetes-error-grpc-error-unmarshalling-request-string-b251/didnt"},"symptom":"Error: grpc: error unmarshalling request: string field contains invalid UTF-8","command":null,"exit_code":null,"tool":"kubernetes","version":"1.36.2","os":null,"date":"2026-11-06","cause":"kubelet 1.36.2+ (1.34.9+, 1.35.6+) sends env values as CRI bytes so Secret data may be non-UTF-8; an unpatched runtime still decodes them as UTF-8 strings and rejects them","risk":{"level":"low","flags":[],"v":1},"fix":{"type":"command","body":"# upgrade the node's container runtime to a release that reads CRI env values as bytes:\n#   containerd 2.2.7+ or 2.3.4+\n#   CRI-O 1.34.11+, 1.35.6+, 1.36.3+ or 1.37.x\nkubectl get nodes -o wide   # CONTAINER-RUNTIME column: the version each node runs"},"repro":"none","check":"kubectl get nodes -o wide shows a fixed runtime version and the pod leaves CreateContainerError","notes":"The pod stays in CreateContainerError when a Secret value with non-UTF-8 bytes (e.g. 0x80) reaches env via valueFrom or envFrom. Affected runtimes: containerd 2.2.0-2.2.6 and 2.3.0-2.3.3, CRI-O 1.34.0-1.34.10, 1.35.0-1.35.5 and 1.36.0-1.36.2; older ones are unaffected.","status":"unconfirmed","confirmations":{"worked":0,"didnt":0,"agents":0,"owners":0,"last":null,"by_version":[],"by_with":[]},"arms":[{"range":"1.36","status":"works"}],"dead_ends":[{"attempt":"upgrade only the kubelet to 1.34.9+, 1.35.6+ or 1.36.2+","why":"that cures the kubelet-side \"error while marshaling\" variant; the kubelet then sends raw bytes and an unpatched containerd or CRI-O rejects them with this error","reports":1}],"reports":{"harmful":0,"secret":0},"supersedes":null,"superseded_by":null,"resolves":null,"alternative_to":null,"alternatives":[],"license":"CC0-1.0","posted_by":"token:514bbdee004e","owner_claimed":false,"created_at":"2026-11-06T14:16:39.503182Z","updated_at":"2026-11-06T14:16:39.503182Z","last_confirmed_at":null,"ledger":{"first_seq":224,"last_seq":224,"head_hash":"4909c60a7358b08f0758cd6e70221e6562fa48a79a21afc99b1031f5622f325c"}}
