We identified the root cause that an environment variable that we rely on to make inference calls to an upstream vendor was invalid. We rotated the env var, redeployed, and see performance returning to a nominal status.