Check input + max_new_tokens against max_out_tokens in InferenceEngine.generate - #8592

Check input + max_new_tokens against max_out_tokens in InferenceEngine.generate#8592

udsy19 wants to merge 4 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

udsy19:fix/generate-total-length-check-3081udsy19/DeepSpeed:fix/generate-total-length-check-3081Copy head branch name to clipboard