feat: Per-sequence scaling in FP8 attention, FP8 fixes#162

andrea-fasoli merged 1 commit intofoundation-model-stack:mainfoundation-model-stack/fms-model-optimizer:mainfrom

ani300:fp8_sequence_fixesani300/fms-model-optimizer:fp8_sequence_fixesCopy head branch name to clipboard