Patch release: v5.14.1
# Patch release v5.14.1 This patch solves a few issues which appeared when integrating Inkling model, most notably an issue affecting models using EncoderDecoderCache during assisted generation. It also fixes an issue that could appear during prefill with StaticCache and sdpa without padding for Inkling which uses a position_bias. It contains the following commits: - Fix sdpa prefill with position_bias (#47359) by @Cyrilvallez - Fix assisted decoding for models with EncoderDecoder cache & OlmoHybrid (#47361) by @Cyrilvallez - [FP8] Bump kernels version (#47344) by @vasqu - Fix deepgemm on multiple devices (#47323) by @IlyasMoutawwakil
来自 Transformers 发布记录 的官方公开更新;本站仅提供短摘要与原始出处链接。
Patch release: v5.14.1
# Patch release v5.14.1 This patch solves a few issues which appeared when integrating Inkling model, most notably an issue affecting models using EncoderDecoderCache during assisted generation. It also fixes an issue that could appear during prefill with StaticCache and sdpa without padding for Inkling which uses a position_bias. It contains the following commits: - Fix sdpa prefill with position_bias (#47359) by @Cyrilvallez - Fix assisted decoding for models with EncoderDecoder cache & OlmoHybrid (#47361) by @Cyrilvallez - [FP8] Bump kernels version (#47344) by @vasqu - Fix deepgemm on multiple devices (#47323) by @IlyasMoutawwakil
来自 Transformers 发布记录 的官方公开更新;本站仅提供短摘要与原始出处链接。
自动收录自 Transformers 发布记录 的公开订阅信息;请以原始出处为准。
前往原始出处阅读