scaled_dot_product_attention函数兼容3D输入

[Qin-sx]

trafficstars

PR Category

User Experience

PR Types

Improvements

Description

scaled_dot_product_attention函数兼容3D输入。如果输入是3D，[seq_len, num_heads, head_dim]，函数内部扩充为4D [1, seq_len, num_heads, head_dim]

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Please upload report for BASE (develop@917ecbd). Learn more about missing BASE report.

Additional details and impacted files

@@             Coverage Diff             @@
##             develop    #73336   +/-   ##
===========================================
  Coverage           ?   100.00%           
===========================================
  Files              ?         1           
  Lines              ?         6           
  Branches           ?         0           
===========================================
  Hits               ?         6           
  Misses             ?         0           
  Partials           ?         0           

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

• :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.