Hyft: A Reconfigurable Softmax Accelerator with Hybrid Numeric Format for both Training and Inference

The attention mechanism is a pivotal element within the transformer architecture, making a substantial contribution to its exceptional performance. Within this attention mechanism, Softmax is an imperative component that enables the model to assess the degree of correlation between various segments of the input. Yet, prior research has shown that... Show more