Attention Mechanism

A machine learning mechanism that weights relationships between elements of an input when producing an output. Attention can improve information processing, but its weights do not by themselves explain a model’s reasoning.