Notes

Essays and notes on engineering, machine learning, and systems.

From Softmax Attention to Kimi Delta Attention

gradually build intuition for how attention goes from softmax to kimi delta.

Books I've read

books list