Floating-Point Formats and Deep Learning

Floating-Point Formats and Deep Learning

Floating-Point Formats and Deep Learning

Floating-point format is not a crucial consideration in deep learning, but it can make a significant difference. What is floating-point, why should you (a deep learning practictioner) care, and what can you do about it?

Source: eigenfoo.xyz/floating-point-deep-learning/