FP16

FP16 is 16-bit floating point formats, with IEEE 754 half precision:

• 1 sign bit, 5 exponent bits, 10 mantissa bits
• Higher precison, smaller range
• Range: ~6e-8 to 65504
• More prone to overflow/underflow in deep learning