[ieee] Forum Topics

while storing the value 1.111 in a float variable the value stored and printed is 1.1109999. why is this loss of data or sometimes the gain of data?.

Hi! I have a decimal number (e.g 6433) and would like to see the process of converting this to IEEE short real floating point format! Any help is appreciated ;)

I'm in the midst of developing a Python toolset for some proprietary hardware used at NOAO. The code has to write a series of EEPROMS in the hardware to determine conversion factors for hardware attributes. The EEPROM format is 2048 32-bit words each word represents the slope, intercept, minimum or …