[EN] ByteSized: fun with floating points - U Ruede, A Herten and E di Napoli

English Edition: how are real numbers e.g. 0.1 represented on computers? What can go wrong with using their representation in calculations? And does it matter? These and other questions are the subject of this ByteSized episode with my guests Prof. Ulrich Ruede (University of Erlangen-Nuernberg), Andreas Herten and Edoardo di Napoli (both Research Centre Juelich). 

Links:

• https://www.h-schmidt.net/FloatConverter/IEEE754.html  an online tool to convert numbers into their bit/hex equivalent - also showing the rounding errors
• https://dl.acm.org/doi/10.1145/103162.103163  Goldberg Paper: What every computer scientist should know about floating points
• https://arxiv.org/abs/2012.02492 revisiting Goldberg, Vincent Lafage
• https://en.wikipedia.org/wiki/IEEE_754 the Wiki entry on the IEEE 754 standard for floating points (the standard itself is not accessible for free)
• https://en.wikipedia.org/wiki/Unit_in_the_last_place definition von "ulp"
• https://developer.nvidia.com/blog/floating-point-8-an-introduction-to-efficient-lower-precision-ai-training/ NVidia’s take on lower precision numbers 
• https://indico.esa.int/event/445/contributions/8473/attachments/5559/9378/gernigon_cedric_EDHPC2023.pdf list of lower precision formats
• https://en.wikipedia.org/wiki/Chinese_remainder_theorem Chinese remainder theorem

I would like to thank the STEP-UP project in the UK for supporting this series of ByteSized episodes. 

Get in touch

Thank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören!

Contact Details/ Coordonnées / Kontakt:

• Email mailto:[email protected]
• UK RSE Slack (ukrse.slack.com): @code4thought or @piddie 
• Bluesky: https://bsky.app/profile/code4thought.bsky.social
• LinkedIn: https://www.linkedin.com/in/pweschmidt/  (personal Profile)
  • LinkedIn: https://www.linkedin.com/company/codeforthought/ (Code for Thought Profile)

This podcast is licensed under the Creative Commons Licence:  https://creativecommons.org/licenses/by-sa/4.0/