Data/Data Science
2023. 5. 13.
[ML] bf16, fp16, fp32의 차이점
업무를 진행하면서 bf16, fp16, fp32에 대한 정보를 알게되었는데. 왜 사용하는지 그리고 언제 사용하는지에 대해서 좀 정리해보려고한다. https://arxiv.org/abs/1905.12322 -> 관련논문 A Study of BFLOAT16 for Deep Learning Training This paper presents the first comprehensive empirical study demonstrating the efficacy of the Brain Floating Point (BFLOAT16) half-precision format for Deep Learning training across image classification, speech recognition, langu..
![[ML] bf16, fp16, fp32의 차이점](http://i1.daumcdn.net/thumb/C480x320/?fname=https://blog.kakaocdn.net/dn/dNVsSt/btsfbjloCUF/1xXSxpjYHACPzMh8ItRvj1/img.png)