Evidence of Fortran boosting GenAI

1

Hi all,

Recently I came across this post in LinkedIn and it is interesting that they show how NumPy leverages Fortran code for compute-intensive kernels like MATMUL:

I did not find the link to the technical article yet. I will post it here!

Are you aware of other evidence of Fortran powering the GenAI tools?

1 Like
2

I believe the more technical write up is hosted here:

3

Thanks for sharing!

4

The post was much discussed at Hacker News (currently 1233 points and 401 comments).

5

See also GitHub - rbitr/llm.f90: LLM inference in Fortran this Fortran implementations of CPU language model inference for a few models including llama. There is a branch for PHI-2 that is a smaller model better suited to CPU. (Disclaimer, I am the author)