Repository navigation
|
Hey everyone. I’m just looking to get my head wrapped around each package. I’m trying to understand what jlama-native is and how it’s different from jlama-core? Why do I need jlama-native when I’m importing dependencies into my Java app? Any info would be appreciated. Thanks in advance! |
Answered by
tjake
Feb 2, 2025
Replies: 1 comment
|
👋 jlama-native is not required. It’s an alternative implementation on tensor operation that use native simd. The reason for this is the Java vector api is still not perfect and more complex vector dense methods like quantized GEMM can be de-optimized at runtime. So YMMV and native helps normalize performance if needed. |
0 replies
Answer selected by
isaaca26
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
👋 jlama-native is not required. It’s an alternative implementation on tensor operation that use native simd. The reason for this is the Java vector api is still not perfect and more complex vector dense methods like quantized GEMM can be de-optimized at runtime.
So YMMV and native helps normalize performance if needed.