feat: Add loading sharded GGUF files from HuggingFace with Llama.from… #2736
Job | Run time |
---|---|
11s | |
9m 57s | |
1m 7s | |
1m 11s | |
10m 10s | |
1m 17s | |
1m 9s | |
10m 13s | |
1m 12s | |
1m 0s | |
10m 5s | |
1m 8s | |
1m 7s | |
1m 13s | |
51m 0s |
Job | Run time |
---|---|
11s | |
9m 57s | |
1m 7s | |
1m 11s | |
10m 10s | |
1m 17s | |
1m 9s | |
10m 13s | |
1m 12s | |
1m 0s | |
10m 5s | |
1m 8s | |
1m 7s | |
1m 13s | |
51m 0s |