Privacy policy is not great with deepseek api, but you are always just trusting their word with any hosted llm and in theory i could at least self host the models i use from deepseek.
131 karma · joined June 25, 2019
Privacy policy is not great with deepseek api, but you are always just trusting their word with any hosted llm and in theory i could at least self host the models i use from deepseek.
16-core ARM CAX41
root@ubuntu-32gb-fsn1-1:~# ./a.out
1 17.8
2 35.6
3 49.9
4 64.9
5 79.0
6 92.1
7 101.7
8 110.2
9 117.6
10 124.0
11 130.4
12 136.2
13 140.9
14 143.8
15 149.2
16 152.9
16 Core AMD shared CPX51
root@ubuntu-32gb-fsn1-1:~# ./a.out
1 18.9
2 37.5
3 54.3
4 65.4
5 77.2
6 92.8
7 100.8
8 92.1
9 95.1
10 105.7
11 93.4
12 100.9
13 89.9
14 97.0
15 99.1
16 107.8
16 core AMD dedicated CCX43
root@ubuntu-64gb-fsn1-1:~# ./a.out
1 36.3
2 71.6
3 56.8
4 50.8
5 63.4
6 57.2
7 53.4
8 50.9
9 55.2
10 61.3
11 64.4
12 65.3
13 66.5
14 68.8
15 69.2
16 64.4
Increasing the data volume for CCX43 to 48GB increases the bandwidth using 16 cores to 75.1. Memory bandwidth seems to scale pretty well with the number of cores on ARM. Interesting that the bandwidth for the shared AMD system is that much higher than the dedicated system
You could try it on earth with if you train a model on two separate languages, being careful that the traning data does not contain any mixed language. But even then, modern Human languages most likely have too much cross-contamination. Would be an interesting experiment nevertheless
I'm sure everybody in the EU would like US level salaries, but most wouldn't move for the money alone
That sounds like a reasonable and balanced approach.