• 1 Post
  • 8 Comments
Joined 2 years ago
cake
Cake day: June 9th, 2023

help-circle

  • Need max AVX instructions. Anything with P/E cores is junk. Only enterprise P cores have the max AVX instructions. When P/E are mixed the advanced AVX is disabled in microcode because the CPU scheduler is unable to determine if a process thread contains an AVX instruction and there is no asymmetrical scheduler that handles this. Prior to early 12k series Intel, the microcode for P enterprise could allegedly run if swapped manually. This was “fused off” to prevent it, probably because Linux could easily be adapted to asymmetrical scheduling but Windows would probably not. The whole reason W11 had to be made was because of the E-cores and the way the scheduler and spin up of idol cores works, at least according to someone on Linux Plumbers for the CPU scheduler ~2020. There are already asymmetric schedulers in Android ARM.

    Anyways I think it was on Gamer’s Nexus in the last week or two that Intel was doing some all P core consumer stuff. I’d look at that. According to chips and cheese, the primary CPU bottleneck for tensors is the bus width and clock management of the L2 to L1 cache.

    I do alright with my laptop, but haven’t tried R1 stuff yet. The 70B llama2 stuff that I ran was untenable for CPU only with a 12700 with just CPU. It is a little slower than my reading pace when split with a 16 GB GPU, and that was running a 4 bit quantization version.


  • It is just a fundamental abstraction that it is an all Israeli thing. Israel has no separation of business government and military. It is one of the most integrated States in that respect. The person with the most influence and control over the alignment problem and the most proprietary undocumented black box aspect of all present AI, so close to the Israeli military is not a good idea. Israelis have proven that they are genocidal nuts with no ethics. Even with the best intentions, will these people maintain them under torture and duress. We are all only animals that cosplay sentient intelligence. The power available by bending alignment is already so large it can reshape all of civilization if it were removed or realigned and that power is only going to increase with time.