nake13 2 days ago

The Magistral Small can fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.

2
the_sleaze_ 2 days ago

Excellent news for me.

How does one figure this out? As in I want to know the comparable Deepseek or Llama equivalent (size-wise) and don't want to figure it out by trial and error.

lolive 1 day ago

Is it indeed the plan of Apple to eventually run such kind of models direcly inside a iPhone? Or are the specs of any stateOfTheArt smartphone well below the minimum requirements of such "lightweight" models?