llama-cli by Ciro Santilli 37 Created 2025-07-16 Updated 2025-08-08
A CLI front-end for llama.cpp.
A decent test command as of llama.cpp 79e0b68c178656bb0632cb8602d2940b755077f8:
time ./llama-cli \
  --no-display-prompt \
  --single-turn \
  --temp 0 \
  -c 16384 \
  -cnv \
  -m Llama-3.1-Tulu-3-8B-Q8_0.gguf \
  -n 1000 \
  -ngl 100 \
  -p 'What is quantum field theory?' \
  -t 10 |
  tee output.txt \
;
but it failed to be deterministic despite --temperature 0. This ran 2x faster at 18 tokens/s for 1000 tokens on P14s on GPU via Vulkan than on CPU which is achievable by removing the -ngl 100.
llama.cpp by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
This appears to be the backend library of Ollama.
They have a CLI front-end named llama-cli.
askubuntu.com/questions/1461564/install-llama-cpp-locally has some tutorials for Ubuntu. There was no nicely pre-packaged one for Ubuntu 25.04, but build worked on 79e0b68c178656bb0632cb8602d2940b755077f8 In particular it exposed Vulkan support before Ollama did: github.com/ollama/ollama/pull/5059 and it did seem to work, using up my AMD GPU.
Deep learning with coherent nanophotonic circuits by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Paper by the team that went on to found Lightmatter.
Optical computing company by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Optical computing by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Windows 11 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Windows version by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Proxima Fusion by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
MacOS 26 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
MacOS 15 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
MacOS 14 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
MacOS 11 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
MacOS version by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
List of operating systems by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
The three operating systems by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
As of 2025 and much earlier, there were only 3 operating systems that mattered on desktop:We refer to them as "the three operating systems".
Stellarator by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16

Unlisted articles are being shown, click here to show only listed articles.