Generative pre-trained transformer by Ciro Santilli 37 Created 2025-07-19 Updated 2025-08-08
Video 1.
5 Years of GPTs by Finbarr Timbers
. Source. 2023. Good talk.
Video 2.
Attention in transformers, step-by-step by 3Blue1Brown
. Source. 2024. Uses on GPT-3 as basis.
Video 3.
How might LLMs store facts by 3Blue1Brown
. Source. Followup to the above video.
llama-cli by Ciro Santilli 37 Created 2025-07-16 Updated 2025-09-09
A CLI front-end for llama.cpp.
A decent test command as of llama.cpp 79e0b68c178656bb0632cb8602d2940b755077f8 tested on Ubuntu 25.04:
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
mkdir build
cd build
cmake ..
make -j
cd bin
time ./llama-cli \
  --no-display-prompt \
  --single-turn \
  --temp 0 \
  -c 16384 \
  -cnv \
  -m ~/Downloads/Llama-3.1-Tulu-3-8B-Q8_0.gguf \
  -n 1000 \
  -ngl 100 \
  -p 'What is quantum field theory?' \
  -t 10 |
tee output.txt
and that was deterministic due to --temp 0.
Also, this command ran 2x faster at 18 tokens/s for 1000 tokens on P14s on GPU via Vulkan than on CPU which is achievable by removing the -ngl 100.
llama.cpp by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
This appears to be the backend library of Ollama.
They have a CLI front-end named llama-cli.
askubuntu.com/questions/1461564/install-llama-cpp-locally has some tutorials for Ubuntu. There was no nicely pre-packaged one for Ubuntu 25.04, but build worked on 79e0b68c178656bb0632cb8602d2940b755077f8 In particular it exposed Vulkan support before Ollama did: github.com/ollama/ollama/pull/5059 and it did seem to work, using up my AMD GPU.
Deep learning with coherent nanophotonic circuits by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Paper by the team that went on to found Lightmatter.
Optical computing company by Ciro Santilli 37 Created 2025-07-16 Updated 2025-09-09
Optical computing by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Windows 11 by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16
Windows version by Ciro Santilli 37 Created 2025-07-16 Updated 2025-07-16

There are unlisted articles, also show them or only show them.