Giles' blog

# Giles' Blog > Giles' Blog is the personal technical blog for Giles Thomas, a software engineer > and entrepreneur. Current information about Giles Thomas can be found on the > [about page](https://www.gilesthomas.com/about.md). This page lists the 20 most recent posts, and then all categorised posts by their category (many posts have multiple categories). ## Recent posts * [A quick(ish) Chinchilla check](https://www.gilesthomas.com/2026/08/chinchilla-check.md) posted on 2026-08-07T19:00:00+00:00 * [How I use AI on this blog](https://www.gilesthomas.com/2026/07/ai-use.md) posted on 2026-07-31T19:00:00+00:00 * [Why do OpenAI's GPT-2 weights beat mine? Part three: testing overtraining](https://www.gilesthomas.com/2026/07/why-do-openai-gpt2-weights-beat-mine-3-overtraining.md) posted on 2026-07-31T01:15:00+00:00 * [Why do OpenAI's GPT-2 weights beat mine? Part two: the bugfix](https://www.gilesthomas.com/2026/07/why-do-openai-gpt2-weights-beat-mine-2-the-bugfix.md) posted on 2026-07-30T19:00:00+00:00 * [Why do OpenAI's GPT-2 weights beat mine?](https://www.gilesthomas.com/2026/07/why-do-openai-gpt2-weights-beat-mine-1-intro.md) posted on 2026-07-29T15:30:00+00:00 * [Benchmarking Qwen 3.6 35B MoE (3B active) on an RTX 3090](https://www.gilesthomas.com/2026/07/benchmarking-qwen-3-6-35b-moe-rtx-3090.md) posted on 2026-07-24T23:30:00+00:00 * [Building intuition about LLM parameter counts](https://www.gilesthomas.com/2026/07/llm-parameter-counts.md) posted on 2026-07-10T21:30:00+00:00 * [poppy the training box, part 1: the beginnings](https://www.gilesthomas.com/2026/07/poppy-the-training-box-1-the-beginnings.md) posted on 2026-07-09T01:00:00+00:00 * [Writing an LLM from scratch, part 34b -- from bigrams to GPT-2, one component at a time (in JAX)](https://www.gilesthomas.com/2026/07/llm-from-scratch-34b-building-and-training-gpt-2-small-in-jax.md) posted on 2026-07-08T18:45:00+00:00 * [Writing an LLM from scratch, part 34a -- building a JAX training loop for an LLM training run](https://www.gilesthomas.com/2026/06/llm-from-scratch-34a-building-a-jax-training-loop-for-an-llm-training-run.md) posted on 2026-06-30T19:00:00+00:00 * [Thoughts on Role Confusion](https://www.gilesthomas.com/2026/06/role-confusion.md) posted on 2026-06-24T20:15:00+00:00 * [Flax debugging: making a hash of things](https://www.gilesthomas.com/2026/06/hashing-jax-parameters.md) posted on 2026-06-17T02:40:00+00:00 * [10Gb/s Ethernet: switching to a Broadcom SFP+ module](https://www.gilesthomas.com/2026/06/10g-ethernet-switching-to-broadcom-sfp-plus.md) posted on 2026-06-16T18:45:00+00:00 * [JAX: commitment issues](https://www.gilesthomas.com/2026/06/jax-commitment-issues.md) posted on 2026-06-15T21:30:00+00:00 * [JAX backends and devices](https://www.gilesthomas.com/2026/06/jax-backends-and-devices.md) posted on 2026-06-05T19:30:00+00:00 * [Using Safetensors with Flax](https://www.gilesthomas.com/2026/06/flax-and-safetensors.md) posted on 2026-06-04T23:30:00+00:00 * [On first looking into JAX](https://www.gilesthomas.com/2026/05/on-first-looking-into-jax.md) posted on 2026-05-30T18:45:00+00:00 * [10Gb/s Ethernet: using mini-heatsinks with a 10GBASE-T SFP+ module](https://www.gilesthomas.com/2026/05/10g-ethernet-sfpplus-mini-heatsinks.md) posted on 2026-05-18T19:15:00+00:00 * [10Gb/s Ethernet: what I actually did to get it working in my home](https://www.gilesthomas.com/2026/04/10g-ethernet-what-i-did.md) posted on 2026-04-29T14:15:00+00:00 * [10Gb/s Ethernet: what I had to (re)learn](https://www.gilesthomas.com/2026/04/10g-ethernet-what-i-relearned.md) posted on 2026-04-28T18:45:00+00:00 ## Posts in category AI * [Evolution in action](https://www.gilesthomas.com/2008/10/evolution-in-action.md) posted on 2008-10-03T17:52:56+00:00 * [Building an AI chatbot for beginners: part 0](https://www.gilesthomas.com/2023/03/ai-llm-bot-beginners-tutorial-00.md) posted on 2023-03-19T20:45:00+00:00 * [Building an AI chatbot for beginners: part 1](https://www.gilestho […gekürzt]