# Thinking Forth

> Source: <https://forum.level1techs.com/t/thinking-forth/259464#post_13>
> Published: 2026-11-21 19:04:46+00:00

**Key takeaway:** tensorForth runs a Forth VM on CUDA with dynamic parallelism for tensor calculus and CNNs, letting developers interactively build and run individual AI layers on the GPU instead of JIT-transcoding Python to C/C++ and compiling on the host.

Forth lives in GPU: tensorForth

Forth can run anywhere. As evidence, here is a project that runs Forth in a GPU.

Forth does tensors, in CUDA.

When GPU got involved, to enable processing on CUDA device, say with Numba, TaiChi or the likes, mostly there will be a behind the scene ‘just-in-time’ transcoding to C/C++ followed by compilation then load and run. Your Python code behaves like a Makefile which requires compilers/linker available on the host box. The common code-compile-run-debug cycle is especially counter-productive with ML’s extra-long run stage.

Forth language encourages incremental build-test cycle. Having a ‘GPU shell’, that can interactively and incrementally develop/run each AI layer/node can potentially build a cleaner system. So, here we are!

tensorForth - lives in GPU, does linear algebra and machine learning

Forth VM that supports tensor calculus and Convolution Neural Network with dynamic parallelism in CUDA
