{"slug": "parallel-processing-ai", "title": "Parallel Processing AI", "summary": "A new paper by Patience Strong proposes building neural networks as semiconductor devices rather than emulating them in software, which could eliminate the massive compute power currently required. The approach uses digital-to-analog converters for weights and biases and a fast-switching transistor for the activation function, enabling parallel processing that would be faster and more energy-efficient than GPUs. The design allows for electrical reprogramming, maintaining compatibility with current AI update practices.", "body_md": "Zero Compute AI\n\nA paper on the next step in the evolution of Neural Networks\n\nby\n\nPatience Strong\n\n**Introduction**\n\nNeural Networks, in their current form, require vast amounts of compute / electrical power to function. They require this degree of power in order to emulate a technology that, if expressed as hardware, would require no computational power at all.\n\nIn short, the compute power is consumed by the *emulation process*, not by the network or the task that network is processing. Therefore, if we stop *emulating* the circuit, and instead build it, no conventional computer at all would be required to achieve the same result.\n\nIt is the above observation, and tentative proposals on how to achieve the next iteration of this technology, that is the subject of this paper.\n\n**Current Technology**\n\nNeural Networks are built around the concept of the artificial neurone, like this:\n\nImage 1: A simple neurone.\n\nThe massive compute demand comes from the host servers needing to perform very simple calculations billions of times per second in order to emulate an array of these neurones. So, although the computation is trivial, it is *the scale of the task* that consumes the compute power.\n\nEssentially, the software is reading and summing the values referred to as “weights” in figure 1, a trivial task, then offsetting that summed value by the value of a constant called a “bias”, another trivial task, then using a conditional statement to decide if the final computed value is greater than the trigger threshold for the output.\n\nAgain, very trivial coding, but when you have billions of neurones in the network, and you need to compute these trivial tasks for every one of them in real time, then you require a ridiculous amount of compute / electrical power to do so.\n\n**The Proposal**\n\nThis paper is proposing that instead of using all this compute power to emulate the circuit, we actually build it as a semiconductor device.\n\nThe intent here is to simply demonstrate that it is not nearly as difficult to express this network as a semiconductor device, as it is for example, to make a GPU.\n\n**An example of a viable approach**\n\n**The weights and Bias**\n\nThe weights and Bias shown could be realised as Digital to Analog Converters, (DAC). Each of which would have its register implemented as non-volatile memory, so the value of the weight or bias can survive power loss.\n\nThe registers would use standard address and data buses to allow them to be updated each time a new iteration of the neural network is released.\n\n**The Activation Function**\n\nThe output from the weights and bias feed into a fast switching transistor that turns on when the current or voltage is above the activation threshold, and remains off when below it.\n\nNo doubt an expert in semiconductor design would come up with something even simpler.\n\nIt is worth noting that this device will process its neurones in parallel, so it should be considerably faster than a GPU, as well as draw far less power.\n\n**Conclusion**\n\nIf the neural network is implemented as an electrically programable device, then successive releases of an AI can be overwritten on the non-volatile chip hosting it. So parity with current upgrade practices can be maintained.\n\nBecause each neurone handles the decision whether to trigger its output or not in real time, no computer is required. The only need for computers would be to handle incoming requests and returning the results.\n\nI hope you find this document useful and that it sparks a productive conversation.\n\nYours sincerely.\n\nPatience", "url": "https://wpnews.pro/news/parallel-processing-ai", "canonical_source": "https://discuss.huggingface.co/t/parallel-processing-ai/178270#post_1", "published_at": "2026-07-28 18:40:35+00:00", "updated_at": "2026-07-28 19:05:35.534841+00:00", "lang": "en", "topics": ["neural-networks", "ai-research"], "entities": ["Patience Strong"], "alternates": {"html": "https://wpnews.pro/news/parallel-processing-ai", "markdown": "https://wpnews.pro/news/parallel-processing-ai.md", "text": "https://wpnews.pro/news/parallel-processing-ai.txt", "jsonld": "https://wpnews.pro/news/parallel-processing-ai.jsonld"}}