My current research paper introduces so called TreeNets, which can drastically reduce the size of LLMs. In general, TreeNets help us understand the fundamental connection between neural networks and decision trees.
You can find my paper here. Or go to my repository directly. This is the first draft of my paper, so it will require changes in the future.
I have also uploaded a LLM based on TreeNets and Bart. You can find it here.
Please let me know if there are any problems with the uploads. I am an independent researcher and this is my first publication.