Show HN: Proxy Block-CAGE, a new sparse block attention

A PhD student in bioinformatics used ChatGPT and genetic algorithms to develop Proxy Block-CAGE, a new sparse block attention method for transformers, aiming to reduce computational intensity. The work is shared on Hacker News for feedback from the AI/ML research community.

Hi, I'm a PhD student in Bioinformatics/Computational Biology with a software engineering background, I'm trying to pivot toward AI/ML research. I'm familiar with the practical side of AI as in using, Scikit learn, R, Pytorch, ONNX Runtime etc... I was thinking if LLMs could be used as a research assistant to create better AIML algorithms. So I asked ChatGPT to help find better way to solved one of the most computationally intensive problems in Transformer architecture based model. I instructed ChatGPT to use genetic algorithms, genetic programming and other optimization techniques Something I use extensively in my bioinformatics research to find better Attention methods in transformers and this was the result. I would love to get feedback and comments from the AIML research community. Please read the md file and get back to me. Hope you find this useful. Thank you Comments URL: https://news.ycombinator.com/item?id=48659271 https://news.ycombinator.com/item?id=48659271 Points: 1 Comments: 0