{"slug": "evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism", "title": "Evaluating the Effect of Frame Rate in Sequence-Based Classification of Autism-Related Self-Stimulatory Hand Idiosyncrasies", "summary": "Researchers achieved up to 98.75% accuracy in detecting autism-related self-stimulatory behaviors from video using GRU and LSTM models at a 15-frame sampling interval, outperforming prior CNN baselines. The study also identified horizontal flip as the most effective data augmentation technique and highlighted the necessity of upsampling for behavioral video augmentation. These findings provide practical guidance for video-based behavioral classification in data-scarce clinical settings.", "body_md": "arXiv:2607.07957v1 Announce Type: new\nAbstract: Autism spectrum disorder (ASD) affects over 75 million individuals worldwide, yet scalable computational methods for remote behavioral screening remain limited. This study addresses two complementary challenges in automated detection of autism-related self-stimulatory behaviors from video: (1) identifying the optimal sequence-based neural network architecture and temporal sampling rate, and (2) characterizing data augmentation strategies for training on small behavioral datasets. For the first objective, long short-term memory (LSTM) and gated recurrent unit (GRU) models were trained on pose-derived features from the Self-Stimulatory Behavior Diagnosis (SSBD) dataset at frame sampling intervals of 1, 5, 15, 30, 45, and 90 frames. Both architectures exceeded prior convolutional neural network (CNN) baselines (62-76% accuracy), with peak accuracies of 97.5% (LSTM) and 98.75% (GRU) at a sampling interval of every 15 frames. For the second objective, ten data augmentation strategies were applied to an I3D transfer learning pipeline, with an ablation study quantifying the marginal contribution of each technique. Horizontal flip achieved the highest standalone accuracy (48.78%), while exclusion of upsampling from the augmentation pipeline produced the largest performance degradation, indicating its necessity for complex behavioral video augmentation. A personalized machine learning approach, in which per-subject models were trained and tested on temporally split segments of each video, produced consistent predictions (mean loss 1.84, SD 0.79). These results provide practitioners with concrete guidance on architecture selection, sampling rate, and augmentation strategy for video-based behavioral classification in data-scarce clinical domains.", "url": "https://wpnews.pro/news/evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism", "canonical_source": "https://arxiv.org/abs/2607.07957", "published_at": "2026-07-10 04:00:00+00:00", "updated_at": "2026-07-10 04:10:48.022606+00:00", "lang": "en", "topics": ["machine-learning", "computer-vision", "artificial-intelligence"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism", "markdown": "https://wpnews.pro/news/evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism.md", "text": "https://wpnews.pro/news/evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism.txt", "jsonld": "https://wpnews.pro/news/evaluating-the-effect-of-frame-rate-in-sequence-based-classification-of-autism.jsonld"}}