Shanghai AI Lab's New Model Learns to Predict Concepts, Not Just Words
Shanghai AI Laboratory and Shanghai Jiao Tong University's LUMIA Lab released NCP-ArchPreview, an approximately 8.94-billion-parameter model that reaches the final Stage 1 pretraining loss of Allen In…