Bilibili Announces Multiple AI Tech Achievements and Open Sources Index-1.9B Series Models at WAIC2024
TapTechNews July 5th news, at the 2024 World Artificial Intelligence Conference (WAIC2024), Bilibili (hereinafter referred to as B Station) announced a number of self-developed AI technology achievements and AIGC diverse creativity, including the latest customized AI voice sound library, self-developed audio and video large model Bjian Studio, and self-developed AI dynamic manga technology, etc.
In addition, B Station's self-developed large language model series was also exhibited for the first time at this WAIC2024 conference, including the open source Index-1.9Bchat and Index-1.9Bcharacter two models.
TapTechNews learned from GitHub that the Index-1.9B series models were open sourced in June and include the base model, control group, conversation model, role-playing model:
Index-1.9Bbase: The base model has 1.9 billion non-word embedding parameters and is pre-trained on 2.8 trillion mainly Chinese and English corpora, and is leading compared to models of the same level in multiple evaluation benchmarks.
Index-1.9Bpure: The control group of the base model, which has the same parameters and training strategy as the base, except that all instruction-related data in the corpus of this version is filtered to verify the impact of instructions on the benchmark.
Index-1.9Bchat: The conversation model after alignment through SFT and DPO based on Index-1.9Bbase.
Index-1.9Bcharacter: On the basis of SFT and DPO, RAG was introduced to implement few-shot role-playing customization.
At the B Station 15th anniversary speech, Chen Rui, chairman and CEO of B Station, said that in 2023, the daily average video playback volume of B Station's AI-related content increased by more than 80% year-on-year, and the blockbuster content covered fields such as popular science information, AI technology applications, digital humans and creative applications.
According to the data disclosed by B Station, currently more than 80 million users watch AI-related videos on B Station every month, 60% of whom are post-00s.
The open source address of the Index-1.9B series models:
https://github.com/bilibili/Index-1.9B