Dubai, UAE: Huawei has launched a new AI storage model, the OceanStor A310, designed for the era of large AI models at GITEX GLOBAL 2023. The solution provides optimal storage capability for basic model training, industry model training, and inference in segmented scenario models, unleashing new AI capabilities.
The launch demonstrates Huawei’s alignment with the latest trends of AI development in the era of large models. The OceanStor A310 deep learning data lake storage caters to different industries and scenarios in large AI model applications.
Peter Zhou, President of Data Storage Product Line, Huawei said, “With the OceanStor A310, we are bringing our customers and partners a cutting-edge AI storage solution to unleash new AI capabilities and create value for various industries. Visitors to our GITEX stand can witness how Huawei is committed to accelerating the intelligent era, leveraging a trusted, secure, and reliable OceanStor platform used by some of the leading businesses in the world.”
Enterprises face four significant challenges in the development and implementation of large model applications. First, data preparation takes a long time, with dispersed data sources and slow aggregation. Currently, preprocessing about a hundred terabytes of data takes around ten days.
Secondly, for multi-modal large models using massive text and images as training sets, the current loading speed for a large number of small files is less than 100MB/s, resulting in low efficiency in loading training sets. Third, frequent tuning of large model parameters and instability in the training platform leads to training interruptions approximately every two days on average. The Checkpoint mechanism is needed to recover training, and the fault recovery process takes more than a day.
Finally, the high threshold for large model implementation, complex system construction, difficult resource scheduling, and GPU resource utilization is usually below 40%. Huawei OceanStor A310’s deep learning data lake storage caters to different industries and scenarios in large model applications.
In the context of basic/industry large model scenarios, OceanStor A310 is a deep learning data lake storage solution that offers unlimited horizontal scalability and high performance for mixed workloads. It enables end-to-end massive data storage management for AI processes, including data collection, preprocessing, training, and inference. It possesses data analysis capabilities consistent with HPC and big data, allowing for the processing of data from similar sources.
Huawei is a Gold Sponsor of GITEX GLOBAL 2023 and the lead sponsor for the event’s cybersecurity program, Cyber Valley. Visit the Huawei booth in Hall 22, Dubai World Trade Center, at GITEX GLOBAL to experience the latest technology innovations and learn how the company is accelerating intelligence.
For more information about Huawei’s participation at GITEX GLOBAL, please visit the Huawei GITEX GLOBAL website: https://e.huawei.com/ae/events/2023/ae/gitex.
About Huawei
Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We have more than 207,000 employees, and we operate in more than 170 countries and regions, serving more than three billion people around the world.
Our Vision and mission is to bring digital to every person, home and organization for a fully connected, intelligent world. To this end, we will drive ubiquitous connectivity and promote equal access to networks; bring cloud and artificial intelligence to all four corners of the earth to provide superior computing power where you need it, when you need it; build digital platforms to help all industries and organizations become more agile, efficient, and dynamic; redefine user experience with AI, making it more personalized for people in all aspects of their life, whether they’re at home, in the office, or on the go.
For more information, please visit Huawei online at:
www.huawei.com
https://e.huawei.com/ae/
or follow us on:
http://www.linkedin.com/company/Huawei
https://www.linkedin.com/showcase/huawei-enterprise
http://www.twitter.com/Huawei
http://www.facebook.com/Huawei
http://www.youtube.com/Huawei
Middle East:
https://www.facebook.com/HuaweiTechME
https://twitter.com/Huawei_ME
