Home > News > Hardware

Intel AI Innovation Competition Concludes: CPU+GPU+NPU Trifecta Gears Up

Shang Fang Wen Q Mon, May 13 2024 08:50 AM EST

AI computing is on the rise, and beyond the fundamental hardware components like CPU, GPU, and NPU, the crucial aspect lies in the ecosystem integration of application software and scenarios. Only by truly transforming people's daily work and life experiences through applications, bringing genuine convenience, can AI computing achieve success.

As a pioneer in the industry, Intel not only spearheaded the concept of AI computing but also introduced the groundbreaking Core Ultra processors and a plethora of AI-powered laptops, leading PCs into the AI era comprehensively. Intel has spared no effort in expanding the ecosystem, solidifying its position as an industry leader. S2bbad5be-039a-41b4-b9ce-cc368c930480.png According to Intel's grand vision, the shipment volume of AI PCs in 2024 is expected to reach around 40 million units, and by 2025, this market size will exceed 100 million units, entering millions of households.

In order to enable developers to better utilize various AI tools, hardware, and software, Intel has fully leveraged its comprehensive accumulation in open source, technology, and ecosystem over the past 20 years to drive the rapid development of AIGC.

Currently, globally, there are over 20 categories of 500 AI models optimized on Intel Core Ultra, covering various categories of local AI inference, including natural language processing, diffusion processing, super-resolution, object detection, image classification/segmentation, computer vision, and more, such as OpenVINO Model Zoo, Hugging Face, ONNX Model Zoo, PyTorch, Phi-2, Mistral, Llama, Bert, Whisper, Stable Diffusion 1.5, and so on. S455a7a80-f1bf-42c8-9344-9a5cfa412d1b.jpg

S1fbd8f15-a055-4e5d-8532-bc979c36ead5.jpg On December 16, 2023, just one day after the official release of the Core Ultra processor, Intel launched the AI Innovation Challenge, providing a platform for developers to showcase their creativity and achievements, helping each developer seize the opportunities brought by generative AI.

In the end, outstanding works from 30 teams stood out and advanced to the final competition. The VidBot team from the individual track and the Panda AI team from the enterprise track both won first prizes, each receiving a prize of 50,000 RMB.

Additionally, there were 2 second prizes, 3 third prizes, and 9 special prizes for each track, with a total prize pool of 525,000 RMB. Scaea36fe-296f-4ad5-87af-c6041ec5fdf3.jpg The competition is divided into individual and enterprise tracks, with a total of up to 2120 teams registering and submitting 1083 entries.

These AI applications are innovative, creative, practical, and deployable, covering a wide range of fields such as the internet, education, healthcare, agriculture, construction, law, retail, culture and tourism, industry, energy, gaming, film and television, advertising, and more.

This clearly demonstrates the enthusiasm for generative AI and the high expectations and optimism for its broad prospects. S950d1838-2b5a-4fb2-80f1-efee98f215d9.jpg

S2bdb52ed-4ceb-4b47-89b6-d6084680fe8f.jpg During the preliminary stage in February this year, the competition held 10 training and community coaching sessions. In March, there was an innovation application special competition, followed by expert coaching and in-depth optimization stages in April and May.

To assist participants and developers, Intel not only offered its own open-source software frameworks and optimization toolchains like OpenVINO, oneAPI, and IPEX-LLM, but also collaborated with the entire ecosystem to provide a wealth of AI large models covering various aspects of generative AI. S69f5a58f-d01b-46df-aad2-a0d180e15a38.jpg Interestingly, Intel also disclosed the usage of XPU in their entry.

CPUs are suitable for general workloads, offering fast response times and low latency. GPUs provide high computing power and throughput, significantly accelerating content creation. NPUs, on the other hand, are designed for sustained low workloads with the lowest power consumption. Each of the three engines has its own characteristics, working together to form Intel's XPU strategy.

Currently, CPU+GPU remains the absolute mainstream, with a much higher usage rate compared to other solutions. Encouragingly, new applications that utilize all three engines - CPU, GPU, and NPU - are continuously emerging. Sc8d3c127-6f7c-471d-b747-a9a3faff6527.jpg

Sd43e2669-3594-4557-98d6-91aa1e1db5e2.jpg As the exclusive AI PC partner for the competition, Lenovo has provided strong support, including AI PC devices, application development and ecosystem, prizes, and professional judging.

At the same time, Lenovo is comprehensively advancing AI PC products and applications, particularly pioneering the definition of five key features of AI PCs: embedded personal large models for natural user interaction, local heterogeneous AI computing power (CPU/GPU/NPU), personal knowledge base, open AI application ecosystem, and personal data and privacy protection.

In terms of the ecosystem, Lenovo's AI PCs come pre-installed with a comprehensive range of AI applications, with the first batch including ten applications covering various experiences, such as AI artist, AI PPT, document summarization, knowledge Q&A, AI image recognition, meeting minutes, intelligent assistant, device optimization, AI device migration, and AI services. S3021da80-5129-4db5-a88a-34e7784ed461.jpg The recent AI Innovation Application Competition may have come to a close, but it is far from over. Intel will continue to nurture the competition's projects through various efforts such as ecosystem channels, marketing promotions, and technical support, bringing AI from the cloud to benefit everyone.

More importantly, AI on PCs is just getting started, and Intel's initiatives will unfold one after another. They will persist in supporting developers to enter the new AI market through training, application promotion, resource matching, and market expansion. The previously launched AI PC Developer Program and Enterprise AI Open Platform will also continue to strengthen, promising a bright future.

Now, let's take a look at the brief introductions of the outstanding works from the AI Innovation Application Competition: Sb4c383e1-b79c-4d91-9146-f9097d0dc03e.jpg

Sab065a97-69ba-49e6-aa0b-c81cc277e5ec.jpg

S2c8a870e-78ef-46a0-953a-c74585176403.jpg

S58caddc5-1aff-4a9e-a9ba-f88203bb28cb.jpg

S4bf4c672-9f18-49ae-b098-7a99bd77946e.jpg

S4d1cafb4-d14d-431d-bf25-9560734e3427.jpg

Se63db852-9eaf-4ea1-b752-9182be42c69c.jpg

S77a1abe7-4e59-407a-8d10-f3e3edb290be.jpg

S2cb6bcb8-27bf-4a88-b8c5-9e4e8495c80a.jpg

S36ed011c-3ee7-4914-b148-7ffc178d9716.jpg

Sc6a7a53c-3489-42ce-9b2d-2ed01aa67bef.jpg