• Guest Post   |
  • Submit App Review   |
  • Submit PR   |
  • Advertise   |
  • Contact Us
  • Login
No Result
View All Result
Submit App Review
Mobile App Development | Design | Marketing Magazine: Appedus
Subscribe
  • Home
  • App Development
  • App Marketing
    • All
    • App Onboarding
    • App Store Optimisation
    • App User Engagement
    • Push Notifications
    increase-your-app installs organically

    5 Best Tips to Increase App Installs Organically.

    15 best apps-for-users

    know 15 Best Apps with Awesome User Onboarding Experiences

    How-to-Create-a-Mobile App-Marketing-Strategy-That-Works-appedus

    How to Create a Mobile App Marketing Strategy That Works

    How-to-Monetize-Your-Mobile-App-Strategies-for-Success-Appedus

    How to Monetize Your Mobile App: 5 Best Strategies for Success in 2023

    Trending Tags

      • App Store Optimisation
      • App User Engagement
      • App Push Notifications
      • App Onboarding
      • App Analytics
    • App Design
    • App Reviews
      • All
      • Books & Reference
      • Business
      • Dating
      • Education
      • Finance
      • Fitness
      • Food & Drink
      • Health
      • iOS apps
      • Lifestyle
      • Medical
      • Mobile Games
      • Photography
      • Productivity
      • Shopping
      • Social
      • Travel
      • Utilities
      • Video Editing
      chessvision-ai-app-review

      Chessvision.ai: A Comprehensive App Review

      Top 5 Online Pharmacy Apps in United Kingdom

      Top 5 Online Pharmacy Apps in United Kingdom

      Advanced Uninstall Manager app

      Advanced Uninstall Manager App Review 2023 | Remove Unnecessary Applications

      best-5 Free Hiking and Trail Apps

      Top 5 Free Hiking and Trail Apps

      Top invoice makers

      Top 5 Best Free Invoice Makers for Freelancers and Businesses

      Top-10-Wearable-App Development-Company

      Top 10 Wearable App Development Companies

      Cryptocurrency Apps

      Top 10 Cryptocurrency Apps in the USA

      Trailforks App Review: Best App for Mountain Bike, Hiking, Moto, Horseback & Ski Trail Maps

      Trailforks App Review: Best App for Mountain Bike, Hiking, Moto, Horseback & Ski Trail Maps

      top-10-trading apps-in-canada

      Top 10 Trading Apps In Canada

      Trending Tags

      • Travel
      • fitness
      • Video Editing app
      • Utilities
      • Lifestyle
      • Medical
      • Photography
      • Productivity
      • Shopping
      • Social
      • Travel
    • App Events
    • Exclusive
    • Home
    • App Development
    • App Marketing
      • All
      • App Onboarding
      • App Store Optimisation
      • App User Engagement
      • Push Notifications
      increase-your-app installs organically

      5 Best Tips to Increase App Installs Organically.

      15 best apps-for-users

      know 15 Best Apps with Awesome User Onboarding Experiences

      How-to-Create-a-Mobile App-Marketing-Strategy-That-Works-appedus

      How to Create a Mobile App Marketing Strategy That Works

      How-to-Monetize-Your-Mobile-App-Strategies-for-Success-Appedus

      How to Monetize Your Mobile App: 5 Best Strategies for Success in 2023

      Trending Tags

        • App Store Optimisation
        • App User Engagement
        • App Push Notifications
        • App Onboarding
        • App Analytics
      • App Design
      • App Reviews
        • All
        • Books & Reference
        • Business
        • Dating
        • Education
        • Finance
        • Fitness
        • Food & Drink
        • Health
        • iOS apps
        • Lifestyle
        • Medical
        • Mobile Games
        • Photography
        • Productivity
        • Shopping
        • Social
        • Travel
        • Utilities
        • Video Editing
        chessvision-ai-app-review

        Chessvision.ai: A Comprehensive App Review

        Top 5 Online Pharmacy Apps in United Kingdom

        Top 5 Online Pharmacy Apps in United Kingdom

        Advanced Uninstall Manager app

        Advanced Uninstall Manager App Review 2023 | Remove Unnecessary Applications

        best-5 Free Hiking and Trail Apps

        Top 5 Free Hiking and Trail Apps

        Top invoice makers

        Top 5 Best Free Invoice Makers for Freelancers and Businesses

        Top-10-Wearable-App Development-Company

        Top 10 Wearable App Development Companies

        Cryptocurrency Apps

        Top 10 Cryptocurrency Apps in the USA

        Trailforks App Review: Best App for Mountain Bike, Hiking, Moto, Horseback & Ski Trail Maps

        Trailforks App Review: Best App for Mountain Bike, Hiking, Moto, Horseback & Ski Trail Maps

        top-10-trading apps-in-canada

        Top 10 Trading Apps In Canada

        Trending Tags

        • Travel
        • fitness
        • Video Editing app
        • Utilities
        • Lifestyle
        • Medical
        • Photography
        • Productivity
        • Shopping
        • Social
        • Travel
      • App Events
      • Exclusive
      No Result
      View All Result
      Mobile App Development | Design | Marketing Magazine: Appedus
      No Result
      View All Result
      Home Featured

      Unleashing China’s Secret Weapon: Kai-Fu Lee’s Game-Changing LLM

      Explore the secrets of 01.AI's bilingual LLM and why it's making waves globally

      by Editorial
      November 9, 2023
      in Featured, News-Curated, Tech
      Reading Time: 4 mins read
      0
      kai-fu-lee

      source: Instagram/kai-fu-lee

      Share on FacebookShare on Twitter

      Table of Contents

      • Kai-Fu Lee’s Game-Changing LLM

      Kai-Fu Lee’s Game-Changing LLM

      In late March, Lee launched a company called 01.AI with the vision to develop a homegrown large language model for the Chinese market. The venture puts him in competition with other prominent Chinese tech leaders, including Sogou’s founder Wang Xiaochuan, who have been swiftly gathering talent and venture capital to establish China’s equivalents of OpenAI.

      “I think necessity is the mother of innovation, and there’s clearly a huge necessity in China,” Lee, who’s 61 and leading 01.AI as CEO, explained the motive behind starting the company. “Unlike the rest of the world, China doesn’t have access to OpenAI and Google because those two companies did not make their products available in China, so I think many doing LLM are trying to do their part in creating a solution for a market that really needs this.”

      01. AI’s growth is a fitting reflection of the rapid development in the generative AI field. Seven months after its founding, the startup has released its first model, the open-source Yi-34B. The decision to introduce an open LLM as its debut product is a way to “give back” to society, said Lee. For people who have felt LLaMA is a “godsend” to them, “we’ve provided a compelling alternative,” he added.

      As of writing, Yi-34B, which is a bilingual (English and Chinese) base model trained with 34 billion parameters and significantly smaller than other open models like Falcon-180B and Meta LlaMa2-70B, came in first amongst pre-trained LLM models, according to a ranking by Hugging Face.

      “We still believe that larger models, when trained well on a large amount of high-quality data, will always outperform substantially smaller models of comparable quality and comparable technology, so I think [Yi-34B] outperforming much larger models is something that we don’t usually see,” said Lee. “We feel quite confident that as we release models that are 100 billion to 400 billion over the next year and a half, these models will be dramatically better than today’s model that we announced.”

      The startup’s ability to commence model training quickly is no doubt an outcome of its smooth fundraising, which is critical to securing top-tier talent and AI processors. While declining to disclose how much 01.AI has raised, Lee said it’s valued at $1 billion after receiving financing from Sinovation Ventures, Alibaba Cloud, and other undisclosed investors.

      01.AI has already grown to more than 100 employees, over half of whom are LLM experts from major multinational and Chinese tech firms. Its vice president of technology, for instance, is an early member of Google’s Bard, and its chief architect was a founding member of TensorFlow and worked alongside renowned researchers like Jeff Dean and Samy Bengio at Google Brain. The key figures behind Yi-34B are Wenhao Huang, a Microsoft Research Asia veteran, and Ethan Dai, who held senior AI positions at Huawei and Alibaba.

      Having backed over ten unicorns and venture-built seven companies through Sinovation Ventures, Lee is possibly one of the most well-connected investors and entrepreneurs in China.

      “It’s been, you know, over 25 years since the founding of Microsoft Research Asia, and everything I’ve done has been about getting super great talent,” said Lee, who launched Microsoft Research Asia, the U.S. giant’s biggest research center abroad, before spearheading Google China. Over the years, Microsoft Research Asia has earned the reputation of being the “West Point” for nurturing China’s AI entrepreneurs.

      “Now, of course, you want to pay people fairly, and you need to be competitive in pay, but I really think that it’s also about people believing they can make a difference and believing the company can succeed,” said Lee, appearing in a video call at 9:30 p.m. Beijing time. His staff was just as self-motivating. One of the startup’s infrastructure experts was working well into the wee hours that day, still messaging Lee at 2:15 a.m. to express his excitement about being part of AI’s mission.

      It’s no secret that building LLMs is a costly undertaking. To sustain its cash-intensive operations, 01.AI has plans for monetization right from the start. While the company will continue to open source some of its models, its objective is to build a state-of-the-art proprietary model that serves as a foundation for a diverse range of commercial products.

      “We can’t open source everything,” said Lee. “We were quite cognizant of the fact that these large language models require a lot of computing and, therefore, are very expensive. When we raise a lot of money, most of it will be spent on the GPU. Given that, we needed to first acquire as much GPU as we could, which we did.”

      Like other LLM players in China, 01.AI has proactively stockpiled GPUs in anticipation of U.S. sanctions; it borrowed money to buy processors even before it landed funding. Over the past year, the Biden administration has heightened restrictions on China’s access to high-end AI chips, prompting Chinese firms to pay inflated prices for chips. The foresight was rewarded—01.AI now has a supply that will suffice for at least the next 12–18 months.

      Aside from causing headaches for Chinese firms, U.S. sanctions have been a catalyst for innovation by encouraging them to optimize the use of computing power. “With a very high-quality infrastructure team, for every 1000 GPUs, we might be able to squeeze 2,000 GPU workloads out of them,” said Lee.

      01. AI’s path to monetization hinges largely on its ability to find a product-market fit for its expensive AI models. While top-notch LLM scientists are scarce, there’s no shortage of product talent in China.

      “China’s not ahead of the U.S. in LLM, but there’s no doubt China can build better applications than American developers mostly because of the phenomenal mobile internet ecosystem that was built over the last 12 years or so,” argued Lee.

      While the founder gave no details on the services in the pipeline, he hinted that the company is experimenting with concepts in the productivity and social directions, and he’d be “disappointed” if 01.AI didn’t release an app within this calendar year.

      The startup’s ultimate goal, according to Lee, is to become an ecosystem where outside developers can build applications easily. “The duty is not just to push out good research models, but even more importantly to make application development easy so that there can be compelling applications,” he said. “At the end of the day, it is an ecosystem play.” Time will tell if Lee’s AI endeavor will pay off.

      mm

      Editorial

      We are a digital magazine focused on the mobile app ecosystem aggregating, writing and publishing the best of the tech news in the mobile app ecosystem. Our constant endeavor is to get the most actionable news for you to use.

      Next Post
      Viber App Review

      Viber App Review 2023 | An amazing social media app

      Weekly Newsletter

      Top Apps This Week

      chessvision-ai-app-review
      Featured

      Chessvision.ai: A Comprehensive App Review

      by Editorial
      November 30, 2023

      ChessVision.ai: A Comprehensive App Review As a chess enthusiast, I've...

      Read more
      Top 5 Online Pharmacy Apps in United Kingdom

      Top 5 Online Pharmacy Apps in United Kingdom

      November 30, 2023
      Advanced Uninstall Manager app

      Advanced Uninstall Manager App Review 2023 | Remove Unnecessary Applications

      November 29, 2023
      Load More

      About Us

      mobile app technology magazine

      Appedus is a mobile app ecosystem focused news publishing platform which covers various topics like app design, app development, app marketing and other relevant news, views or opinions. We also publish industry insights, e-books, developer interviews and e-magazines. You can get in touch with us on hola@appedus.com or you can snail mail us at

      Medianiti Ltd. Brooklands Business Park, Wellington Way, Weybridge KT13 0TT, United Kingdom

      Latest Articles & News

      Mobile Game Engines and Development Platforms for Beginners and Experts

      Top 10 Mobile Game Engines and Development Platforms for Beginners and Experts

      November 30, 2023

      Important Links

      • Guest Post
      • Submit App Review
      • Submit PR
      • Mobile App Marketing
      • Mobile App Reviews | Top Android & iOS app reviews
      • Top Apps
      • Curated News
      • Advertise
      • Contact Us

      Subscribe

      • About Appedus
      • Advertise
      • App Events
      • Appedus
      • Contact Us
      • Contact Us
      • Donation Confirmation
      • Donation Confirmation
      • Donation Failed
      • Donation Failed
      • Donor Dashboard
      • Donor Dashboard
      • Exclusive at Appedus
      • Our Authors, Contributors & Writers
      • Payment Confirmation
      • Payment Failed
      • Privacy Policy
      • Submit App for Review
      • Submit Free Press Release
      • Tip-Off
      • Write For Us | Mobile App Development Guest Post

      © 2023 Appedus - Appedus All Right Reserved

      No Result
      View All Result
      • About Appedus
      • Advertise
      • App Events
      • Appedus
      • Contact Us
      • Contact Us
      • Donation Confirmation
      • Donation Confirmation
      • Donation Failed
      • Donation Failed
      • Donor Dashboard
      • Donor Dashboard
      • Exclusive at Appedus
      • Our Authors, Contributors & Writers
      • Payment Confirmation
      • Payment Failed
      • Privacy Policy
      • Submit App for Review
      • Submit Free Press Release
      • Tip-Off
      • Write For Us | Mobile App Development Guest Post

      © 2023 Appedus - Appedus All Right Reserved

      Welcome Back!

      OR

      Login to your account below

      Forgotten Password?

      Retrieve your password

      Please enter your username or email address to reset your password.

      Log In
      This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy and Cookie Policy.
      Go to mobile version