Particle.news

Download on the App Store

Google launches AI Edge Gallery app to run language models locally on Android

Installed via an APK from GitHub, the app runs local LLMs from Hugging Face on high-end Android devices

Image
Image
Google has launched a new app that will make AI fans happy.
Image

Overview

  • Google AI Edge Gallery is available as an experimental alpha release on GitHub and must be sideloaded via an APK on Android devices.
  • The app runs large language models entirely on-device to power AI Chat, Ask Image and Prompt Lab tasks without needing an internet connection.
  • Users download open-source models from Hugging Face or Google’s Gemma variants and can adjust settings such as tokens, temperature and processing accelerator.
  • High-end Android phones with capable CPUs and GPUs are required and users can monitor device temperature and battery consumption during AI tasks.
  • Google cautions that the experimental build may crash or produce inaccurate outputs and confirms an iOS version is coming soon.