On Device

MLC-LLM: LLMs on Every Device

MLC-LLM enables running large language models natively on any device — laptops, phones, browsers — without a server, by compiling models through the Apache TVM compiler stack. One of the earliest frameworks to make on-device LLM inference practical across diverse hardware.