This demo runs Llama-3.1-8B-Instruct-q4f32_1-MLC using WebLLM (https://github.com/mlc-ai/web-llm) in your browser. It is not intended for production deployments. Use at your own risk.