intel-analytics ipex-llm
Accelerate local LLM inference and finetuning LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc. on Intel CPU and GPU e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max . A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex,...