[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
-
Updated
Oct 18, 2024 - Python
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
Build LLM-enabled FastAPI applications without build configuration.
Fine-tuning open-source large and small instruct/chat language models (LLMs & SLMs) from the Hugging Face Model Hub using public datasets.
Add a description, image, and links to the smollm topic page so that developers can more easily learn about it.
To associate your repository with the smollm topic, visit your repo's landing page and select "manage topics."