使用 Hugging Face 以及 PyTorch 做一些 NLP 任务的 tutorial
代码相对简洁易懂,适合新手入门
如有任何问题,可以在 issues 中提出,也可以在 CSDN/friedrichor 私信我。
Windows: Windows 系统从零配置 Python 环境,安装CUDA、CUDNN、PyTorch 详细教程
Linux服务器: 远程服务器配置 Anaconda 并安装 PyTorch 详细教程
本地-服务器文件传输: 将本地项目/文件上传到远程服务器中详细教程(vscode,sftp)
备注:对话生成的代码同样适用于文本生成、文本摘要等 text-to-text 任务。
- DialoGPT
- paper: DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (ACL 2020)
- fine-tune DialoGPT for dialogue generation: code
- T5
- paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (JMLR 2020)
- fine-tune T5 for dialogue generation: code
备注:情感分析、主题分类、意图识别等任务均属于文本分类。
- BERT
- paper: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (NAACL 2019)
- fine-tune BERT for text classification: code
- prompt-tuning BERT for text classification: code
- RoBERTa
- paper: RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv 2019)
- fine-tune RoBERTa for dialogue generation: code
- T5
- paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (JMLR 2020)
- fine-tune T5 for text classification: code
- fine-tune T5 Encoder for text classification: code
更新中...