中文长文本分类、短句子分类、多标签分类、两句子相似度(Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short),字词句向量嵌入层(embeddings)和网络层(graph)构建基类,FastText,TextCNN,CharCNN,TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
albertbertcapsulecharcnncrnndcnndpcnnembeddingsfasttexthankeraskeras-textclassificationleamnlprcnntext-classificationtextcnntransformervdcnnxlnet
keras_textclassification | ||
test | ||
__init__.py | ||
.gitignore | ||
LICENSE | ||
README.md | ||
requirements.txt |
Keras-TextClassification
keras_textclassification(代码主体,未完待续...)
- FastText
- TextCNN
- charCNN
- TextRNN
- TextRCNN
run(运行, 以FastText为例)
- 1. 进入keras_textclassification/m01_FastText目录,
- 2. 训练: 运行 train.py, 例如: python train.py
- 3. 预测: 运行 predict.py, 例如: python predict.py
- 说明: 默认不带pre train的random embedding,训练和验证语料只有100条,完整语料移步下面data查看下载
keras_textclassification/data
- 数据下载
** github项目中只是上传部分数据,需要的前往链接: https://pan.baidu.com/s/1I3vydhmFEQ9nuPG2fDou8Q 提取码: rket
- baidu_qa_2019(百度qa问答语料,只取title作为分类样本,17个类,有一个是空'',已经压缩上传)
- baike_qa_train.csv
- baike_qa_valid.csv
- embeddings
- chinese_L-12_H-768_A-12(取谷歌预训练好点的模型,已经压缩上传)
- model
- 预训练模型存放地址
项目说明
-
- 构建了base基类(网络(graph)、向量嵌入(词、字、句子embedding)),后边的具体模型继承它们,代码简单
-
- conf存放项目数据、模型的地址, data存放数据和语料, etl为数据预处理模块,
模型与论文paper题与地址
- FastText: Bag of Tricks for Efficient Text Classification
- TextCNN: ConvolutionalNeuralNetworksforSentenceClassification
- charCNN: Character-Aware Neural Language Models
- TextRNN: Recurrent Neural Network for Text Classification with Multi-Task Learning
- RCNN: Recurrent Convolutional Neural Networks for Text Classification
- DCNN: A Convolutional Neural Network for Modelling Sentences
参考/感谢
- 文本分类项目: https://github.com/mosu027/TextClassification
- 文本分类看山杯: https://github.com/brightmart/text_classification
- Kashgari项目: https://github.com/BrikerMan/Kashgari
- 文本分类Ipty : https://github.com/lpty/classifier
- keras文本分类: https://github.com/ShawnyXiao/TextClassification-Keras