Text-Classification-tutorial

Environment

• Ubuntu 20.04
• Python 3.9.5
• CUDA 10.1

Get started

git clone https://github.com/IKMLab/Text-classification-tutorial
cd Text-classification-tutorial
pip install -r requirements.txt

Download Dataset

• Currently support AG News dataset
  • Download link: https://www.kaggle.com/datasets/amananandrai/ag-news-classification-dataset

mkdir data
# organize data folder
mkdir data/agnews
mv archive.zip data/agnews/

cd data/agnews
unzip archive.zip
rm archive.zip
cd ...

Run EDA (Exploratory Data Analysis)

python simple_eda.py

Run training / evaluations

python main.py \
--data_name agnews \
--use_agnews_title \
--model_name bert-base-uncased \
--max_length 128 \
--batch_size 32 \
--test_batch_size 128 \
--num_epoch 1 \
--learning_rate 3e-5

• This will also be provided in the scripts/run_agnews.sh file.