stevhliu/astroGPT

The astroGPT model is a GPT-2 model fine-tuned on Western zodiac signs . It does not support zodiac sign-specific generation and only returns a general horoscope . The data was scraped from Horoscope.com and trained on 4.7MB of text . The model was trained with on one of Google Colaboratory's GPU's for approximately 2.5 hrs with fastai's learning rate finder, discriminative learning rates and 1cycle policy . It has a vocabulary size of 50,257 and sequence length of 1024 tokens . The text was collected from four categories (daily, love, wellness, career) and span from 09/01,