Easy GPT2 fine-tuning with Hugging Face and PyTorch

I’m sharing a Colab notebook that illustrates the basics of this fine-tuning GPT2 process with Hugging Face’s Transformers library and PyTorch. It’s intended as an easy-to-follow introduction to using Transformers with PyTorch, and walks through the basics components and structure, specifically with GPT2 in mind. …

Posted on

Fine-tuning OpenAI's GPT-2 to generate fake DJ biographies

For fun, I wanted to see if I could fine-tune OpenAI’s GPT-2 model to generate DJ and electronic musician biographies. Although it’s only my opinion, it performed impressively. With only a modest amount of training, the model’s output gets close to the source material. …

Posted on

Hello, world

It is customary to write some filler for an inaugural post on a blog, and here is my contribution to that time-honoured tradition. The pages of this site are intended to filled with musings about personal projects and thoughts relating to data science. …

Posted on

about

This site is intended to cover a range projects and ideas relating to my work and personal interests. Professionally, I’m a principal data scientist with experience leading projects across industries and problem spaces, solving problems from implementing data-informed decision making to innovating with AI. …

Posted on