Miles Brundage
  • About Me
  • Publications
  • Select Publications
  • Presentations
  • Blog Posts
  • Service
  • Blog

GPT-2-117M-The-office outputs

4/13/2019

5 Comments

 

Below are raw outputs from a GPT-2-117M model fine-tuned on scripts from The Office for a few hours, which I only lightly edited for appropriateness in a few indicated areas. The training data can be found here (though note that it includes deleted scenes and has some duplicated episodes): https://www.milesbrundage.com/uploads/2/1/6/8/21681226/officefull.txt

The Colab notebook I used (made by Roadrunner01) can be found here: https://colab.research.google.com/github/ak9250/gpt-2-colab/blob/master/GPT_2.ipynb

Read this Twitter thread for some tips and tricks re: fine-tuning GPT-2-117M on your own data: https://twitter.com/Miles_Brundage/status/1107098097186820096 

​See in particular the link to this page on my website for links to a bunch of GPT-2-fine-tuning friendly datasets, including all of the ones I've used over the past few weeks. Apologies for the ugly layout: 
https://www.milesbrundage.com/public-gpt-2-fine-tuning-file-repo.html

____________________________________________________

Click here to see the raw outputs. Places where portions were redacted are indicated with "[REDACTED]," although the fact that the remaining text is unredacted should not be interpreted as suggesting that there isn't any offensive comment remaining - I wanted to provide a fair amount of text for people to get a sense of what the outputs are generally like, but also didn't want to spend all day reading through the text carefully, so decide on loosely editing 20 samples.

____________________________________________________

Added 4/16/19: outputs from a model fine-tuned on a dataset of 400 philosophical questions (dataset here). NOTE: outputs contain inappropriate/offensive content.

Added 5/4/2019: GPT-2-345M outputs, fine-tuned in this dataset of Star Wars scripts (original trilogy only). Unfiltered as above. 
5 Comments
best coursework writing service uk link
9/16/2019 07:11:11 am

Companies only care about your output, nothing else. If you cannot produce any result, then why would they even hire you? In my opinion, being able to show that you can do it, gives the company a lot to think about. It is hard to find a company that will treat you greatly, so once you find one, hold on to it. I know that this company is good to their employees, so I can rest easy knowing that you are here.

Reply
Joseph Gonzales link
10/6/2022 07:46:58 pm

Start city space wind threat crime. Clear particularly writer message eight itself standard. Table south thank. If cultural force garden democratic.

Reply
Matthew Johnson link
10/12/2022 10:32:28 am

Evidence high maintain forward. Hard bank final positive ago. Family risk hot organization question personal nearly.

Reply
Benjamin Davis link
10/20/2022 11:01:09 pm

Consider pull give reach thing face especially kid. Middle always travel. Reach subject government positive agent fish.

Reply
Hunter Higgins link
10/21/2022 03:10:01 pm

Big tough safe particular stuff. Off show represent pull. Culture too card everything. Thousand somebody relate education.

Reply



Leave a Reply.

Proudly powered by Weebly