3
19 Comments

GPT-3 to generate news content

I recently acquired a left wing news website in the US. The site currently uses Creative Commons articles to generate content.

I would like to create an app using GPT-3 that can generate news content. I know GPT-3 might better be served for generating headlines, but wondering if full article writing is possible.

Has anyone built something like this?

posted to Icon for group Developers
Developers
on December 14, 2020
  1. 4

    GPT-3 is like letting a riderless bicycle freewheel downhill.

    It looks amazing for a short time, freaky even, then hits a bump, goes in a surprising direction, flips over and crashes.

    It can generate full articles that are non-sensical. It can generate full articles that sound sensible to non-experts but don't stand up to scrutiny.

    A robot wrote this entire article. Are you scared yet, human?
    https://www.theguardian.com/commentisfree/2020/sep/08/robot-wrote-this-article-gpt-3

    If you are using GPT-3 to summarize a specific article or express same content in a different style then since problem more bounded I imagine could need less interaction.

    1. 1

      I have been wondering about this for the past few months.

      What was your procedure to create articles?

      What were you inputting? Was it somehow connected to the web? Where was it fetching the data from?

    2. 1

      Thanks I appreciate the feedback!

  2. 2

    This is currently not a supported use case - and likely will remain so in future given how hard it would be to mitigate risks (See https://openai.com/charter/).
    Both of the following fall under their "no-quota" use cases:

    • "Applications for the automated writing of news articles or summaries for political, economic, medical, or sensitive cultural content."
    • "Applications for scalably generating synthetic articles or blog posts for SEO purposes."

    I've been experimenting with GPT3 for months and can say that this is partially possible - especially short articles, as Rab mentions in comments at some point GPT3 falls off the bicycle. Certain domains work better than others. For example, I was able to generate short theonion.com style articles with amazing results in a scalable and hands off manner. Other types of articles benefit from human in the loop steering. As far as I understand, that is still an unsupported use case, but we are inching towards use cases such as those with the likes of copy.ai (which given OpenAI's use case guidelines, I initially didn't think would be supported).

    If you don't have access yet, you may get in the near future as OpenAI have been giving access to more and more people lately.

  3. 2

    I am also hoping to find out if GPT-3 can help me generate content for my website. I need well over 100,000 articles for this website so ANY tool I can use to automate any part of the process of writing these articles would be very important to me.

    I have seen where several examples of content have been submitted to GPT-3 and then it was used to generate a new piece of content. So I am hoping that I can take my content research tool that generated summaries of the top 20 search results for a search phrase and then provides a list of major topic (headings) in each article and summaries of those sections of the websites. It also generates a combined list of all the keypwrds (topics) it finds in all 20 of the articles. What I am hoping to do is deliver those text summaries from ALL 20 articles to GPT-3 along with the list of keywords and have it generate an article that more completely covers the search request than any single one of the existing articles. My goal is to use the Skyscraer technique of writing a BETTER article as a way to get top rankings for the search phrase.

    I don't need to build a system that takes a search request (keyword porase) and generates an article...I only want to use eXISTING articles that rank for the search phrase and use GPT-3 to write a better more complete article.

    Does anyone here know of any project that is focused on this...or of any code developer that I could hire to build such an interface to GPT-3?

    1. 1

      BT W did you find any solution, I am also looking for something on the same lines but am not as technically learned as you!!! I thought if you were successful I may use their services also.

  4. 2

    Well technically possible but requires a lot of prompting engineering and it is not clear if it actually will be just gibberish and does not follow any actual / real news or event.

    1. 1

      Interesting. Essentially we would be taking Creative Commons text, input it into GPT-3 and hoping for a retooled text.

      The main reason is to help with SEO which can be impacted by Creative Commons.

      1. 1

        But that's not how it works or how are you intending to feed in the COO text? You leave out every 2nd/n-th sentence or every 2nd/n-th word? If you just feed in the text in the prompt it will just continue spinning the text. You can not fine-tune the model unlike GPT2 because they do not give access to that (AFAIK).

        1. 1

          Thats good to know. I haven't had access so wasn't sure the details.

  5. 2

    Well, there are tools that are already doing that, without gpt-3 (wordai....)

    1. 1

      Thanks Tim, this is a good input.

  6. 2

    Sounds like a pretty genius way to make a content farm. Have you heard of copy.ai? They use gpt to generate headlines for websites. I guess you'd just be taking it one step further =D

  7. 1

    Hi Andrew,
    We recently built https://ansy.ai/, it is a Discord bot that will answer community questions based on chat history of public channels. Cool way to save time of mods. We launched it on Product Hunt as well. https://www.producthunt.com/posts/ansy-ai . Do check us out and let us know what you think.Your feedback will be super helpful.

  8. 1

    What was your experience getting access to GPT-3? Was it easy?

  9. 1

    I heard they're not allowing making blog posts using GPT3

    1. 1

      You're correct. It's literally one of the first things you agree to when you get your keys.

  10. 1

    Do you have access to GPT-3? I heard it wasn't that easy to get access to it.

    1. 1

      No, hoping to find someone with experience to help build this.

  11. 1

    This comment was deleted 5 years ago.

Trending on Indie Hackers
1 small portfolio change got me 10x more impressions User Avatar 30 comments AI Is Destroying the Traditional Music Business and Here’s Why. User Avatar 29 comments Fixing my sleep using public humiliation and giving away a Kindle User Avatar 23 comments A Tiny Side Project That Just Crossed 100 Users — And Somehow Feels Even More Real Now User Avatar 16 comments From 1k to 12k visits: all it took was one move. User Avatar 11 comments Tell me what your business does, I’ll show you the growth loops you’re probably missing. User Avatar 10 comments