9
14 Comments

How would you use Github Copilot?

Hey IH,

About a week ago, Github announced its AI pair programmer tool Copilot ✈️

Copilot banner

At first glance, it looks pretty promising. I believe that AI could definitely assist developers in their everyday task.


Now for your input.

  • Would you use Copilot in your day-to-day workflow?
  • Would it do all the repetitive tasks for you?
  • Would you just ignore it all together?
on July 9, 2021
  1. 2

    To create a challenger bank that only uses float for their money calculations 😍

    1. 2

      Haha yes please!!

      1. 2

        I'm raising money $15.000.000,00000001 if you want in write me a check 😏

        1. 2

          Hahaha taking banks to the moon! 🚀

  2. 2

    I haven't tried it yet, but I think the most you can get from a tool like this is TEMPLATING.

    You will still have to know ALL the engineering behind creating an app. It will take decades before a business man with an idea could build & deploy with just AI. It's not even an alternative to no code tools.

    1. 1

      Exactly. Repetitive tasks are definitely on my list.

  3. 2

    I dont have access to it but one of the devs at my day job has access to it and said that it is pretty good.

    Since I may not have access to it for a while I decided to give https://tabnine.com a shot and have been using that for a week.

    The verdict is that it is very underwhelming.

    Its a shame and I wanted to like it given how little chance I stand to have access to Copilot but it's the unfortunate reality.

    Tabnine is not a bad product, I would say that it gives me a good suggestion 10% of the time but it does not really justify the $15USD/month price tag.

    It's a bit like comparing a Renault Zoe to a Tesla. Once you have seen what a Tesla can do and there is no going back to something that does not perform as well.

    I have tested Tabnine with typed codebases and non typed codebases and the results are pretty similar.

    I would have assumed that the typed codebases would give Tabnine an edge but it barely makes a difference.

    I will continue using the extension for the next 3 weeks and most likely will cancel my subscription as the benefits are marginal at best.

    In essence what I foresee happening here is a winner takes all approach, why would you want as a dev use anything over Copilot if Copilot is at the same price point or even more expensive than Tabnine/other AI tools in this space?

    To catch up to Copilot, you would need first access to GPT-3(Tabnine uses GPT-2 with some custom models) which hard to get this days, two you'll need access to as much code as possible, then you need the cash that will pay for all the engineers that will work out the bugs and rough edges over time.

    That's not even getting into the legal side of this thing where you will have to defend your product against some (potentially legitimate) uproar from the dev community and people suing you for copyright infringement.

    In reality if Copilot becomes a public product that you can subscribe to, then Tabnine will be obliterated.

    It is just not possible to compete against it.

    Only another GAFA could enter this space and give Copilot a run for its money but the problem is that MS controls Github and I doubt that MS would simply let Google, Apple or Oracle have access to all the open source repositories knowing that this access would be required to create a potential competitor to a business that could easily be valued at billions of $ within the next few years.

    1. 1

      Exactly, I see what you mean. I’ve seen demos by Github’s team and what their first thoughts are and most of the time they weren’t super happy with the results.

      And if they were happy because it suggested a “console.log()” after millions of tries, then you have to think, “I could’ve done that. In like a fraction of the time” 🤷‍♂️ you still have to remember that nothing is perfect and there will always be revisions.

      But yeah, once Copilot is released, any other alternatives will go “bye bye” 👋

  4. 2

    Tried it for a bit, amazed by what I can predict, UX of how it predicts needs to be improved.

    Having to check its prediction really takes me out of the flow of programming. I’m slowing down because I’m reading prediction.

    If I don’t read the predictions, copilot will now and then make a tiny mistake (for example assuming I want to use .width vs .x of a rect object), those mistakes aren’t obvious if you miss them, thus taking more time to fix.

    1. 1

      I see what you mean. Totally.

      Just like Tesla’s autopilot. When someone tries it out the first time, they are freaking out and are on the egde of their seats. Worrying about where it’s going. That’s completely the opposite of what they’re trying to achieve.

      But once they get more accurate, the user will be more confident in it’s control. The same will go for Copilot.

      1. 1

        Not sure if it is the same as the bound set of things in driving is much larger, there are more rules and less choices, there are clear right and wrongs

        I've seen someone trail it and get a print loop that prints every third number, while there wasn't any input to say if you should print every number of every X, something like that could easily be missed and become an issue later

        1. 1

          Yep, that makes sense too. Even with clear rights and wrongs and how it is pretty much always right, we are still very hesitant and in the end may waste the same amount of time we would have if we typed it ourselves.

          Just comes down to actually accepting it.