Glue

Data pipeline and automation tool.

Visit Website
March 10, 2021 Finished MVP

That took longer than I thought...

I'm generally a fast worker (I think) but getting everything pieced together just took a while. I was spending half of my time contracting so that slowed things down.

I had a pretty high standard as I was building. Especially with the front end. I think the most important part of the app is the front end. I'm really doing anything new on the backend. Simply hooking the user up to backend pandas methods.

I'm pretty happy with how the app turned out. There are more devOps related things I added that I didn't expect to add and less node functionality than I hoped but I think the compromise was important. I need to talk to users to figure out what new features (new nodes) they want before going gang busters on random functionality.

Comment

September 1, 2020 Started work on the MVP

After having traveled for 5 months, bought a house and had a kid I was finally able to start working on Glue. It's likely going to take a while given the scope of the project. My hope is that it will be something that I can also use which will be a first for me.

Glue is a drag and drop, code free, code friendly tool for building data pipelines and exploring data.

I'm going to be using Electron, React and Python. Pandas will form the core of the backend that will run the graphs.

I want to make the tool friendly to developers and data scientists

Comment

About

We should be constantly striving for better interfaces to data and the processes around it. Excel is a great tool for small data sizes and non repeatable tasks but has major limitations with repeatability and scale.