Home
Starting Up
Case Studies DB
Products
Ideas DB
Vibe Coding Tools
Subscribe to IH+
Starting Up
Case Studies
Ideas DB
Products DB
Join
4
Likes
10
Comments
What challenges are you facing with data or analytics?
by
Noah Hart
What challenges are you facing with data or analytics?
As a data analyst -- cleaning.
Cleaning messy data sets with duplicates (not the straight forward kind), missing values, structural errors, etc., can be a huge, huge pain. I bet the person who invents an automated solution to do this will be handed over a million dollars on a golden plate.
Do you have any examples of your usual process and the types of data you handle and what you want to do with it?
Example -- joining multiple large (10,000+ records) data sets of companies together to create one comprehensive list for a supply mapping assignment.
When all of the lists don't have the same columns or information, that's where it gets interesting (and painful).
The case differs with every assignment and data set we receive so I can't really standardize how we handle it and what we want to do with it. At this stage, it just requires a lot of human input to get it to a point where we can even begin to extract insights from it.
What kind of data are you usually dealing with?
Primarily structured data extracted from various sources. Extracted from APIs, purchased from a third party provider, or transactional information provided by the client. Once in a while we'll deal with unstructured data as well such as images.
Every data set we get is different and every objective with it tends to be so as well. It's difficult to standardize the cleaning process when you're looking at different formats, types, and column meanings each time.
I'd like to see a tutorial that upon scanning the page it's obvious I'll be able to implement it without headaches and trial-and-error.
The tutorial would be on how to proxy analytics assets and requests with Nginx so that they don't get blocked by ad blockers. I've seen many tutorials, but when I read them over, I sigh and move on by judging that it's not worth the pain.
I want better analytics for firebase and our user accounts. I want metrics on user engagement and GA really falls apart here
Yeah, GA is great for an overview, but seems a lot more difficult to extract more actionable data from
I never understood why GA doesn’t put together useful dashboards and present them by default. Maybe allow people to choose industry and show some simple mid level and advanced actionable data in easy to use dashboards. Instead, they make others put them together.
I keep dreaming of installing Piwik or Countly so that I can have access to all the data and query it to my heart's content but I never get around to it. More important things on the roadmap for now.