Recently was talking with someone looking to get a job as a data engineer. Unfortunately he was learning about LLMs and other ML stuff so I had to set him straight 😁

There are two reasons most managers don't use data to improve the business:
1. They lack a solid methodology
2. They have a fundamental distrust of data

Just like a map is the representation of the territory, data is the representation of business as it currently stands.

And just like a map data works best when it provides guidance and options on how to proceed.

The most powerful analytics pattern, capable of producing incredible insights, is segmentation.
There are two forms of segmentation:
1. By product attributes
2. By customer attributes

I hate jinja and yaml. That shit can go to hell

Typical data storytelling:
- Look at some data and make up a story
- Choose the data that fits the story

Proper data storytelling:
- Make up a theory and validate it with data
- Update theory until it fits data

When I finally grasped statistics…

I think executives are intimidated by data.

They’re expected to know how to use data but nobody showed them how to do it properly.

Using data properly starts by first determining what the goals or objectives are.

Next you need to map the goals to a metric that facilitates fast feedback loops.

How the Dodgers used analytics to win the World Series (albeit there not a lot about analytics)
open.substack.com/pub/huddleup...

I’m starting to get curious about high level questions like “what do highly effective data driven organizations look like?” Any good resources (books, articles, papers) I can dive into?

So I guess I don’t have to post data thought leadership-y stuff here….yet?