Built a dashboard to analyze how AI skills are showing up in data science job postings (open source)
I've been scraping thousands of U.S. data science jobs for the past couple of months and writing about the findings in my newsletter.
At some point, I figured the dashboard was more useful than anything I was writing, so I decided to open source it.
Here's what it covers:
- Top skills companies are actually hiring for, ranked by frequency
- Skills broken down by category (ML/DL, GenAI, Cloud, MLOps, etc.)
- What % of roles now require AI skills, broken down by seniority level
- Salary premium for candidates with AI skills
- An interactive explorer where you can browse individual postings with matched skills highlighted
The skill extraction is built on around 230 curated keyword groups, so it's pretty granular.
Code and data are all in the repo if you want to fork it or dig into the methodology.
https://ai-in-ds.streamlit.app/
I'm scraping weekly, and soon I will upload all of the raw data into Kaggle, for now, you can find the data in the repo
P.S. By the way, I already mentioned it to Luke Barousse since some of these AI keyword groups could be worth adding into his dashboard.
[link] [comments]
Want to read more?
Check out the full article on the original site