Can you crawl data from LinkedIn?
My journey and exploration process on one cold winter night.
So it’s that time of the year again. It’s freezing outside, days are getting shorter and shorter, you feel like all you do is living in a world where the sun is on vacation somewhere south of wherever you’re staying right now. You find yourself asking: what’s the limit here? How many layers of socks and pullovers do I need to wear to not be freezing?
I love this time.
Why? Because when you’re forced to stay inside, you get bored. And when you’re bored, you get ideas. At least I’m like that. And I would like to share my most recent data adventure with you.
Can you write a script that scrapes data from LinkedIn?
It all started with this question. Well, to be honest, the whole journey started in 2018 when I decided to pick up programming again as a preparation for my master thesis. If you’re interested in my previous projects you can find more articles on my Medium profile page. They are mainly about social network analysis, especially Instagram. And if you are really really into this kind of stuff: I’ve published my 140+ pages master thesis Influencer Fraud on Instagram — A Descriptive Analysis of the World’s Largest Fake Engagement Community on…