Scrape and collect data from LinkedIn sounds interesting. With over 22 million members, it's one of the largest professional social networks in the world.
Well known to professionals, LinkedIn allows them to develop their professional network, but also to prospect or look for a job.
The social network is full of interesting data for finding professional profiles or for recruiting. ScrapingBot offers a LinkedIn scraper to scrape and collect public data from LinkedIn profile pages and LinkedIn company profiles. Get the data you want in JSON, without any blocking!
You want to scrape LinkedIn profile pages, companies, posts, and more?
What data you can collect with our LinkedIn Scraper?
LinkedIn profile
URL, name, position, current company name & link, avatar, about, city, following, education details, posts, experience, education, certifications, courses, languages, groups.
LinkedIn company profile
URL, name, sphere, followers, employees number, about, locations, employees updates, websites, industries, company size, headquarters, type, founded
How to start scraping LinkedIn?
ScrapingBot is here to help you scrape LinkedIn profiles, company profiles and job results as easily and efficiently as possible.
Start scraping LinkedIn in 3 steps:
1. Create an account
Want to start scraping LinkedIn right now? No problem, ScrapingBot offers FREE access to begin! No payment information required, and no any engagement.
If you already have an account, just log in.
2. Configure your scraping
Once your account has been created, go to Documentation, to the "Data Scraper API" section to be able to start scraping what you want.
Setting up the endpoint is a two-step process with two API calls.
It's a little longer than usual because social networks have many protections to avoid robots and get scraped. These two calls make it possible to recover the data without being blocked.
Step 1 : Get your Response ID
First, you must make a first POST request to get the ResponseID which will be used later.
To do this, you must enter the following parameters in the body, then run a first API call:
- scraper
("linkedinProfile" to scrape LinkedIn profiles, "linkedinCompanyProfile" to scrape LinkedIn company profiles ) - url
The URL of the LinkedIn profile you want to scrape.
Here is the Request Endpoint:
http://api.scraping-bot.io/scrape/data-scraper
Step 2 : Configure your second request
Now that you have your responseId, you will be able to configure a GET request to ask for the response.
Here is the Response Endpoint:
http://api.scraping-bot.io/scrape/data-scraper-response?responseId=xxxx&scraper=name
Complete the Response Endpoint with these parameters:
- responseId
Insert here the Response ID that you had with the POST API call - scraper
You must fill in the same as that used previously for the POST API call ("linkedinProfile" or "linkedinCompanyProfile")
When it's ready, execute the API call. The result you will get will tell you if the scraping is ready to use or not.
If it's not, you will get this pending message:
{status: "pending", message: "Scraping is not finished for this request, try again in a few"}In this case, you have to try again until it's ready.
3. Let's scraping!
Your web scraping setup is now ready to use!
You can start collecting data from Linkedin Profiles and Company Profiles.
NB: If you need more help, a sample code to execute the call to this API is available in the documentation right here ("Data Scraper API" section).