LinkedIn Message Thread Scraper

Overview

This app allows you to scrape LinkedIn message threads from multiple connections at once, including message content, sender, date, and more. The scraped data is saved in a local Excel file for easy access and analysis. Ideal for organizing LinkedIn conversations and tracking communication history.

How to Use

1. Download the app from Octoparse AI app store.

2. Launch the app in your list.

   

   1. Parameter Description

      

      1. ProfileUrls: Choose the file that contains the profile URLs. The app will start reading from the second row of the first column, with the first row as the header.

      2. ExportPath: Select the folder where you'd like to save the scraped data.

      3. Browser: Select the browser where the app will run.

      4. AdsPowerProfileId: If you’re using AdsPower, open a profile first and enter its ID here.

      5. StartDateForScraping:Select the start date to begin scraping message threads from. For example, selecting January 1st will scrape all messages from that date to the present.

   2. Click "Run application"

3. Output

   The app scrapes the following fields for each contact's conversation: Date, Author, First Name, Last Name, Profile Url, Headline, Img Url, Connection Degree, Input Url, and Message Content. The scraped data is organized by date and saved in an Excel file. If the app is run multiple times in one day, new records will be added to the existing file for that day.

   

Notes

• Before running the app, make sure to install the following Python packages: requests, pandas, chardet, and openpyxl. Installation instructions are shown in the image below.

  • Click on your user avatar in the client, go to "Tools" and select "Python Library Management."

    

  • Enter the package name in the "Library Name" field, click "Install" and wait for the installation to complete. Then, close the window and run the app.

    

• The file containing the profile URLs must follow this format: the first row is the header, and the URLs start from the second row.

  

• Please log into your LinkedIn account in the specified browser beforehand and ensure the browser is in full-screen mode while the app is running.

• Before starting the app, please ensure that all message conversation windows on your profile are closed to avoid interruptions.

  

• Do not use the mouse or keyboard while the app is running to avoid interruptions.

• Please adhere to LinkedIn's automation rate limits and manage the number of message threads you extract daily. It's recommended to start with a small number and gradually increase.

Troubleshooting

Encounter obstacles but don't know how to resolve them when executing the app?

Please contact our support team at [email protected] to find the way out!