Twitter Profile Scraper

Overview

This app allows you to extract public information from multiple Twitter profiles at once. By providing Twitter profile URLs, you can quickly gather details like the user's handle, follower count, bio, join date, location, and more. This data is then saved in an Excel file, making it easy to analyze or use for your research and marketing purposes.

How to Use

1. Download the app from Octoparse AI app store

2. Launch the app in your list.

   1. Parameter Description

      1. addressFile: Provide the path to a file that contains the list of Twitter profile URLs (e.g., C:\Users\Desktop\XURL.xlsx).

      2. resultFile: Specify the folder where the collected data will be saved (e.g., C:\Users\Desktop).

      3. Browser: Choose the browser where you are logged into Twitter (e.g., Edge).

      4. BrowserID: If you're using AdsPower, enter the browser ID here. If using another browser, leave this field blank.

   2.   Click "Run application"

3. Output

This app will automatically scrape the public profile details for the provided Twitter URLs. A new Excel file will be created in your selected folder, containing the following information:

• query: The Twitter profile URL that was scraped.

• timestamp: The time the data was collected (saved as a timestamp).

• tweetsCount: The number of tweets posted by the profile owner.

• followers: The number of followers the profile has.

• following: The number of accounts the profile is following.

• likes: The number of likes the profile has received (Note: Likes can only be collected from the logged-in user’s own profile due to platform restrictions).

• lists: The number of lists the profile has created.

• twitterProfile: The user’s Twitter profile URL.

• bio: The bio description on the profile.

• handle: The Twitter handle (username) of the profile.

• location: The location listed in the profile.

• website: The URL of the user’s website, if provided.

• joinDate: The date when the profile joined Twitter.

• protectedAccount: Whether the account is protected (private).

• followback: Whether the profile follows you back (if applicable).

• canDM: Whether the profile allows direct messages.

• twitterId: The Twitter ID of the profile.

• alternativeProfileUrl: An alternative link to the user’s profile.

• name: The name displayed on the profile.

• verified: Whether the profile is verified with a blue check.

  Notes

  • Do not use the mouse or keyboard while the app is running to avoid interruptions.

  • Please install and enable the Octoparse AI web automation extension on your browsers.

  • Log in to Twitter before running the app. If you're not logged in, press Ctrl+B to pause the app and log in.

  Troubleshooting

  Encounter obstacles but don't know how to resolve them when executing the app?

  Please contact our support team at [email protected] to find the way out!

  To help us better understand your issue, follow the steps below to export your running logs: