scraping-twitter-profile-tweets

Scraping Twitter Profile Tweets

Raw data collection. No assumed use case — returns the full dataset for downstream analysis.

---

Inputs

Parameter	Type	Required	Default	Notes
startUrls	array	Optional	[]	Twitter profile URLs (x.com or twitter.com formats)
twitterHandles	array	Optional	[]	Twitter usernames (without @)
start	string	Optional	—	Tweets after this date (YYYY-MM-DD or YYYY-MM-DD_HH:MM:SS_UTC)
end	string	Optional	—	Tweets before this date (YYYY-MM-DD or YYYY-MM-DD_HH:MM:SS_UTC)
includeNativeRetweets	boolean	Optional	false	Include native retweets in results
onlyImages	boolean	Optional	false	Only tweets containing images
getReplies	boolean	Optional	false	Include tweet replies
minReplyCount	number	Optional	—	Minimum reply count threshold
getAboutData	boolean	Optional	false	Fetch full profile about data
maxItems	number	Optional	Unlimited	Maximum tweets to return
customMapFunction	string	Optional	—	JavaScript function to transform each output object

How to Run

Using run_actor.js (recommended)

# Quick answer (table)
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}'

# Save as CSV
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}' --output results.csv --format csv

# Save as JSON
node scripts/run_actor.js --actor "apidojo~twitter-profile-scraper" --input '{"twitterHandles": ["elonmusk"], "maxItems": 100}' --output results.json --format json

REST API fallback

curl -X POST "https://api.apify.com/v2/acts/apidojo~twitter-profile-scraper/runs" \
  -H "Authorization: Bearer $APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"twitterHandles": ["elonmusk"], "maxItems": 100}'

If Apify MCP is available: Use the Apify MCP call_actor tool with actor apidojo~twitter-profile-scraper and the input above.

---

Output Fields

Field	Type	Description
type	string	Always tweet
id	string	Tweet ID
url	string	Tweet URL (x.com)
twitterUrl	string	Tweet URL (twitter.com)
text	string	Tweet text content
retweetCount	number	Retweet count
replyCount	number	Reply count
likeCount	number	Like count
quoteCount	number	Quote tweet count
bookmarkCount	number	Bookmark count
createdAt	string	Creation timestamp
lang	string	Detected language
isReply	boolean	Whether this is a reply
isRetweet	boolean	Whether this is a retweet
isQuote	boolean	Whether this is a quote tweet
source	string	Twitter client used
author.userName	string	Author @username
author.name	string	Author display name
author.isVerified	boolean	Legacy verification
author.isBlueVerified	boolean	Twitter Blue verification
author.profilePicture	string	Author profile picture URL
author.followers	number	Author follower count

Edge Cases

• Private account: Returns 0 tweets. Tell user the account is private.
• Account suspended: Returns error. Handle may be banned.
• Very active account: Use maxItems to cap and control cost ($0.0004 per extra tweet).
• Date range: Minimum 50 results needed for the query to run. If few tweets in range, widen date range.
• Retweets in results: Actor returns all public tweets including retweets.