social-listening

Social Listening

Setup

Choose the available runtime before doing any credential setup:

• Terminal-free client: skip the shell commands below. Use connected MCP tools. For ScrapeCreators operations, read scrapecreators-api and prefer call_data_provider. For another provider step without a connected tool, use an equivalent built-in public-web method when it preserves the workflow, or clearly report that step as unavailable.
• Local terminal: use the GooseWorks credentials and proxy commands below.

Read your credentials from ~/.gooseworks/credentials.json:

export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])")
export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))")

If ~/.gooseworks/credentials.json does not exist, tell the user to run: npx gooseworks login

The local proxy endpoints use Bearer auth: -H "Authorization: Bearer $GOOSEWORKS_API_KEY". ScrapeCreators operation descriptions below remain environment-neutral in both runtimes.

Track brand mentions, competitor activity, and industry conversations across social media and the web.

When to Use

• User wants to monitor what people say about a brand or product
• User asks "what are people saying about [company]?"
• Tracking competitor launches or announcements
• Monitoring industry trends and sentiment
• Social media due diligence before partnerships

Workflow

Step 1: Search Web Mentions with Exa

Find recent mentions, reviews, and discussions across the web:

curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
  -H "Authorization: Bearer $GOOSEWORKS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"api":"exa","path":"/search"}'
  "query": "Notion reviews opinions user feedback",
  "numResults": 30,
  "contents": {"text": true}
}'

Step 2: Monitor Social Media with Scrape Creators

Check what's being posted on X/Twitter:

provider: scrapecreators
method: GET
path: /v1/twitter/user-tweets
query:
  handle: NotionHQ

Check LinkedIn company activity:

provider: scrapecreators
method: GET
path: /v1/linkedin/company/posts
query:
  url: https://linkedin.com/company/notion

Use /v1/linkedin/company when only the company page is needed, and /v1/linkedin/post for one specific post URL.

Step 3: Deep Scrape Key Pages with Scrapegraph

Extract structured data from specific pages found in Steps 1-2:

curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
  -H "Authorization: Bearer $GOOSEWORKS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"api":"scrapegraph","path":"/v1/smartscraper"}'
  "website_url": "https://example.com/review-page",
  "user_prompt": "Extract sentiment, key complaints, and praise about the product"
}'

Examples

User: "What are people saying about Slack?"

# Step 1: Web mentions
curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
  -H "Authorization: Bearer $GOOSEWORKS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"api":"exa","path":"/search","body":{"query":"Slack reviews complaints praise 2025 2026","numResults":20,"contents":{"text":true}}}'

Then run the X/Twitter operation from Step 2 with handle: SlackHQ through the selected ScrapeCreators runtime.

User: "Monitor competitor launches in the AI space"

curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
  -H "Authorization: Bearer $GOOSEWORKS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"api":"exa","path":"/search","body":{"query":"AI startup launch announcement new product 2026","numResults":30,"contents":{"text":true}}}'

Tips

• Use Exa for broad web monitoring (blogs, forums, news)
• Use Scrape Creators for social media (X/Twitter, LinkedIn, Instagram, TikTok)
• Use Scrapegraph for extracting structured data from specific URLs
• Include date ranges in Exa queries for recent results
• Track both your brand and competitors for comparative insights