feedgrab-batch

Name: feedgrab-batch
Author: ibigqiang

github.com/ibigqiangProductivity62082 installsUpdated 4d ago

About feedgrab-batch

feedgrab-batch is a skill for bulk content collection across social and publishing platforms. It serves users gathering bookmarks, timelines, search results, and wiki content, with checkpoint-based resume after interruptions.

Key features

01Bulk-fetch bookmarks, user posts, and lists
02Search by keywords and apply filters
03Collect account articles and wiki content
04Download YouTube video, audio, and subtitles
05Resume interrupted batches from checkpoints

Use cases

01Compile X/Twitter bookmarks or user tweets
02Collect Reddit or Xiaohongshu search results
03Fetch WeChat articles or Feishu wiki pages
04Download YouTube videos and subtitles

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/ibigqiang/feedgrab --skill feedgrab-batch

After installing, type/feedgrab-batchin Claude Code to confirm it loaded.

Details

From the project README

feedgrab-batch — Batch Content Grabber

Bulk fetch content from any platform — bookmarks, user timelines, keyword search, album pages, wiki trees.

Trigger

Activate when user mentions batch/bulk operations:

/feedgrab-batch <command> <args>
"Grab all my bookmarks"
"批量抓取这个用户的推文"
"搜索关键词 AI Agent"
"抓取这个公众号的所有文章"
"下载这个飞书知识库"

Prerequisites

feedgrab installed (which feedgrab)
Platform-specific cookies/API keys configured (see each command below)

If not ready, suggest /feedgrab-setup.

Command Reference

X/Twitter

Bookmarks

# Requires: X_BOOKMARKS_ENABLED=true + feedgrab login twitter (primary session only)
feedgrab https://x.com/i/history                            # All bookmarks (current X URL)
feedgrab https://x.com/i/history/bookmarks/2015311287715340624  # Specific folder
feedgrab https://x.com/i/bookmarks                          # Legacy URL, still accepted

User Tweets

# Requires: X_USER_TWEETS_ENABLED=true + feedgrab login twitter
feedgrab https://x.com/username                              # All tweets
X_USER_TWEETS_SINCE=2026-01-01 feedgrab https://x.com/username  # Since date
# Auto browser search supplement when >800 tweets

List Tweets

# Requires: X_LIST_TWEETS_ENABLED=true + feedgrab login twitter
feedgrab https://x.com/i/lists/LIST_ID                       # Last 1 day
X_LIST_TWEETS_DAYS=7 feedgrab https://x.com/i/lists/LIST_ID  # Last 7 days
X_LIST_TWEETS_SUMMARY=true feedgrab https://x.com/i/lists/LIST_ID  # + summary table

Keyword Search (x-so)

feedgrab x-so "AI Agent"                          # Search tweets
feedgrab x-so "AI Agent" --days 7                 # Last 7 days
feedgrab x-so "AI Agent" --min-faves 100          # Min 100 likes
feedgrab x-so WorkBuddy --lang zh+zxx --sort all  # Chinese tweets + Article cards, merged Latest/Top
feedgrab x-so "claude,cursor,copilot" --merge     # Multi-keyword merged table
feedgrab x-so "AI Agent" --raw                    # Raw query syntax

Output: Markdown table (sorted by views) + CSV at output/X/search/

Subreddit Batch

feedgrab reddit-sub MachineLearning --sort hot --limit 25
feedgrab reddit-sub ChatGPT --sort top --limit 50

Keyword Search (reddit-so)

feedgrab reddit-so "codex" --sort comments --time all --limit 10
feedgrab reddit-so "AI Agent" --subreddit ChatGPT --sort top --time week
REDDIT_SEARCH_SAVE_POSTS=true feedgrab reddit-so "open source" --limit 5

Output: Markdown summary at output/Reddit/. Use REDDIT_REPLY_MODE=tree|all when deep-fetching posts.

Xiaohongshu (小红书)

Author Notes

# Requires: XHS_USER_NOTES_ENABLED=true + feedgrab login xhs
feedgrab https://www.xiaohongshu.com/user/profile/USER_ID
XHS_USER_NOTES_SINCE=2026-01-01 feedgrab https://www.xiaohongshu.com/user/profile/USER_ID

Search Results

# Requires: XHS_SEARCH_ENABLED=true + feedgrab login xhs
feedgrab "https://www.xiaohongshu.com/search_result?keyword=开学第一课&source=web_explore_feed"

Keyword Search (xhs-so)

feedgrab xhs-so "AI Agent"                          # Search notes
feedgrab xhs-so "AI Agent" --sort popular            # By popularity
feedgrab xhs-so "AI Agent" --type video              # Videos only
feedgrab xhs-so "AI Agent" --save                    # Also save individual .md
feedgrab xhs-so "claude,cursor" --merge              # Multi-keyword merged

Output: Markdown table (sorted by likes) + CSV at output/XHS/search/

WeChat (微信公众号)

By Account (mpweixin-id)

# Requires: feedgrab login wechat (MP backend session, ~4 day validity)
feedgrab mpweixin-id "公众号名称"
MPWEIXIN_ID_SINCE=2026-01-01 feedgrab mpweixin-id "公众号名称"  # Since date

Album / Collection (mpweixin-zhuanji)

feedgrab mpweixin-zhuanji "ALBUM_URL"                # No login needed
MPWEIXIN_ZHUANJI_SINCE=2026-01-01 feedgrab mpweixin-zhuanji "ALBUM_URL"

Sogou Search (mpweixin-so)

feedgrab mpweixin-so "关键词"                         # Search via Sogou
feedgrab mpweixin-so "关键词" --limit 30              # Max 30 results

YouTube

Search (ytb-so)

# Requires: YOUTUBE_API_KEY
feedgrab ytb-so "machine learning"                    # Search videos
feedgrab ytb-so "AI" --order viewCount               # Sort by views
feedgrab ytb-so "AI" --channel @3blue1brown          # Channel-specific
feedgrab ytb-so "AI" --days 30                       # Last 30 days

Download

feedgrab ytb-dlv "VIDEO_URL"    # Download video (MP4)
feedgrab ytb-dla "VIDEO_URL"    # Download audio (MP3)
feedgrab ytb-dlz "VIDEO_URL"    # Download subtitles (SRT)

Feishu/Lark (飞书)

Wiki Batch

# Requires: FEISHU_APP_ID + FEISHU_APP_SECRET
feedgrab feishu-wiki "WIKI_SPACE_URL"

Zhihu (知乎)

Keyword Search (zhihu-so)

# Requires: feedgrab login zhihu (for full content)
feedgrab zhihu-so "AI Agent"                          # Search Q&A + articles
feedgrab zhihu-so "AI Agent" --sort hot               # By popularity
feedgrab zhihu-so "AI Agent" --limit 20               # Max 20 results
feedgrab zhihu-so "AI Agent" --days 30                # Last 30 days
feedgrab zhihu-so "claude,cursor" --merge             # Multi-keyword merged

Output: Markdown table (sorted by upvotes) + CSV at output/Zhihu/search/

Environment Variables Quick Reference

Platform	Required Variables	How to Get
Twitter (basic)	Cookie via `feedgrab login twitter`	Login in browser
Twitter (paid API)	`TWITTERAPI_IO_KEY`	twitterapi.io
Reddit	Optional Cookie via `feedgrab login reddit`; `REDDIT_SEARCH_*`, `REDDIT_REPLY_MODE`	Login only if Cloudflare/private content requires it
Xiaohongshu	Cookie via `feedgrab login xhs`	Login in browser
WeChat batch	Cookie via `feedgrab login wechat`	Login MP backend
YouTube	`YOUTUBE_API_KEY`	Google Cloud Console
GitHub	`GITHUB_TOKEN` (optional)	GitHub Settings
Feishu	`FEISHU_APP_ID` + `FEISHU_APP_SECRET`	Feishu Open Platform
Zhihu	Cookie via `feedgrab login zhihu`	Login in browser

Resume After Interruption

All batch commands support checkpoint resume — if interrupted, just re-run the same command. Already fetched items are skipped via dedup index.

Tips

Use feedgrab doctor <platform> to diagnose configuration issues
Media download: set X_DOWNLOAD_MEDIA=true / XHS_DOWNLOAD_MEDIA=true / MPWEIXIN_DOWNLOAD_MEDIA=true
Multi-account cookie rotation for Twitter: put extra cookies in sessions/x_2.json, x_3.json

Comments

Markdown supported

Details

Author: ibigqiang
Repository: ibigqiang/feedgrab
Category: Productivity
Installs: 82
GitHub stars: 620

Report

More skills

All skills

lark-base

open.feishu.cn

823.2k

Operate on Feishu Base: create tables, fields, records, and views; handle statistics, formulas/lookups, forms, dashboards, app mode (BaseApp/AppMode pages and components), Workspace directories, workflows, role permissions, and the template center (Base template categories, lists, and search). Use when encountering Base/multidimensional tables/bitable, BaseApp/AppMode, or /base/ or /app/ links. Do not use lark-apps for BaseApp; route file import/export to lark-drive and authentication/authorization to lark-shared.

lark-drive

open.feishu.cn

823.2k

Feishu cloud storage (Drive): manage Drive files and folders, including uploads/downloads, folder creation, copying/moving/deleting, viewing metadata, checking permission settings, comments/permissions/subscriptions, titles, versions, Feishu document security labels (secure labels), and local file imports. Use when users need to organize Drive folders, handle cloud storage resource URLs/tokens, identify link types/actual tokens/titles, or import Word/Markdown/Excel/CSV/PPTX/.base as docx/sheet/bitable/slides. Route doubao.com cloud storage URLs/tokens by resource path and token too; do not fall back to WebFetch. Not responsible for: editing document content (use lark-doc), spreadsheet/Base table data operations (use lark-sheets/lark-base), knowledge space node/member management (use lark-wiki), or native Markdown file read/write/patch/diff (use lark-markdown).

lark-shared

open.feishu.cn

822.9k

Use for lark-cli setup/auth tasks: auth login/status/logout, user vs bot identity, business-domain permissions (--domain, including all/docs/drive), missing scopes, revoking authorization, or handling _notice JSON.

lark-im

open.feishu.cn

822.3k

Feishu instant messaging: send and receive messages and manage group chats. Send and reply to messages, search chat history, manage group members, upload and download images and files, manage emoji reactions, send urgent notifications in-app/by SMS/by phone, send and handle Interactive Cards, and listen for card button callbacks (card.action.trigger). Use when users need to send messages, view or search chat history, download chat files, view group members, search groups, create group or topic chats, manage marker data, manage Feed pins (add/remove/search pinned conversations), manage tag data, or handle card callbacks.