Skip to main content
skill CX Codex

comment-mining — Claude Code skill: what it does, how to install

Mines public social media comments to uncover audience questions, objections, content ideas, and buying intent.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add ScrapeCreators/social-media-research-skills --skill comment-mining -a claude-code
Open on GitHub

What comment-mining does

The skill extracts audience feedback from posts and videos on TikTok, YouTube, Instagram, Facebook, Reddit, and Rumble. It calls ScrapeCreators endpoints via WebFetch or Bash. Instead of flattening reactions into simple sentiment metrics, it categorizes remarks into specific buckets such as objections, confusion, pain points, feature requests, and buying signals.

The workflow follows five defined stages. The agent fetches comments with pagination, filters out obvious spam while preserving slang and raw phrasing, classifies entries, and clusters recurring themes. The final report highlights representative quotes, issue frequency, and concrete angles for marketing copy or product development.

You must set the SCRAPECREATORS_API_KEY environment variable. Without this API key, data retrieval endpoints fail immediately.

What it helps with

  • extract comments and reply threads across supported social platforms
  • identify customer objections and pain points from public feedback
  • generate content ideas based on common audience questions
  • capture authentic customer phrasing for landing page copy

Example prompts for the agent

  • Analyze comments on the latest YouTube video and summarize top buyer objections.
  • Mine comments from this Reddit discussion to find recurring product feature requests.
  • Extract exact audience quotes and pain points from an Instagram Reel.

How to install comment-mining

1Skills CLI (Vercel)

npx skills add ScrapeCreators/social-media-research-skills --skill comment-mining -a claude-code

2Manually: put the files in place

~/.claude/skills/comment-mining/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/comment-mining/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about comment-mining

How do I install comment-mining in Claude Code?

Run npx skills add ScrapeCreators/social-media-research-skills --skill comment-mining -a claude-code. The skill file will be placed in ~/.claude/skills/comment-mining/SKILL.md.

What does comment-mining do?

It gathers comments from social media posts, cleans out spam, and structures user reactions into questions, objections, and verbatim customer quotes.

What prerequisites are needed for comment-mining?

You must configure the SCRAPECREATORS_API_KEY environment variable. The skill relies on it to call ScrapeCreators comment endpoints.

Source text

SKILL.md · MIT
---
name: comment-mining
description: Use when the user wants to mine comments and replies for audience reactions, customer language, questions, objections, complaints, product ideas, buying intent, sentiment, or voice-of-customer insights from public social posts and videos.
allowed-tools: Bash, Read, Write, WebFetch

version: 1.0.0
author: ScrapeCreators
license: MIT
homepage: https://scrapecreators.com
repository: https://github.com/ScrapeCreators/social-media-research-skills
metadata:
  openclaw:
    requires:
      env:
        - SCRAPECREATORS_API_KEY
    primaryEnv: SCRAPECREATORS_API_KEY
    homepage: https://scrapecreators.com
    tags:
      - social-media
      - research
      - scrapecreators
---

# Comment Mining

## Overview

Mine public comments for what people actually ask, complain about, want, misunderstand, or repeat. The output should help with product research, content ideas, copywriting, objection handling, and audience understanding.

## When to Use

Use this skill when the user asks to:

- analyze comments on a TikTok, YouTube video, Instagram Reel, Facebook post, Reddit post, or Rumble video
- find audience questions, objections, complaints, or buying intent
- extract voice-of-customer language
- find content ideas from comments
- understand sentiment around a post, creator, product, or topic

## Comment Sources

| Platform | Endpoint |
|---|---|
| TikTok comments | `/v1/tiktok/video/comments` |
| TikTok replies | `/v1/tiktok/video/comment/replies` |
| YouTube comments | `/v1/youtube/video/comments` |
| YouTube replies | `/v1/youtube/video/comment/replies` |
| Instagram comments | `/v2/instagram/post/comments` |
| Facebook comments | `/v1/facebook/post/comments` |
| Facebook replies | `/v1/facebook/post/comment/replies` |
| Reddit comments | `/v1/reddit/post/comments` |
| Rumble comments | `/v1/rumble/video/comments` |

## Workflow

1. **Fetch comments**
   - Use the post/video URL whenever possible.
   - Paginate when the endpoint supports it and the user wants depth.
   - Preserve comment text, author if public, like/upvote count, timestamp, and source URL.

2. **Clean lightly**
   - Remove obvious spam/duplicates.
   - Keep slang, misspellings, and emotional wording if it is useful customer language.
   - Do not over-normalize exact quotes.

3. **Classify each useful comment**
   Use these buckets:
   - questions
   - objections
   - complaints/pain points
   - praise
   - confusion
   - requests/feature ideas
   - buying intent
   - controversy/debate
   - jokes/memes/culture signals

4. **Cluster themes**
   - Group similar comments.
   - Score themes by frequency and intensity.
   - Highlight exact quotes for each theme.

5. **Turn insights into actions**
   Depending on the user's goal, produce:
   - content ideas
   - FAQ ideas
   - landing page copy angles
   - product ideas
   - objection-handling bullets
   - sales/support notes

## Output Format

```markdown
# Comment Mining Report

## Summary
- Source(s): {urls}
- Comments analyzed: {count}
- Confidence: High/Medium/Low

## Top Themes
| Theme | Type | Frequency | Intensity | Representative quote |
|---|---|---:|---|---|

## Audience Questions
- "..."

## Objections and Concerns
- **Objection:** ...
  - Evidence: "..."
  - Response angle: ...

## Buying Intent / Demand Signals
- "..."

## Exact Language to Reuse
- "..."
- "..."

## Content Ideas From Comments
1. ...
2. ...
```

## Quality Guardrails

- Label sample size and confidence.
- Separate one loud comment from a repeated pattern.
- Preserve exact quotes for useful language.
- Avoid claiming broad market sentiment from one post's comments.
- Call out moderation/platform bias when relevant.

## Common Pitfalls

- Do not flatten comments into generic sentiment. The value is in questions, objections, and exact wording.
- Do not include personally identifying details unless they are already public and necessary.
- Do not treat bot/spam comments as audience signal.
- Do not skip Reddit post context. For Reddit, read both the original post and comments.

© ScrapeCreators · MIT · ScrapeCreators/social-media-research-skills

Similar skills

Everything for Marketing and content →

From the same set12

trend-discovery Finds trending topics, hashtags, and sounds across TikTok, Instagram, YouTube, Reddit, and Pinterest. Turns public signals into practical content angles. CX Codex +1 1,300installs influencer-prospecting Finds niche creators across TikTok, Instagram, and YouTube using public data, scores prospects from 1 to 5, and exports ready-to-contact lists to CSV. CX Codex +1 1,200installs content-repurposing Turns public social videos, transcripts and posts into drafts for other formats. Use it when one source needs adapting for several publishing channels. CX Codex +1 1,200installs product-demand-research This skill mines Reddit, social posts and video comments for complaints, requests and buyer objections. Useful before you commit to building a product. CX Codex +1 1,200installs audience-research Evaluates creator and brand audiences using public metrics, TikTok demographics, and comment signals. It helps teams check market fit before booking sponsorships. CX Codex +1 1,200installs creator-profile-teardown Analyzes a public creator or brand account for positioning, content pillars, outlier posts and repeatable patterns. Use it when you need research before adapting content ideas. CX Codex +1 1,200installs social-listening-brief Pulls public mentions of a brand, product or topic from Reddit, TikTok, YouTube and elsewhere, then writes a cited report with themes and sentiment. CX Codex +1 1,200installs transcript-intelligence Pulls transcripts from TikTok, YouTube, Instagram and other social video, then extracts hooks, quotes and reusable content ideas. CX Codex +1 1,300installs

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor