How it works
A read-only collection pipeline for public data
The Fidenn Market Analyzer RAW Collector runs on AWS Lightsail and records how publicly available channel and video statistics change over time for a manually curated set of channels.
Collection pipeline
Manual channel registration
The operator manually selects and registers public channels. There is no automated crawling of arbitrary channels and no public sign-up.
Public upload discovery
For each registered channel, new public uploads are discovered from the channel's public uploads playlist.
Raw metadata and statistics collection
Public metadata and public statistics (view, like and comment counts) are retrieved for registered public videos.
Immutable observation records
Each measurement is stored as an immutable observation (BACKFILL, FIXED or ANCHOR). Records are appended, not edited in place.
Scheduled retention enforcement
A daily one-shot retention job enforces the active 28-day safeguard for non-authorized API data.
Internal read-only review
Results are reviewed internally in a read-only manner. No write actions are ever performed against YouTube.
No user authorization
- Requests use an API key for general public API access.
- No OAuth 2.0 flow.
- No user credentials.
- No actions performed on behalf of a YouTube user.
Public data only
The collector reads only publicly available channel and video data. It never requests or stores YouTube account login information.
Operational model
- One-shot scheduled runs (hourly Cron).
- No continuous in-process polling loop.
- Failed or partial runs are recorded.
- Retention and collection use coordinated locking.
Isolation
The production database remains isolated from this review website. This site never connects to production data or calls the YouTube API directly.