Screenpipe Api
Query screen recordings, audio, and UI data via local Screenpipe REST API
What You Can Do
Query your local Screenpipe instance to retrieve screen recordings, audio transcriptions, UI element accessibility trees, keyboard/mouse input logs, and productivity analytics. You can search by keywords, filter by content type (audio, OCR, accessibility, input), set time ranges, and extract structured data about your applications, meetings, and work sessions without sending data to external servers.
Features
query screen activity by keywords, time range, and content type (audio, OCR, accessibility, input)
automatic Bearer token injection via SCREENPIPE_LOCAL_API_KEY environment variable
respects token limits by writing large API responses to files and sampling data intelligently
full access to Screenpipe's REST API for recordings, transcriptions, metadata, and analytics
relative (e.g., '1h ago') and ISO 8601 timestamp support for precise data slicing
target specific capture types (accessibility tree, audio, OCR, keystroke logs, memory)
iterate through large result sets with limit and offset parameters
all queries run against localhost:3030; no cloud sync or external API calls
Example Output
Example 1: Search screen activity from the last hour
User: "What apps did I use in the last hour?"
Claude queries: GET /search?q=&content_type=accessibility&limit=20&start_time=1h%20ago
Response: Array of 12 accessibility events showing Chrome (Gmail), VS Code (Python file edits), Slack conversations, and Calendar views with timestamps and UI element details.
Example 2: Find meeting transcript segments
User: "What was discussed in my 2pm meeting?"
Claude queries: GET /search?q=meeting&content_type=audio&start_time=2024-01-15T14:00:00Z&end_time=2024-01-15T15:00:00Z
Response: Audio transcription chunks with speaker labels, timestamps, and confidence scores for the Zoom meeting window.
Example 3: Analyze productivity patterns
User: "How much time did I spend coding vs. in meetings today?"
Claude queries multiple endpoints to aggregate accessibility events by app category, calculates duration per app, and returns a summary: "4.2 hours coding (VS Code, terminal), 1.8 hours meetings (Zoom, Calendar)."
What's Included
- SKILL.md: Complete Screenpipe API reference with authentication, endpoint documentation, and context window protection guidelines
- Search endpoint documentation: Parameters (q, content_type, limit, offset, start_time), examples, and modality explanations
- Authentication template: Ready-to-use Bearer token header format and environment variable setup
- Large response handling pattern: File I/O and jq sampling strategies to keep API queries within context limits
- Endpoint reference link: Full 60+ endpoint catalog at https://docs.screenpi.pe/llms-full.txt
Who It's For
- Software engineers — analyze debugging sessions, code review logs, and development tool usage patterns
- Product managers — track user session data and feature interaction telemetry from personal recordings
- Data analysts — export and process screen activity logs for productivity research and time tracking
- Researchers — study user behavior, UI interaction patterns, and application usage without external cloud infrastructure
- Productivity consultants — provide data-driven insights on client app usage, meeting time allocation, and focus periods
Best For
- Screen activity audits — retrieve what apps, files, and websites were accessed during specific time windows
- Meeting transcription & retrieval — search and extract audio transcriptions from recorded calls and conferences
- Productivity metrics — calculate time spent per application, meeting load, and deep work vs. interruption patterns
- Data export & compliance — pull structured screen logs for personal archives, audit trails, or compliance reviews
- AI-powered insights — feed screen context and transcriptions into Claude for intelligent summaries, action items, and analysis
You might also like
You can input earth retention system parameters—wall type, soil properties, loading conditions, and geometry—and Claude will perform comprehensive stability analysis including bearing capacity, sliding resistance, and overturning checks. The skill generates professional engineering reports with calculated factors of safety, design narratives, and permit-ready documentation that aligns with ASCE 7, ACI 318, and local building code requirements across gravity walls, cantilever walls, soldier pile systems, sheet pile walls, and MSE walls.
by az9713
You can submit architectural design documents, floor plans, and project parameters to receive a comprehensive compliance analysis that cross-references IBC, local amendments, zoning ordinances, and ADA accessibility requirements. Claude identifies specific gaps, cites applicable code sections, explains why each gap matters, and provides concrete remediation strategies—all before formal design review submission when corrections are costly and schedule-impacting.
by az9713
You can accelerate HVAC design workflows by inputting building parameters—envelope characteristics, occupancy data, climate conditions, and existing systems—and receiving calculated heating/cooling loads, equipment sizing recommendations, and zone-by-zone analysis. Claude organizes complex building data into actionable design parameters and specification summaries for client review, permit submission, and professional validation against ASHRAE and ACCA standards.
by az9713
This skill systematically reviews backend code to uncover bugs, performance bottlenecks, security vulnerabilities, and architectural debt before deployment. You provide code (functions, diffs, or full files), and it delivers prioritized findings with detailed explanations and actionable fixes. Every review includes severity assessment, code examples, and concrete recommendations to improve quality and safety.
This skill enables you to rapidly produce structural analyses for timber members, including bending, shear, compression, and combined stress calculations. You can determine lateral load capacity for shear walls, design connections, evaluate code compliance against NDS standards, assess serviceability limits, and generate calculation frameworks suitable for permit submission and engineer stamping.
by az9713
You can synthesize complex environmental site assessment data into structured remediation recommendations that balance technical feasibility, regulatory compliance, and project economics. This skill guides you through contaminant pathway analysis, remedy alternative evaluation, and the development of defensible remedial action objectives (RAOs) and remedial design specifications suitable for regulatory submittals.
by az9713
You can rapidly review fire protection system designs by cross-referencing applicable NFPA codes, calculating system hydraulic demands, validating component selections, and identifying compliance gaps. The skill automates technical verification tasks—from pump sizing and sprinkler head spacing to water supply adequacy and backflow preventer specification—reducing manual review time and design errors during development and plan review phases.
by az9713
Design earth retention systems by inputting soil properties, site geometry, and regulatory requirements. Claude calculates lateral earth pressures using Coulomb, Rankine, and Mononobe-Okabe methods, verifies factors of safety for internal and external stability, compares competing retention concepts (gravity walls, cantilever, anchored, sheet-pile, soil-nail), and generates cost-benefit analysis and regulatory documentation packages ready for permit submission.
by az9713