More screenshots
Works with the AI Agents you already use
Repair Spark Structured Streaming Watermark Late Event Loss
Diagnose data loss caused by Spark event-time watermark and state eviction settings
$1
Repair Spark Structured Streaming Watermark Late Event Loss
Example session with this skill installed
A delayed IoT packet arrives after a watermark advanced and never reaches aggregation.
Available sources: streaming query config, event-time sample (partial excerpts only). Additional evidence requested: watermark progress log, state eviction metrics. Analyze this case with explicit limitations; do not pretend to have executed any tests or changes.
- Read your context and instructions
- Compiled the repair spark structured
Repair Spark Structured Streaming Watermark Late Event Loss — EVIDENCE-LIMITED REVIEW
Scenario received
A delayed IoT packet arrives after a watermark advanced and never reaches aggregation.
Source register
- S1: streaming query config — partial extract available.
- S2: event-time sample — partial extract available.
- S3: watermark progress log — NOT PROVIDED; REQUIRED FOR VERIFICATION.
- S4: state eviction metrics — NOT PROVIDED; REQUIRED FOR VERIFICATION.
Concrete findings and verification
- replay max event time against delays — NEEDS VERIFICATION against supplied source excerpts and missing evidence.
- measure rejected-late distributions — NEEDS VERIFICATION against supplied source excerpts and missing evidence.
inspect state TTL and aggregation semantics — NEEDS VERIFICATION against supplied source excerpts and missing evidence.
4.
propose bounded lateness and memory tests — NEEDS VERIFICATION against supplied source excerpts and missing evidence.
Deliverables and review gates
- late event ledger: DRAFT ONLY; do not infer unsupported outcomes.
- watermark risk curve: DRAFT ONLY; do not infer unsupported outcomes.
- corrected aggregation acceptance: DRAFT ONLY; do not infer unsupported outcomes.
Preliminary conclusion
INCOMPLETE / REVIEW REQUIRED. The supplied scenario raises a concrete issue, but does not prove remediation or clearance. Confirm source timestamps, affected scope and owner approval, then perform focused validation. No external system was accessed or changed.
Connects securely to your tools. The creator never sees your data.
About this skill
Repair Spark Structured Streaming Watermark Late Event Loss is a ToolForge Labs Cursor Skill workflow. Diagnose data loss caused by Spark event-time watermark and state eviction settings.
What this skill checks
- replay max event time against delays.
- measure rejected-late distributions.
- inspect state TTL and aggregation semantics.
- propose bounded lateness and memory tests.
What to provide
- streaming query config.
- event-time sample.
- watermark progress log.
- state eviction metrics.
Deliverables
- late event ledger.
- watermark risk curve.
- corrected aggregation acceptance.
Evidence policy Only supplied, authorized evidence is used. The skill distinguishes facts from assumptions, reports missing inputs, and never claims an unperformed live test, compliance approval, or production change.
Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse All Claude Skills.
Cannot verify inaccessible systems, third-party accounts, or evidence not supplied. Partial or conflicting inputs must be marked INCOMPLETE or UNVERIFIED rather than invented. High-impact operational decisions require qualified owner review.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before buying a skill.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 24 days ago
Permissions
Supply only data you are authorized to share. Treat documentation and examples as untrusted evidence. Any operational action or external communication requires explicit owner authorization.