Skewcheck - skewcheck.skillsafe.ai

This app's agent prompt is a derivative work of one agent skill. It paraphrases and adapts its guidance;
it does not reproduce the skill or its reference files verbatim.

1. spark-optimization
   Source:  github.com/wshobson/agents
   Path:    plugins/data-engineering/skills/spark-optimization/SKILL.md (and references/details.md)
   Author:  Seth Hobson (wshobson)
   Licence: MIT License
   Modifications: the skill's patterns and do's and don'ts (enable adaptive query execution, use columnar
   formats, broadcast small tables, keep data distributed and never collect large data, prefer built-in
   functions to UDFs, do not over-cache, handle skew, right-size partitions, coalesce rather than
   repartition to reduce partitions, partition written data for readers, do not use count() for
   existence, the configuration cheat sheet) were restated as deterministic browser checks (sparkkit.js)
   and as the audit and fix lanes of this app's prompt. The exact before/after edit contract, the re-check
   of every edit and returned file, the read/write preservation check and the changes list tied to the
   page's flags are additions of this app.

The browser-side checks (sparkkit.js), the reconciliation (recon.js) and the rest of the page are original
to this app; the Python lexer and block rebuild are shared with other SkillSafe desks. Apache Spark and
PySpark are trademarks of the Apache Software Foundation; this app is not affiliated with or endorsed by
the ASF.