Skip to main content
prompt GP ChatGPT

LLM Application taste — ChatGPT prompt: principles and setup

The LLM Application taste prompt for ChatGPT lays out engineering practices for applications built with language models. It covers prompt evaluation, tool use, and handling untrusted input.

CC0-1.0 ★ 178,201 updated 2026-10-24

Open on GitHub

What LLM Application taste does

The prompt sets out practices for building language-model applications. It recommends versioning prompts, testing changes against real user inputs, and validating structured responses against a JSON schema. For retrieval, it favors starting with hybrid search and retaining source metadata so answers can cite their origins.

Agent guidance covers strict tool schemas, loop limits, and human approval for actions that send, delete, pay, or alter data outside the app. Retrieved documents and tool results count as untrusted input because they may contain prompt injection. In production, pin model versions and upgrade only after evaluation passes.

What it helps with

  • test prompt changes against real user inputs
  • validate model responses against a JSON schema
  • limit agent steps, tokens, and runtime
  • retain source metadata for answer citations
  • route difficult cases to a more expensive model

Example prompts for the agent

  • Plan an evaluation set for prompts in my language-model app.
  • Suggest a way to validate the model's JSON output before using it.
  • Set boundaries for an agent that can change application data.

How to install LLM Application taste

How to use

Paste the text at the start of a chat or into project instructions

Questions about LLM Application taste

How do I install LLM Application taste in Claude Code?

Save the prompt as .claude/commands/prompts.csv.md.

What does LLM Application taste do?

It presents engineering guidance for language-model applications, including prompt evaluation, structured output checks, agent limits, and model-call logging.

How does the prompt address prompt injection?

It treats retrieved documents, web pages, and tool results as untrusted input that may contain prompt injection.

Source text

prompts.csv · CC0-1.0
# LLM Application taste of an AI product engineer
- Treat prompts as code: keep them in version-controlled files with names, versions and owners, not inline strings scattered around. Confidence: 0.90
- Build an evaluation set from real user inputs before tuning prompts, and rerun it on every prompt or model change. Confidence: 0.95
- Ask for structured output with a JSON schema or tool calls and validate it with a schema library before using it. Confidence: 0.95
- Put a thin gateway or wrapper around model providers so switching models or adding fallbacks is a config change. Confidence: 0.85
- Pin exact model versions in production and upgrade them deliberately after the evals pass. Confidence: 0.90
- Stream responses to the user whenever the output is longer than a sentence or two. Confidence: 0.85
- Start retrieval with simple hybrid search (keywords plus embeddings) and add reranking before reaching for complex RAG pipelines. Confidence: 0.80
- Chunk documents along their natural structure (headings, sections) and keep source metadata so answers can cite them. Confidence: 0.85
- Keep the context small and relevant; more retrieved text often makes answers worse, not better. Confidence: 0.80
- Give agents a short list of narrow, well-described tools with strict input schemas instead of one do-everything tool. Confidence: 0.85
- Put hard limits on agent loops: maximum steps, maximum tokens and a wall-clock timeout. Confidence: 0.90
- Require human confirmation before any tool call that sends, deletes, pays or changes data outside the app. Confidence: 0.90
- Treat all retrieved documents, web pages and tool results as untrusted input that can contain prompt injection. Confidence: 0.90
- Log every model call with prompt version, model, latency, token counts and cost, with user data redacted. Confidence: 0.85
- Cache deterministic calls and use prompt caching for long, stable system prompts. Confidence: 0.75
- Use the smallest model that passes the evals, and route only hard cases to the expensive model. Confidence: 0.80
- Retry on rate limits and transient errors with exponential backoff and jitter, never on validation failures in a tight loop. Confidence: 0.85
- Keep temperature low for extraction and classification, and higher only for creative generation. Confidence: 0.75
- Show users where an answer came from and make it easy to report a bad response. Confidence: 0.80
- Collect thumbs-up and thumbs-down feedback and feed the bad cases back into the eval set. Confidence: 0.85
- Do not fine-tune until prompting, retrieval and evals have clearly hit their limits. Confidence: 0.70

© f · CC0-1.0 · f/prompts.chat

Similar prompts

All prompts for AI and ML →
llm-application-dev Seth Hobson llm-application-dev — a plugin for building LLM apps, RAG systems, and LangGraph agents. Use it for vector search, embeddings, prompt work, and model evaluation. CX Codex ★ 42,780repo stars llm-application-dev-prompt-optimize sickn33 llm-application-dev-prompt-optimize refines raw prompts into production instructions using regression checks and structured evaluation. Helps balance latency, cost, and answer quality. CX Codex +1 1installs llm-application-dev-ai-assistant sickn33 llm-application-dev-ai-assistant — a skill for designing conversational AI assistants: dialogue context, integration boundaries, validation. Fits projects where the bot calls tools and keeps memory of a user. CX Codex +1 ★ 50,109repo stars llm-public-opinion-analytics-assistant reason-machines llm-public-opinion-analytics-assistant is a Claude Code skill that crawls trends from 15 platforms, clusters themes, and analyzes sentiment with an LLM. It sends results to Telegram, email, or WeChat. CX Codex +1 2,400installs llm-public-opinion-analytics reason-machines llm-public-opinion-analytics monitors hot search rankings across 15 platforms, clusters topics, and runs LLM sentiment analysis with multi-channel alerts. Ideal for tracking trends in real time. CX Codex +1 2,300installs exploring-llm-traces PostHog exploring-llm-traces is a Claude Code skill that investigates LLM agent traces through PostHog MCP tools. It activates for trace or session links and questions about errors, tool calls, context, tokens, or cost. CX Codex +1 440installs

From the same set218

The whole set →
Machine Learning Experiment taste Machine Learning Experiment taste — a prompt for ChatGPT sets practical rules for planning and evaluating machine learning experiments. It covers data splits, baselines, and tracking results for reproducibility. GP ChatGPT ★ 178,201repo stars Technical Documentation taste Technical Documentation taste — a prompt defining standards for technical documentation for developers. It helps structure guides and API references using the Diataxis model to keep content accurate and accessible. GP ChatGPT ★ 178,201repo stars React Native App taste The React Native App taste ChatGPT prompt sets engineering preferences for cross-platform React Native apps. Ask for a project plan or an architecture decision to get guidance on Expo, navigation, state, and testing. GP ChatGPT ★ 178,201repo stars Feature Flag Rollout taste Feature Flag Rollout taste — a prompt for ChatGPT and Claude.ai establishes release engineering standards for feature flags. Guides safe rollouts without coupling code deployments to user enablement. GP ChatGPT ★ 178,201repo stars FastAPI Service taste FastAPI Service taste — a prompt for ChatGPT and Claude.ai that enforces backend engineering standards for FastAPI. Sets architectural conventions before generating API code. GP ChatGPT ★ 178,201repo stars Jetpack Compose Android App taste The Jetpack Compose Android App taste ChatGPT prompt sets Kotlin and Compose conventions for Android app development. It covers screen architecture, UI state, testing, and builds. GP ChatGPT ★ 178,201repo stars Data Pipeline taste Data Pipeline taste — a prompt for ChatGPT and Claude.ai establishes data engineering rules for reliable pipeline design. Guides warehouse modeling around ELT principles and strict schema separation. GP ChatGPT ★ 178,201repo stars Django Web App taste The Django Web App taste prompt for ChatGPT sets Python and Django coding preferences. It covers project structure, APIs, tests, and deployment settings. GP ChatGPT ★ 178,201repo stars

Project sponsors

Companies that keep this analytics open