Skip to main content
General

Porting a Prompt From GPT to Claude Without Breaking It

A

Agency Script Editorial

Editorial Team

March 15, 2020·7 min read
prompting across different model architecturesprompting across different model architectures getting startedprompting across different model architectures guideprompt engineering

The first time you move a prompt from one model to another, the temptation is to paste it in, glance at the output, and call it done. Sometimes that works. More often the output is subtly worse in a way you do not notice until it causes a problem downstream, a malformed structure, a missing constraint, a reasoning step that the new model skips. The gap between paste-and-pray and a real port is not large, but it is real, and crossing it the first time builds the habits that make every later port faster.

This walkthrough takes you from a working single-model prompt to a validated two-model prompt by the shortest credible path. It assumes you have a prompt that already works on its original model and access to a second model. It does not assume you have built any tooling or evaluation infrastructure; the point is to get a real result with what you have, then decide whether the heavier machinery is worth it.

The result you are aiming for is concrete: the same prompt producing acceptable output on a second model, with the differences understood rather than guessed at. That is a genuine milestone, and reaching it the careful way the first time means you never have to unlearn the paste-and-pray habit.

What You Need First

A few prerequisites make the difference between a smooth first port and a frustrating one. Gather them before you start.

A prompt that already works

  • Start from a prompt that reliably produces good output on its original model. Porting a prompt that is already shaky on its source model just spreads the confusion to two models.

A handful of test inputs

  • Collect five to ten representative inputs, including a couple of edge cases. You will run these on both models to compare, so they need to cover the cases you actually care about.

Access and a way to see token counts

Step One: Establish the Baseline

Before you touch the second model, capture what good looks like on the first one.

Record the source outputs

  • Run your test inputs on the original model and save the outputs. These become your reference for whether the port preserved quality.

Note the structure you depend on

  • Write down exactly what format and constraints the downstream system relies on, valid JSON, a word limit, specific fields. These are what you will check most carefully on the new model.

Step Two: Run It on the Second Model

Now do the paste, but treat the result as a draft to inspect, not a finished port.

Compare against the baseline

  • Run the same inputs on the second model and put the outputs side by side with the source outputs. Read for differences in content quality, structure, and constraint adherence.

Catalog the failures

Step Three: Make Targeted Fixes

Most first ports need two or three small fixes, not a rewrite. Resist the urge to start over.

Fix format first

  • If the structure broke, make your format instruction more explicit or add an example, and re-test. Format is the most common and most damaging failure, so clear it first.

Adjust the reasoning scaffold

Step Four: Validate and Decide

A port is not done when one output looks good. It is done when it holds across your test set and you have decided how to maintain it.

Re-run the full set

  • Run all your test inputs again after the fixes and confirm the output meets your baseline. One good output proves nothing; consistency across the set is the bar.

Decide on a maintenance approach

Traps That Catch First-Time Porters

A few mistakes show up again and again in first ports. Knowing them in advance turns them from incidents into things you simply avoid.

Judging by a single output

  • The most common trap is reading one good output and declaring the port done. One output proves the prompt can work, not that it does work reliably. Always judge against the full test set, because the failures hide in the inputs you did not happen to try first.

Carrying over settings blindly

  • Temperature, top-p, and format instructions look like neutral configuration, so first-time porters carry them over without thinking. They are not neutral, identical settings behave differently across models, and the unexamined carry-over is a frequent source of subtle instability. Re-test them, do not inherit them.

Skipping the edge cases

  • It is tempting to test only the clean, central inputs because they pass quickly and feel representative. The failures that cause production incidents live in the empty input, the oversized input, and the adversarial input, which is exactly the territory mapped in Edge Cases That Separate Portable Prompts From Brittle Ones.

Treating the port as permanent

Frequently Asked Questions

Can I just paste the prompt and skip all this?

You can, and for a throwaway experiment it is fine. For anything that feeds a downstream system or reaches a customer, skipping the baseline and validation steps means you ship the subtle failures instead of catching them. The careful path adds maybe an hour and prevents the incidents.

What usually breaks first when porting a prompt?

Output format and token budget. The new model produces structure that does not quite match what your downstream code expects, or your prompt occupies a different number of tokens and bumps against a different context window. Check both before anything else.

Do I need evaluation tooling to do my first port?

No. A handful of test inputs, the source outputs saved for comparison, and careful reading get you a real result. Build tooling when you are porting many prompts or many models and the manual comparison becomes the bottleneck.

How do I know when the port is actually finished?

When your full test set produces output that meets the baseline you recorded on the source model, and you have decided how you will maintain the prompt going forward. A single good-looking output is not the finish line; consistency across the set is.

Should I tune the second model's prompt to be better than the original?

On your first port, aim for parity, not improvement. Getting the new model to match the original is the milestone. Once you can reliably reach parity, optimizing each model's prompt for its strengths is the natural next step.

Key Takeaways

  • Start from a prompt that already works on its source model and a small set of representative test inputs including edge cases.
  • Capture a baseline on the original model before touching the second one, so you can tell whether the port preserved quality.
  • Treat the first run on the new model as a draft to inspect; catalog every failure as your work plan.
  • Most first ports need two or three targeted fixes, format first, then reasoning scaffold, not a rewrite.
  • The port is done when the full test set meets the baseline and you have chosen a maintenance approach, with shared-core-plus-overrides the usual default.
A

Agency Script Editorial

Editorial Team

The Agency Script editorial team delivers operational insights on AI delivery, certification, and governance for modern agency operators.

Ready to certify your AI capability?

Join the professionals building governed, repeatable AI delivery systems.

Explore Certification