Are there any useful tips in using AI to quickly replace a background with your own files? AI does not seem to generate the same exact building as a replacement.

Question

I am looking for a quick way to remove the background from a panoramic photo and replace it with another. The dilemma I have is that often replacing the background can be difficult to do because I am replacing a very specific building in which when I have used AI in Photoshop to do so it does not generate the same building for me. AI only seems to generate new buildings and not recreate the same building I am using or any details of the building. How can I still use AI to complete removing and replacing the building in the background?

Answer 1

Great question — and yes, this is a common dilemma when you want to remove a specific background (like a building) but not replace it with a random AI-generated structure.

The core issue:

When using Generative Fill in Photoshop, AI is trained to invent content — not match real-world, specific architecture unless explicitly given reference imagery. So it won’t re-create the same building you had unless you guide it more directly.

Best Workflow to Remove and Replace a Background Building (Accurately)

OPTION 1: Use AI + Reference Image Matching

1. Extract the foreground (subject):
2. Use Select Subject, Select > Sky, or Select > Color Range (for fine selections).
3. Refine the edges using Select and Mask.
4. Once clean, copy to a new layer or use Layer Mask to hide the background.
5. Get a clean shot of the background you want to use (if it’s the same building from a different angle or date):
6. Use another photo of the same building from your archive.
7. Or, search Google Street View and take a screenshot (if the copyright situation allows it for your project).
8. Use perspective warp or transform to match the angle and scale.
9. Composite it in manually:
10. Align and blend it behind your masked foreground.
11. Use tools like Color Match, Camera Raw Filter, or Gradient Map blending to unify lighting and tone.

OPTION 2: Use Generative Fill but with a Guide Layer (hacky but works)

1. Place a low-opacity overlay of the actual building (as a guide/reference).
2. Use Generative Fill, but in the prompt, include very specific descriptors, e.g.:
3. “Recreate building with glass façade and red awnings as shown in overlay.”
4. After generation, manually blend or warp AI results to more closely match reality — using liquify, clone stamp, or blend modes.

🧠 AI can’t "know" the real building unless you show it.

🔧 OPTION 3: Use Photoshop’s new Reference Image Capabilities (if available in your version)

In newer beta versions or coming features (check your Creative Cloud updates), Adobe is testing Generative Fill with reference images.

1. If you’re part of the beta: you can upload a specific image of the building and ask Photoshop to reference it during generation.
2. If not, mimic this by placing a reference image visibly in the canvas before using the Generative Fill prompt.

Tips for Cleaner Composites:

1. Use feathered masks around the edges of the foreground for realism.
2. Match the perspective — use vanishing points, guides, or camera raw’s upright tool.
3. Match the color temperature and grain between layers.

Answer 2

Replacing a specific building in the background of a panoramic photo using AI in Photoshop can be challenging. Here are some steps and tips to help you achieve this more effectively:

1. Remove the Background:
2. Open your image in Photoshop.
3. Use the Select Subject feature to select the main subject.
4. Click Remove Background in the Properties panel to remove the existing background¹.
5. Generate a New Background:
6. Use the Generative Fill feature to create a new background. However, since you need a specific building, this might not always give you the desired result.
7. Use a Reference Image:
8. Find a reference image of the specific building you want to use.
9. Place this image in your document as a new layer.
10. Manual Adjustments:
11. Blend the new building into your panoramic photo using tools like the Clone Stamp Tool or Healing Brush Tool.
12. Adjust the lighting and colors to match the rest of the image for a seamless look.
13. Refine the Edges:
14. Use the Brush Tool to clean up any remaining edges and ensure the new background looks natural.
15. Save and Export:
16. Once you’re satisfied with the result, save your work and export the image.

By combining AI tools with manual adjustments, you can achieve a more precise and realistic replacement of the building in your panoramic photo.