Masking, Refine Edge, and Clipping Masks
Masking is the technique that makes everything else possible. It is referenced throughout this entire unit.
Why masking is foundational
Masking is how Photoshop hides parts of a layer without deleting them. The pixels under a mask are always preserved — the mask is a separate greyscale map that controls visibility. This non-destructive logic means any masked edge can be refined, extended, or removed at any point. It is the mechanism behind entourage extraction, sky replacement, texture clipping, and shadow control. Every card in this unit that involves cutting out an object, containing a texture, or compositing two images together depends on masking. Learn this correctly once and everything else builds on it.
Layer mask fundamentals
A layer mask is a greyscale channel attached to a layer. White reveals, black conceals, grey partially reveals. This is always the rule. Adding a layer mask (click the mask icon at the bottom of the Layers panel) adds a white mask — the entire layer is visible. Paint black on the mask to hide areas. Paint white to restore them. The layer pixels are never touched.
| Action | How to do it |
|---|---|
| Add a layer mask | Click the mask icon at the bottom of the Layers panel (filled circle in a square) |
| Add mask hiding all content | Alt/Option+click the mask icon — adds a black (fully hidden) mask |
| Switch between layer and mask | Click the layer thumbnail or the mask thumbnail in the Layers panel — a border appears around the active one |
| Paint on the mask | With the mask thumbnail selected, paint with black to hide or white to reveal |
| View the mask as a red overlay | Alt/Option+Shift+click the mask thumbnail — shows what the mask looks like over the image |
| View the mask as greyscale | Alt/Option+click the mask thumbnail — shows the raw mask |
| Apply mask permanently | Right-click the mask thumbnail → Apply Layer Mask — merges the mask into the layer pixels (destructive) |
| Delete a mask | Right-click the mask thumbnail → Delete Layer Mask — removes without affecting the layer |
Refine Edge workflow for complex extractions
Refine Edge (accessed via Select → Select and Mask, or the Refine Edge button in the options bar when a selection is active) is the tool for extracting objects with complex edges — foliage, hair, fur, translucent elements. The hidden legacy Refine Edge interface (accessed by holding Alt/Option while clicking Refine Edge in older workflows) is often more intuitive for complex edge work.
| Step | What you're doing |
|---|---|
| 1. Start with a rough selection | Use Quick Selection, Polygonal Lasso, or Select Subject as a starting point — accuracy here only needs to be approximate |
| 2. Open Refine Edge / Select and Mask | Select → Select and Mask (or Alt+click Refine Edge in the options bar for the legacy interface) |
| 3. Use the Edge Detection brush | Paint along complex edges (foliage, hair) with the Refine Edge Detect Edges brush — Photoshop analyzes the edge zone and extracts fine detail |
| 4. Adjust Global Refinements | Smooth (reduces jagged edges), Feather (softens edge slightly — use minimally), Contrast (sharpens soft edges), Shift Edge (shrinks or expands the selection boundary) |
| 5. Output settings | Output to: Layer Mask — this applies the refined selection as a non-destructive mask on the original layer |
| 6. Manual cleanup | With the mask applied, zoom to 100% and paint on the mask to correct any areas where the edge detection over or under-selected |
Clipping masks — containing textures to filled areas
A clipping mask clips a layer to the visible shape of the layer directly below it — the clipped layer is only visible where the layer beneath has pixels. This is how textures are contained to specific area fills in a compositing workflow.
The critical workflow principle: let the texture extend beyond the fill boundary. Do not crop the texture tightly to the fill area. The overhang is what preserves long-term editability — when the fill shape changes (a design revision, a new site boundary, a different cropping), the texture already covers the extended area and automatically fills the new boundary. A texture cropped tightly to a fill boundary requires re-sourcing and re-applying every time the boundary changes.
| Step | What you're doing |
|---|---|
| 1. Create the fill area | Draw a closed shape (or paint a filled area) representing where the material lives in the scene — this is the base layer. This shape defines the visible boundary. |
| 2. Place the texture above it | Place or open the texture image and position it above the fill layer in the Layers panel. Let it extend beyond the fill boundaries generously. |
| 3. Create the clipping mask | With the texture layer selected, Layer → Create Clipping Mask (or Alt/Option+click the border between the texture layer and the fill layer). The texture is now visible only within the fill shape below it. |
| 4. Transform the texture | With the clipping mask active, the texture layer can be repositioned and scaled freely within the fill boundary. The fill shape stays fixed; the texture moves inside it. |
| 5. Edit the fill shape | If the fill area changes later, the texture follows automatically — the clipping relationship means the texture always fills wherever the base layer has pixels. |
Try this
Draw a closed irregular shape and fill it with a flat color. Place a texture above it and create a clipping mask. Verify that the texture only shows inside the shape. Now reposition the texture layer inside the clipping mask relationship and note that the fill shape doesn't move. Then resize the fill shape and note that the texture automatically fills the new boundary without any re-positioning. This is the editability argument for extending textures beyond their boundaries.
What breaks
Applying a layer mask to hide content instead of using a clipping mask — both produce similar visual results, but a layer mask permanently links the visibility decision to the specific mask shape painted. If the fill area changes, the mask must be repainted. A clipping mask relationship follows the base layer automatically. Use clipping masks for texture containment; use layer masks for extraction and edge work.
Painting directly on the layer instead of on its mask — the most common beginners' error. If painting black isn't hiding anything, you are probably on the layer thumbnail, not the mask thumbnail. Check which is highlighted (bordered) in the Layers panel.