Skip to content

AI Colorization Tools Are Broken – Here’s How to Use Them Anyway

Most AI colorization guides won't tell you this: the tools guess wrong more often than you'd think. Here's what actually works for restoring old photos and changing colors in 2026.

7 min readBeginner

AI photo colorizers don’t actually know what color things were. They guess based on patterns, and those guesses are wrong more often than the marketing suggests. A UC Berkeley study found that even state-of-the-art models fool humans only 32% of the time – which means 68% of colorized photos look obviously fake to people who see the originals.

That doesn’t mean these tools are useless. It means you need to know what they’re actually doing.

The Problem Nobody Talks About: AI Colorizers Wash Out History

White waterfalls turned brown. The Golden Gate Bridge painted white. Grass came out blue. These aren’t edge cases – researchers found them testing popular colorizers. Sam Goree analyzed DeOldify (the tech behind Hotpot.ai and MyHeritage) and found something worse: dark skin tones get systematically lightened. Vibrant clothing loses saturation.

Training data. That’s the culprit. Most colorizers learn from ImageNet – a dataset of modern Flickr photos uploaded in the late 2000s. Historical photos? Different film stocks. Age differently. Capture cultures with color palettes that don’t exist in contemporary smartphone pics. A 1940s dress? The AI has zero historical context, so it defaults to bland tans and grays from its training.

Think of it like this: you’re colorizing a photo of someone wearing a bright red bandana. But in grayscale, that red looks identical to a bright green shirt or a bright yellow scarf – same lightness value. The AI can’t reverse-engineer the original without knowing what was actually there. And it doesn’t.

Grayscale images only preserve lightness – not hue or saturation. That’s not an AI limitation. That’s physics.

Method 1: Automatic Colorization (Old Photo Restoration)

Upload a black-and-white photo. Get it back in color. That’s the workflow. Works best for old family photos with standard subjects – people, houses, landscapes. High-contrast images where objects are clearly defined. Photos where historical accuracy doesn’t matter much.

Palette.fm is the best automatic option as of early 2026. 21+ color filters you can apply to the same image. Supports up to 5000x5000px output. 2.8 million people have used it. Free plan? Caps output at 500×500 pixels with a watermark. Paid credits start at $0.0035 per image for the Mega plan ($169/month for 48,000 credits). One credit = one full-res download.

MyHeritage In Color: 10 free colorizations with watermarks. Then you’re forced into the Complete subscription – $199 first year, $299/year after. That’s steep if you only want photo tools, not the genealogy stuff bundled in. Uses the same DeOldify tech as others.

Hotpot.ai looks free. Until you read the fine print. Free outputs come with a CC BY-NC license – blocks commercial use. Volume pricing ranges from $0.02 to $0.25 per image. Built on DeOldify with proprietary tweaks.

If you’re colorizing multiple photos of the same person or place, run one through 2-3 different tools and compare. The “correct” result? Usually the one where skin tones look natural and clothing colors match similar photos from that era.

Method 2: Prompt-Based Recoloring (Changing Existing Colors)

Different problem: you have a color photo, but you want to change specific elements. Product colorways. Swapping a shirt color. Trying a wall in different paint shades. This is recoloring, not colorization.

Tool How It Works Free Limit Best For
Pixelbin Text prompt (“change red shirt to navy blue”) 3 images/month Precise object recoloring
Krea.ai Warm/cool/vintage palette styles No signup required Artistic color experiments
Photoroom Recolor Conversational AI + preserves texture Pro feature only E-commerce product variants

Pixelbin understands object context – you can say “make the t-shirt green” and it won’t bleed color into the background. 10MB file size limit and 3-image monthly cap? More of a testing tool than a production workflow.

What Actually Determines Quality

Original image quality matters more than the tool. A high-contrast, well-exposed black-and-white scan will colorize better on a free tool than a low-res, faded photo will on a paid one.

Resolution traps: Free tiers aren’t just watermarked – they’re crippled. Palette.fm’s 500x500px output? Unusable for printing. Kolorize downsamples anything over 4096×4096 and forces JPG output. Compression artifacts on top of colorization errors.

Processing time is a red herring. Kolorize: 3-8 seconds. Others: instant. Speed doesn’t correlate with accuracy. The models are similarly sized. The difference is server load.

The File Format Gotcha

Upload a PNG. Get back a JPG. Most tools convert to JPG on export – even if you paid for “high resolution.” JPG compression can muddy subtle color transitions the AI just spent 10 seconds predicting. Kolorize is transparent about this: JPG output only, no exceptions. Others? You don’t find out until you download.

When the AI Can’t Solve the Problem

Patterned fabric. Stripes, plaids, florals. The AI sees contrast edges and hallucinates random hues. Same with transparent objects – glass, water. Reflective surfaces: metal, mirrors. Low-light photos where shadow detail is already lost.

Group photos where multiple people wear similar clothing? The AI assigns them identical colors, even if they were wearing different shades. A 2020 survey paper calls this the “color consistency” problem – the models lack memory of previous predictions within the same image.

The Research You Should Know About

Multiple studies have benchmarked colorization accuracy. This isn’t anecdotal.

Richard Zhang’s 2016 UC Berkeley paper: trained a model on 1.3 million images. Ran a “colorization Turing test” – humans picked the real photo vs. the colorized one. The AI won 32% of trials. Better than random guessing (16.7% for 6 options). Nowhere near “indistinguishable from reality.”

A 2022 aerial image colorization study: existing models fail completely on rural and heterogeneous landscapes. Urban scenes work because training data is full of cities. Farmland and forests? Generic greens and browns.

If researchers who built these systems are publishing papers about their limitations, the marketing claims from companies selling access should be read skeptically.

Which Tool Should You Actually Use?

For old family photos where you just want something better than grayscale: Palette.fm if you’re willing to pay for one high-res export, or CapCut if you need a completely free option (with the understanding that results will be more desaturated).

For product photography and e-commerce: Photoroom Recolor or Pixelbin (depending on whether you need batch processing or can recolor one at a time).

For historical research: Manual colorization by a human expert. AI tools propagate bias and invent details. If accuracy matters, don’t automate it.

The Workflow That Works

Start with the best scan you can get. 300 DPI minimum, saved as TIFF or PNG. Don’t resize before uploading – let the tool handle that.

Run it through two different colorizers. Palette.fm and Hotpot.ai use similar underlying tech but different post-processing. If they agree on skin tones and major objects, the result is probably plausible. If one makes the sky blue and the other makes it pink, neither is trustworthy.

Download the highest resolution you can afford, then adjust in a real photo editor. Colorizers often miss white balance – you’ll want to shift the overall temperature warmer or cooler. Saturation usually needs a 10-15% boost because AI models default to conservative predictions.

FAQ

Can AI colorization ever be historically accurate?

Not without external information. The AI can’t know that your grandmother’s dress was blue unless it has context clues (like a blue object casting blue light). If historical accuracy matters, you need archival research – fabric swatches, paint catalogs, contemporary descriptions – not just an algorithm.

Why do free tools add watermarks but also limit resolution?

Watermarks? Removable with inpainting tools. Resolution limits aren’t. A 500x500px photo can’t be printed, so you’re forced to upgrade if you want physical output. It’s a more effective conversion funnel than a logo in the corner.

What’s the difference between colorization and recoloring?

Colorization: adds color to grayscale images (predicting from nothing). Recoloring: changes existing colors in already-colored images (editing specific objects). Different models, different use cases. Most tools market both as “AI colorizer” – confusing. Check whether the demo shows black-and-white inputs or color ones.