How to Remove Rust From Metal Using Just Sandpaper (No Chemicals)

I had an old square metal pipe sitting around that had gotten badly rusted on one side, the kind of rust that's flaky, rough, and looks like the piece is basically done for.

My first instinct was to just toss it, but before doing that, I decided to see if a simple piece of sandpaper could actually bring it back. No rust remover, no power tools, just manual effort and a bit of patience.

If you enjoy quick, practical DIY fixes like this one, I also share posts from my videos on my WhatsApp channel, Diy in a Minute, where you can follow along between uploads.

Here's what I used and the exact process I followed to get the rust off and the metal looking clean again.

1. A rusted metal object (in this case, a square metal pipe)
2. Sandpaper (cloth-backed, cut into a small workable piece)
3. Scissors (to cut the sandpaper down to size)
4. A cloth or surface to catch the rust dust (optional, for easier cleanup)

Before doing anything, take a close look at the metal to understand how bad the rust actually is. In my case, the square pipe had heavy rust buildup on one entire side, flaky and rough to the touch. Getting a clear look at the damage helps you know what you're working with and whether sanding alone will be enough.

Instead of using a full, large sheet of sandpaper, cut off a small piece with scissors. A smaller piece is easier to grip, bends with the contours of the metal, and gives you more control, especially on a narrow surface like a pipe.

Hold the metal steady and start rubbing the sandpaper firmly over the rusted side. Work in a back-and-forth motion, covering the surface evenly rather than focusing on just one spot. You'll notice rust particles and dust starting to fall away almost immediately.

This step takes some patience. Keep rubbing the sandpaper over the surface, going over the same area multiple times. The goal is to work through the flaky top layer of rust until it's fully broken down and removed from the metal underneath.

Periodically stop and look at the surface to see how much rust has lifted. If there are still patches of rust remaining, continue sanding those specific areas until the color and texture start to even out.

Once the rust has been fully sanded away, the surface underneath becomes visible, clean and noticeably shinier than the rusted layer that was covering it. In my case, all the heavy rust on that side of the pipe was removed, leaving the bare metal exposed.

After sanding, there will be a fine layer of rust dust sitting on the surface and surrounding area. Wipe this away so you can clearly see the finished result and keep your workspace clean.