Raster to Vector Graphics Converter built on top of visioncortex
Article | Web App | DownloadBuilt with 🦀 by The Vision Cortex Research Group
Introductionvisioncortex VTracer is an open source software to convert raster images (like jpg & png) into vector graphics (svg). It can vectorize graphics and photographs and trace the curves to output compact vector files.
Comparing to Potrace which only accept binarized inputs (Black & White pixmap), VTracer has an image processing pipeline which can handle colored high resolution scans. tl;dr: Potrace uses a O(n^2) fitting algorithm, whereas vtracer is entirely O(n).
Comparing to Adobe Illustrator's Image Trace, VTracer's output is much more compact (less shapes) as we adopt a stacking strategy and avoid producing shapes with holes.
VTracer is originally designed for processing high resolution scans of historic blueprints up to gigapixels. At the same time, VTracer can also handle low resolution pixel art, simulating image-rendering: pixelated for retro game artworks.
Technical descriptions of the tracing algorithm and clustering algorithm.
Web AppVTracer and its core library is implemented in Rust. It provides us a solid foundation to develop robust and efficient algorithms and easily bring it to interactive applications. The webapp is a perfect showcase of the capability of the Rust + wasm platform.
Cmd Appvisioncortex VTracer 0.6.0A cmd app to convert images into vector graphics.USAGE:vtracer [OPTIONS] --input --output FLAGS:-h, --helpPrints help information-V, --versionPrints version informationOPTIONS:--colormode True color image `color` (default) or Binary image `bw`-p, --color_precisionNumber of significant bits to use in an RGB channel-c, --corner_threshold Minimum momentary angle (degree) to be considered a corner-f, --filter_speckle Discard patches smaller than X px in size-g, --gradient_stepColor difference between gradient layers--hierarchical Hierarchical clustering `stacked` (default) or non-stacked `cutout`. Only applies to color mode.-i, --inputPath to input raster image-m, --mode Curver fitting mode `pixel`, `polygon`, `spline`-o, --output Path to output vector graphics--path_precision Number of decimal places to use in path string--preset Use one of the preset configs `bw`, `poster`, `photo`-l, --segment_length Perform iterative subdivide smooth until all segments are shorter than this length-s, --splice_threshold Minimum angle displacement (degree) to splice a splineDownloadsYou can download pre-built binaries from Releases.
You can also install the program from source from crates.io/vtracer:
cargo install vtracerYou are strongly advised to not download from any other third-party sources
Usage./vtracer --input input.jpg --output output.svgRust LibraryYou can install vtracer as a Rust library.
cargo add vtracerPython LibrarySince 0.6, vtracer is also packaged as Python native extensions, thanks to the awesome pyo3 project.
pip install vtracerIn the wildVTracer is used by the following products (open a PR to add yours):
Smart logo design CitationsVTracer has since been cited by a few academic papers in computer graphics / vision research. Please kindly let us know if you have cited our work:
SKILL 2023 Framework to Vectorize Digital Artworks for Physical Fabrication based on Geometric Stylization TechniquesarXiv 2023 Image Vectorization: a ReviewarXiv 2023 StarVector: Generating Scalable Vector Graphics Code from ImagesarXiv 2024 Text-Based Reasoning About Vector GraphicsarXiv 2024 Delving into LLMs' visual understanding ability using SVG to bridge image and textHow did VTracer come about?The following content is an excerpt from my unpublished memoir.
At my teenage, two open source projects in the vector graphics space inspired me the most: Potrace and Anti-Grain Geometry (AGG).
Many years later, in 2020, I was developing a video processing engine. And it became evident that it requires way more investment to be commercially viable. So before abandoning the project, I wanted to publish something as open-source for posterity. At that time, I already developed a prototype vector graphics tracer. It can convert high-resolution scans of hand-drawn blueprints into vectors. But it can only process black and white images, and can only output polygons, not splines.
The plan was to fully develop the vectorizer: to handle color images and output splines. I recruited a very talented intern, @shpun817, to work on VTracer. I grafted the frontend of the video processing engine - the "The Clustering Algorithm" as the pre-processor.
Three months later, we published the first version on Reddit. Out of my surprise, the response of such an underwhelming project was overwhelming.
What's next?There are several things in my mind:
Path simplification. Implement a post-process filter to the output paths to further reduce the number of splines.
Perfect cut-out mode. Right now in cut-out mode, the shapes do not share boundaries perfectly, but have seams.
Pencil tracing. Instead of tracing shapes as closed paths, may be we can attempt to skeletonize the shapes as open paths. The output would be clean, fixed width strokes.
Image cleaning. Right now the tracer works best on losslessly compressed pngs. If an image suffered from jpeg noises, it could impact the tracing quality. We might be able to develop a pre-filtering pass that denoises the input.
If you are interested in working on them or willing to sponsor its development, feel free to get in touch.