Is colorizing a movie vandalism?

The Three Stooges DVD release is getting some attention for it's decision to offer a colorized version in addition to the original black and white version.

Reminds me of that great "In Living Color" sketch where Ted Turner "colorizes" old movies by using black actors in place of the original white actors.