A faster alternative to the very slow GetPixel() and SetPixel() for .Net System.Drawing.Bitmap

Anybody who works with images often have probably come across .Net Bitmaps (System.Drawing.Bitmap) with their staggeringly slow GetPixel() and SetPixel() methods. Now, if you are going to work directly with images then you’re probably in the wrong place if you are using C# and .Net. However, sometimes you may want to do a small amount image analysis or manipulation from within .Net without the pain of having to pull in any other image libraries – but you find that GetPixel() and SetPixel() are just way too slow to use!

Now there is a faster way to access or manipulate the pixel data stored in a .Net Bitmap, that is to lock it (using LockBits()) and then directly access the raw image data in memory – you unlock it when you’re finished. This method is a lot faster than using Get/SetPixel() but is quite complicated to implement and it’s very messy to look at!

To get around this problem, and to avoid littering my code with gibberish I have written a bitmap wrapper class that wraps a bitmap, locks it, and provides it’s own GetPixel() and SetPixel() functions with which the original bitmap’s image data can be accessed. Using this class you can get fast access to a bitmap while using the familiar Get/SetPixel() paradigm – in this way it should act as a fairly easy drop in replacement for accessing the Bitmap objects directly.

The class is called BmpPixelSnoop and it is used like this:

// Calculate a simple sum over all of the pixels
// in the snooped bitmap. bitmap is a valid Bitmap object
long snoopSum = 0;
// Create a BmpPixelSnoop wrapper for bitmap
using (var snoop = new BmpPixelSnoop(bitmap))
{
    for (int j = 0; j != snoop.Height; j++)
    {
        for (int i = 0; i != snoop.Width; i++)
        {
            // We call GetPixel() on snoop rather
            // than bitmap as it's much faster!
            var col = snoop.GetPixel(i, j);
            snoopSum += col.R +
                        col.G +
                        col.B;
        }
    }
}

First a BmpPixelSnoop object is created to wrap the bitmap, GetPixel() and SetPixel() can then be called on it. When the BmpPixelSnoop object is destroyed (on leaving the using() block) the original bitmap will be unlocked. It is important to note, that while the bitmap is being snooped the original bitmap object cannot be accessed as it’s locked! Currently BmpPixelSnoop only works for bitmaps with a Pixel Format of PixelFormat.Format32bppArgb which is the default format for Bitmaps (if you don’t specify an alternative when creating them).

So for a little extra complication you get easy & fast access to the bitmap data – but how much faster than the native Get/SetPixel() is it? My (non scientific) tests seem to indicate that it’s about 10 times faster, which is fast enough for simple imaging tasks. It is still quite inefficient however, this is a result of wanting to provide the same Get/SetPixel() interface as System.Drawing.Bitmap – for example, GetPixel() always returns all of the pixel data even if you just want to access the red component and hence is slower than it needs to be in this case. I may add extra accessor methods in the future to cater for other usage patterns and greater efficiency.

The code can be found in the git-hub repo: https://github.com/kgodden/DotNetPixelSnoop.

The class is defined in BmpPixelSnoop.cs, there is also some test code to check correctness and performance in Program.cs.

Here is the code:

//   Copyright 2019 Kevin Godden
//
//   Licensed under the Apache License, Version 2.0 (the "License");
//   you may not use this file except in compliance with the License.
//   You may obtain a copy of the License at
//
//       http://www.apache.org/licenses/LICENSE-2.0
//
//   Unless required by applicable law or agreed to in writing, software
//   distributed under the License is distributed on an "AS IS" BASIS,
//   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
//   See the License for the specific language governing permissions and
//   limitations under the License.
using System;
using System.Drawing;
using System.Drawing.Imaging;
/// 
/// Wraps a System.Drawing.Bitmap and provides faster
/// GetPixel() and SetPixel() functions for pixel access.
/// 
/// NB While the snoop object is in scope the wrapped
/// bitmap object is locked and cannot be used 
/// as normal.  Once you have finished snooping
/// on a bitmap object, dispose of the snooper to
/// unlock the bitmap and gain normal access to 
/// it again, it is best to employ the 'using' keyword
/// to effectivly manage the snooper's scope as follows:
/// 
/// 
/// using (var snoop = new BmpPixelSnoop(myBitmap))
/// { 
/// 
///     // Snoop away!
///     var pixel = snoop.GetPixel(0, 0);
///     
/// } // Snoop goes out of scope here and bitmap is unlocked
/// 
/// This class is marked as 'unsafe' so to use it in your project
/// you must have the 'Allow unsafe code' setting checked in the
/// project settings.
/// 
/// 
unsafe class BmpPixelSnoop : IDisposable
{
    // A reference to the bitmap to be wrapped
    private readonly Bitmap wrappedBitmap;
    // The bitmap's data (once it has been locked)
    private BitmapData data = null;
    // Pointer to the first pixel
    private readonly byte* scan0;
    // Number of bytes per pixel
    private readonly int depth;
    // Number of bytes in an image row
    private readonly int stride;
    // The bitmap's width
    private readonly int width;
    // The bitmap's height
    private readonly int height;
    /// 
    /// Constructs a BmpPixelSnoop object, the bitmap
    /// object to be wraped is passed as a parameter.
    /// 
    /// The bitmap to snoop
    public BmpPixelSnoop(Bitmap bitmap)
    {
        wrappedBitmap = bitmap ?? throw new ArgumentException("Bitmap parameter cannot be null", "bitmap");
        // Currently works only for: PixelFormat.Format32bppArgb
        if (wrappedBitmap.PixelFormat != PixelFormat.Format32bppArgb)
            throw new System.ArgumentException("Only PixelFormat.Format32bppArgb is supported", "bitmap");
        // Record the width & height
        width = wrappedBitmap.Width;
        height = wrappedBitmap.Height;
        // So now we need to lock the bitmap so that we can gain access
        // to it's raw pixel data.  It will be unlocked when this snoop is 
        // disposed.
        var rect = new Rectangle(0, 0, wrappedBitmap.Width, wrappedBitmap.Height);
        try
        {
            data = wrappedBitmap.LockBits(rect, ImageLockMode.ReadWrite, wrappedBitmap.PixelFormat);
        }
        catch (Exception ex)
        {
            throw new System.InvalidOperationException("Could not lock bitmap, is it already being snooped somewhere else?", ex);
        }
        // Calculate number of bytes per pixel
        depth = Bitmap.GetPixelFormatSize(data.PixelFormat) / 8; // bits per channel
        // Get pointer to first pixel
        scan0 = (byte*)data.Scan0.ToPointer();
        // Get the number of bytes in an image row
        // this will be used when determining a pixel's
        // memory address.
        stride = data.Stride;
    }
    /// 
    /// Disposes BmpPixelSnoop object
    /// 
    public void Dispose()
    {
        Dispose(true);
        GC.SuppressFinalize(this);
    }
     /// 
    /// Disposes BmpPixelSnoop object, we unlock
    /// the wrapped bitmap.
    /// 
    protected virtual void Dispose(bool disposing)
    {
        if (disposing)
        {
            if (wrappedBitmap != null)
                wrappedBitmap.UnlockBits(data);
        }
        // free native resources if there are any.
    }
    /// 
    /// Calculate the pointer to a pixel at (x, x)
    /// 
    /// The pixel's x coordinate
    /// The pixel's y coordinate
    /// A byte* pointer to the pixel's data
    private byte* PixelPointer(int x, int y)
    {
        return scan0 + y * stride + x * depth;
    }
    /// 
    /// Snoop's implemetation of GetPixel() which is similar to
    /// Bitmap's GetPixel() but should be faster.
    /// 
    /// The pixel's x coordinate
    /// The pixel's y coordinate
    /// The pixel's colour
    public System.Drawing.Color GetPixel(int x, int y)
    {
        // Better do the 'decent thing' and bounds check x & y
        if (x < 0 || y < 0 || x >= width || y >= width)
            throw new ArgumentException("x or y coordinate is out of range");
        int a, r, g, b;
        // Get a pointer to this pixel
        byte* p = PixelPointer(x, y);
        // Pull out its colour data
        b = *p++;
        g = *p++;
        r = *p++;
        a = *p;
        // And return a color value for it (this is quite slow
        // but allows us to look like Bitmap.GetPixel())
        return System.Drawing.Color.FromArgb(a, r, g, b);
    }
    /// 
    /// Sets the passed colour to the pixel at (x, y)
    /// 
    /// The pixel's x coordinate
    /// The pixel's y coordinate
    /// The value to be assigned to the pixel
    public void SetPixel(int x, int y, System.Drawing.Color col)
    {
        // Better do the 'decent thing' and bounds check x & y
        if (x < 0 || y < 0 || x >= width || y >= width)
            throw new ArgumentException("x or y coordinate is out of range");
        // Get a pointer to this pixel
        byte* p = PixelPointer(x, y);
        // Set the data
        *p++ = col.B;
        *p++ = col.G;
        *p++ = col.R;
        *p = col.A;
    }
    /// 
    /// The bitmap's width
    /// 
    public int Width { get { return width; } }
    // The bitmap's height
    public int Height { get { return height; } }
}

Here is some sample output from the colsone based test program, showing relative times:

Testing GetPixel()
GetPixel() OK
Testing SetPixel()
SetPixel() OK
Testing GetPixel() Speed
Bitmap.GetPixel() took 759ms, BmpPixelSnoop.GetPixel() took 67ms
Testing SetPixel() Speed
Bitmap.SetPixel() took 907ms, BmpPixelSnoop.SetPixel() took 72ms

ExifTool- Query Exif Maker Note by ID on Command line

In Exif, each maker-note will have a unique (hex) id. ExifTool can be used to query a maker note’s contents by its id as follows:

exiftool -u -b -Unknown_0x0013 image.jpg

This will return the value for makernote id 0x0013 contained in image.jpg.

PCL LNK2001 unresolved external symbol EuclideanClusterExtraction extract()

I have been getting the following linker error when building with the Point Cloud Library (PCL 1.8.1) in Visual Studio 2017 – not at all sure why:

Error	LNK2001	unresolved external symbol "public: void __cdecl
pcl::EuclideanClusterExtraction
::extract(class std::vector > &)" (?extract@?$EuclideanClusterExtraction@UPointNormal@pcl@@@pcl@@QEAAXAEAV?$vector@UPointIndices@pcl@@V?$allocator@UPointIndices@pcl@@@std@@@std@@@Z)	

I found that to get rid of the linker error I needed to include:

#include 

Again I am not sure why, and it is not usual to have to include impl/* files? – I may look into it a bit further if I get a chance but for now I am happy that my code links!

Hack – Sleeping for less that 1 second in Shell / Bash Script

To sleep in your shell script in units of 1 second – sleep will see you right. However what if you want to sleep for less than one second, say for 200ms?

On some newer system you can do something like this and everything is fine:

sleep .2

However when I try this on my embedded busybox device I just get a response like this:

sleep .2
sleep: invalid number '.2'

So no luck there!

However there is a nice little hack using read, have a look at this:

read -p "" -t 0.2

This will wait for 200ms and then return! It waits for a line of text that never arrives, and times-out after 200ms – in effect it sleeps for 200ms. Now, if read receives a line during the 200ms it will return early, so only use it in cases where you’re sure it won’t or you might end up (temporarily) confused!

It’s not pretty but is better than nothing ;-)

Visual Studio Paho MQTT Error C2238 unexpected token(s) preceding ‘;’

If you’re receiving errors like the following when trying to build a project in Visual Studio 2017 using the Paho C client:

Error C2238 unexpected token(s) preceding ';'

Then there is a quick fix, the problem seems to revolve around the following for DLLImport & DLLExport in the Paho header files:

#if defined(WIN32) || defined(WIN64)
  #define DLLImport __declspec(dllimport)
  #define DLLExport __declspec(dllexport)
#else
  #define DLLImport extern
  #define DLLExport __attribute__ ((visibility ("default")))
#endif

The catch here is that neither WIN32 nor WIN64 will be defined as instead either _WIN32 or _WIN64 will be defined.

So a quick fix is to define either WIN32 or WIN64 in your project’s ‘Preprocessor Definitions’ depending on whether you are targeting x86 (32bit) or x64 (64bit).

Here are some of the other errors you might see when you have this problem:

error C3861: 'visibility': identifier not found
error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
error C2059: syntax error: 'const'
error C3861: 'visibility': identifier not found
error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
error C2374: '__attribute__': redefinition; multiple initialization
note: see declaration of '__attribute__'
error C2448: '__attribute__': function-style initializer appears to be a function definition
 error C3646: 'data': unknown override specifier
 error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
 error C3646: 'value': unknown override specifier
 error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
 error C2143: syntax error: missing ';' before '*'
 error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
 error C2238: unexpected token(s) preceding ';'
 error C3861: 'visibility': identifier not found
 error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
 error C2374: '__attribute__': redefinition; multiple initialization
note: see declaration of '__attribute__'
 error C2448: '__attribute__': function-style initializer appears to be a function definition
 error C2143: syntax error: missing ',' before '*'
 error C3861: 'visibility': identifier not found
 error C4430: missing type specifier - int assumed. Note: C++ does not support default-int

PCL Octree Cheat Sheet

The point cloud library (PCL) is a fantastic resource for working with point clouds, however it is a large library and it can take a while to effectively find your way around it. The octree construct is very useful for working with point clouds, but again it can take a while to learn how to interact with octrees. To help me to remember how to interact with them I will include some examples here:

To iterate across the nodes of an octree (depth first):

//
for (auto it = octree.begin(); it != octree.end(); ++it) {
	if (it.isBranchNode()) {
		cout << "branch" << std::endl;
	}
	if (it.isLeafNode()) {
		cout << "leaf" << std::endl;
	}
}
//

To iterate across the leaf nodes:

//
for (auto it = octree.leaf_begin(); it != octree.leaf_end(); ++it) {
}
//


Get a Voxel's Bounding Region given node iterator:

//
// Get iterator to first leaf
auto it = octree.leaf_begin();
Eigen::Vector3f voxel_min, voxel_max;
octree.getVoxelBounds(it, voxel_min, voxel_max);
//

Get point indices from leaf node iterator

//
auto it = octree.leaf_begin(); 
std::vector indices;
it.getLeafContainer().getPointIndices(indices);
//

Get point indices from leaf node pointer

//
std::vector indices;
if (node->getNodeType() == LEAF_NODE)
{
	// Nasty down-cast?
	auto* l = dynamic_cast ::LeafNode*>(node);
	(*l)->getPointIndices(indices);
}
//

An implementation of ntohf() with code

I am working on extracting data from some binary navigation messages today. Working with binary data can be difficult and quite confusing – especially when converting byte order from network (big endian) to host byte order (possibly little endian). The integer types are well covered by ntohs() and ntohl() et al. but when dealing with floats things can get a bit harder as ntohf() isn’t always available to the hard pressed programmer!

So I have included a simple implementation below, I have tested it during my own use, but it use at your own risk as this code may well be an example of a rather dubious use of unions!

//
#include 
#ifndef ntohf
// Converts a 32 bit IEEE float represented as
// 4 bytes in network byte order to a float in host byte order
// the 4 bytes are passed as an unsigned 32bit integer
inline float ntohf(uint32_t net32)
{
    union {
        float f;
        uint32_t u;
    } value;
    // Swap bytes if necessary and store to value
    value.u = ntohl(net32);
    // return value as float
    return value.f;
}
#endif
//

This version is slightly adapted from an original implementation by Kevin Bowling (pls. see copyright notice).

ASCII ‘art’ for Camera Calibration Python Script

Working on a python script for a focus calibration (software based) routine for a computer vision camera, in order to spruce it up a bit I decide to add a nice ASCII introduction! #Friday

camera_cal

Using a Virtual USB Serial Port from a Guest OS on VirtualBox

Here is a decent set of instructions on how to access normal COM ports as well as USB Virtual com ports from you Guest OS running on VirtualBox – Thankfully it worked for me but I had to install the FTDI drivers on the Guest for rs232, I got them from here.

Thanks jorgensen!
.

Have ExifTool Display Maker Notes

Phil Harvey’s ExifTool is a fantastic software tool for displaying and interacting with image Exif data, however by default it doesn’t display maker notes and I always forget the command line options to persuade it to list them, so here it is – the -u option gets exiftool to display ‘unknown’ tags and theses include maker notes!

exiftool -u image.jpg

The makernotes will be listed as unknown items by their hex ids.

Happy days – Thanks Phil!

exiftool display maker notes

.