http://stackoverflow.com/questions/1236060/compiling-python-modules-whith-debug-defined-on-msvc
As a workaround to the situation, try to copy the file python26.dll to python26_d.dll. (I'm not sure this will work; you say you are building a SWIG library in debug mode, and it's possible that SWIG will try to use features of the Python debugging version. If that's the case, you'll have no choice but to use the debugging version of Python.)
Edit: From comments:
You should also edit pyconfig.h and comment out the line "#define Py_DEBUG" (line 374)