如何用C开发DataStage Parallel Routine

如何用C开发DataStage Parallel Routine

很多人都在问DataStage Parallel Routine如何写，可是几乎没有人回答，网上也没有找到。倒是从网上找到一个用C++开发Parallel Routine的 ，只是试了试没有成功。URL如下：http://blogs.ittoolbox.com/dw/soa/archives/datastage-parallel-routines-made-really-easy-20926

我用DataStage自带的示例做了一下，server端为AIX环境，供大家参考

1、用C开发Parallel Routine，需要用到 Makefile去编译C文件

   创建C文件和Makefile文件，

C文件如下：

/*

//

// Examplefunctions to be used as parallel external user functions in the transformerstage

//

// These areexamples for Solaris, and are intended for demonstration purposes only.

//

*/

#include"string.h"

/*

// Case 1:Returning an int value

*/

int TrxFuncInt()

{

return -1034;

}

/*

// Case 2:Returning an unsigned char

*/

unsigned charTrxFuncUChar()

{

return (unsigned char)‘&‘;

}

/*

// Case 3:Returning a long

*/

long longTrxFuncLong()

{

return 119921;

}

/*

// Case 4:Returning a char string

*/

char*TrxFuncCharStr()

{

return (char*)"TestString";

}

/*

// Case 5: Afunction taking one of each type of argument

*/

intTrxFuncAllArgs(signed char arg1, unsigned char arg2,

                short arg3,       unsigned short arg4,

                int arg5,         unsigned int arg6,

                long long arg7,   unsigned long long arg8,

                float arg9,

                double arg10,

                char* arg11)

{

int retval;

/*

// this just checks the value of each inputargument. If all the values are

// as expected then it returns 0, otherwise-1

*/

if (arg1 != ‘&‘) {

    retval = -1;

} else if (arg2 != (unsigned char)‘&‘){

    retval = -1;

} else if (arg3 != -3) {

    retval = -1;

} else if (arg4 != 4) {

    retval = -1;

} else if (arg5 != 5555) {

    retval = -1;

} else if (arg6 != 6665) {

    retval = -1;

} else if (arg7 != -77777) {

    retval = -1;

} else if (arg8 != 87654) {

    retval = -1;

} else if ((arg9 <= 2.2) || (arg9 >=2.4)) {

    retval = -1;

} else if (arg10 != 4.3) {

    retval = -1;

} else if (strcmp(arg11,(char*)"TestString") != 0) {

    retval = -1;

} else {

    retval = 0;

}

return retval;

}

Makefile文件内容如下：

#=====================================================================

Example Makefile to build the exampletransformer external functions

SOLARIS version, intended fordemonstration purposes only.

#=====================================================================

TARGETLIB =libTrxFuncs.so

CODESRC = TrxFuncs.c

TARGETOBJ =TrxFuncs.o

CC = g++

CCOPTIONS = -O -fPIC

LIBCC = $(CC)

LDOPTIONS = -nostartfiles -Wl,-Bshareable,-Bsymbolic,–allow-shlib-undefined

.SUFFIXES: .c .o

#---------------------------------------------------------------------

Rules

---------------------------------------------------------------------

all: $(TARGETLIB)

$(TARGETLIB): $(TARGETOBJ)

   $(LIBCC)$(LDOPTIONS) $(TARGETOBJ) -o $(TARGETLIB)

$(TARGETOBJ): $(CODESRC)

   $(CC)$(CCOPTIONS) -c $(CODESRC) -o $(TARGETOBJ)

clean:

   @rm-f $(TARGETOBJ) $(TARGETLIB)

#---------------------------------------------------------------------

End of makefile

#---------------------------------------------------------------------

2、 将这两个文件放在DataStage 服务器下，然后执行：make；这样会生成TrxFuncs.o和libTrxFuncs.so文件，

3、 在DataStage Manager下创建一个Parallel Routine
Routine name写Routine的名字，External subroutine name则写.c文件中的function名称。如果在Object type中选择Library， 则在Library path中写libTrxFuncs.so文件；如果是选择Object，则在Library path中写TrxFuncs.o文件。然后保存退出

4、然后在DataStage Designer的Transformer中调用其即可