一、About thrift
二、什么是thrift,怎么工作?
三、Thrift IDL
四、Thrift Demo
五、Thrift 协议栈 以及各层的使用(java 为例)
六、与protocolbuffer的区别
一、About thrift
thrift是一种可伸缩的跨语言服务的发展软件框架。它结合了功能强大的软件堆栈的代码生成引擎,以建设服务,工作效率和无缝地与C + +,C#,Java,Python和PHP和Ruby结合。thrift是facebook开发的,我们现在把它作为开源软件使用。thrift允许你定义一个简单的定义文件中的数据类型和服务接口。以作为输入文件,编译器生成代码用来方便地生成RPC客户端和服务器通信的无缝跨编程语言(来自百度百科)。
>>>最初由facebook开发用做系统内个语言之间的RPC通信 。
>>>2007年由facebook贡献到apache基金 ,现在是apache下的opensource之一 。
>>>支持多种语言之间的RPC方式的通信:php语言client可以构造一个对象,调用相应的服务方法来调用java语言的服务 ,跨越语言的C/S rpc 调用 。
二、什么是thrift,怎么工作?
java rmi的例子,代码见附件,建立一个java rmi的流程 :
>>>定义一个服务调用接口 。
>>>server端:接口实现---impl的实例---注册该服务实现(端口)---启动服务。
>>>client端:通过ip、端口、服务名,得到服务,通过接口来调用 。
>>>rmi数据传输方式:java对象序列化 。
Thrift 服务
>>>例同rmi ,需要定义通信接口、实现、注册服务、绑定端口……
>>>如何多种语言之间通信 ?
>>>数据传输走socket(多种语言均支持),数据再以特定的格式(String ),发送,接收方语言解析 。
Object ---> String ---> Object 。
问题:编码、解析完全需要自己做 ,复杂的数据结构会编码困难 .
Thrift 服务 :thrift的中间编码层
>>>java Object ---> Thrift Object ---> php Object
>>> 定义thrift的文件 ,由thrift文件(IDL)生成 双方语言的接口、model ,在生成的model以及接口中会有解码编码的代码 。
>>>thrift 文件例子
thrift-0.7.0.exe -r -gen java TestThrift.thrift 生成java 代码
thrift-0.7.0.exe -r -gen php TestThrift.thrift 生成php代码
thrift-0.7.0.exe -r -gen py TestThrift.thrift 生成python代码
thrift-0.7.0.exe -r -gen as3 TestThrift.thrift 生成as3代码
thrift-0.7.0.exe -r -gen cpp TestThrift.thrift 生成C++代码
三、Thrift IDL
http://www.cnblogs.com/tianhuilove/archive/2011/09/05/2167669.html
http://wiki.apache.org/thrift/
http://wiki.apache.org/thrift/ThriftTypes
四、Thrift Demo
Thrift IDL 文件
1
2
3
4
5
6
7
8
9
10
11
12
13
14
|
namespace java com.gemantic.analyse.thrift.index
struct NewsModel{
1:i32 id ;
2:string title;
3:string content;
4:string media_from;
5:string author;
}
service IndexNewsOperatorServices {
bool indexNews(1:NewsModel indexNews),
bool deleteArtificiallyNews(1:i32 id )
}
|
java server
Java代码
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
|
package
com.gemantic.analyse.thrift.index;
import
java.net.InetSocketAddress;
import
org.apache.thrift.protocol.TBinaryProtocol;
import
org.apache.thrift.server.TServer;
import
org.apache.thrift.server.TThreadPoolServer;
import
org.apache.thrift.server.TThreadPoolServer.Args;
import
org.apache.thrift.transport.TServerSocket;
import
org.apache.thrift.transport.TServerTransport;
import
org.apache.thrift.transport.TTransportFactory;
public
class
ThriftServerTest {
/**
* @param args
*/
public
static
void
main(String[] args) {
// TODO Auto-generated method stub
IndexNewsOperatorServices.Processor processor =
new
IndexNewsOperatorServices.Processor(
new
IndexNewsOperatorServicesImpl());
try
{
TServerTransport serverTransport =
new
TServerSocket(
new
InetSocketAddress(
"0.0.0.0"
,
9813
));
Args trArgs=
new
Args(serverTransport);
trArgs.processor(processor);
//使用二进制来编码应用层的数据
trArgs.protocolFactory(
new
TBinaryProtocol.Factory(
true
,
true
));
//使用普通的socket来传输数据
trArgs.transportFactory(
new
TTransportFactory());
TServer server =
new
TThreadPoolServer(trArgs);
System.out.println(
"server begin ......................"
);
server.serve();
System.out.println(
"---------------------------------------"
);
server.stop();
}
catch
(Exception e){
throw
new
RuntimeException(
"index thrift server start failed!!"
+
"/n"
+e.getMessage());
}
}
}
|
java client
Java代码
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
|
package
com.gemantic.analyse.thrift.index;
import
org.apache.thrift.TException;
import
org.apache.thrift.protocol.TBinaryProtocol;
import
org.apache.thrift.protocol.TProtocol;
import
org.apache.thrift.transport.TSocket;
import
org.apache.thrift.transport.TTransport;
public
class
ThriftClientTest {
/**
* @param args
* @throws TException
*/
public
static
void
main(String[] args)
throws
TException {
// TODO Auto-generated method stub
TTransport transport =
new
TSocket(
"10.0.0.41"
,
9813
);
long
start=System.currentTimeMillis();
// TTransport transport = new TSocket("218.11.178.110",9090);
TProtocol protocol =
new
TBinaryProtocol(transport);
IndexNewsOperatorServices.Client client=
new
IndexNewsOperatorServices.Client(protocol);
transport.open();
client.deleteArtificiallyNews(
123456
);
NewsModel newsModel=
new
NewsModel();
newsModel.setId(
789456
);
newsModel.setTitle(
"this from java client"
);
newsModel.setContent(
" 世界杯比赛前,由于塞尔维亚和黑山突然宣布分裂,国际足联开会决定剔除塞黑,由世界上球迷最多的国家顶替,名额恰巧来到中国。举国上下一片欢腾,中国足协决定由“成世铎”(成龙+阎世铎)组队,进军世界杯。"
);
newsModel.setAuthor(
"ddc"
);
newsModel.setMedia_from(
"新华08"
);
client.indexNews(newsModel);
transport.close();
System.out.println((System.currentTimeMillis()-start));
System.out.println(
"client sucess!"
);
}
}
|
php client
Php代码
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
|
<?php
$GLOBALS
[
'THRIFT_ROOT'
] =
'/home/tjiang/demo/thrift/lib/php/src'
;
require_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/Thrift.php'
;
require_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/protocol/TBinaryProtocol.php'
;
require_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/transport/TSocket.php'
;
require_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/transport/THttpClient.php'
;
require_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/transport/TBufferedTransport.php'
;
include_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/packages/TestThrift/TestThrift_types.php'
;
include_once
$GLOBALS
[
'THRIFT_ROOT'
].
'/packages/TestThrift/IndexNewsOperatorServices.php'
;
$data
=
array
(
'id'
=>
'1'
,
'title'
=>
'demo-标题'
,
'content'
=>
'demo-内容'
,
'media_from'
=>
'hexun'
,
'author'
=>
'xiaodi667'
);
$thrif_server_url
=
'10.0.0.41'
;
$transport
=
new
TSocket(
$thrif_server_url
, 9813);
$transport
->open();
$protocol
=
new
TBinaryProtocol(
$transport
);
$client
=
new
IndexNewsOperatorServicesClient(
$protocol
,
$protocol
);
$obj
=
new
NewsModel(
$data
);
$result
=
$client
->indexNews(
$obj
);
$transport
->close();
?>
|
python client
Python代码
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
|
#!/usr/bin/env python
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#
import
sys
from
TestThrift.ttypes
import
NewsModel
from
TestThrift.IndexNewsOperatorServices
import
Client
from
thrift
import
Thrift
from
thrift.transport
import
TSocket
from
thrift.transport
import
TTransport
from
thrift.protocol
import
TBinaryProtocol
try
:
# Make socket
transport
=
TSocket.TSocket(
'10.0.0.41'
,
9813
)
# Buffering is critical. Raw sockets are very slow
transport
=
TTransport.TBufferedTransport(transport)
# Wrap in a protocol
protocol
=
TBinaryProtocol.TBinaryProtocol(transport)
# Create a client to use the protocol encoder
client
=
Client(protocol)
# Connect!
transport.
open
()
client.deleteArtificiallyNews(
123
)
newsModel
=
NewsModel()
newsModel.
id
=
123456
newsModel.title
=
"python Test"
newsModel.content
=
"client test come from python"
;
newsModel.media_from
=
"xinhua08"
client.indexNews(newsModel)
#close
transport.close()
except
Thrift.TException, tx:
print
'%s'
%
(tx.message)
|
Csharp client
C#代码
1
2
3
4
5
6
7
8
9
10
11
12
13
|
TTransport transport =
new
TSocket(
"10.0.0.41"
, 9813);
TProtocol protocol =
new
TBinaryProtocol(transport);
IndexNewsOperatorServices.Client client =
new
IndexNewsOperatorServices.Client(protocol);
transport.Open();
NewsModel model =
new
NewsModel();
model.Author =
"jww"
;
model.Title =
"title"
;
model.Content =
"client Come From CSharp"
;
model.Id = 1;
client.deleteArtificiallyNews(123);
Console.WriteLine(client.indexNews(model));
|
五、Thrift 协议栈 以及各层的使用(java 为例)
1、model interface
服务的调用接口以及接口参数model、返回值model
2、Tprotocol 协议层
将数据(model)编码 、解码 。
3、Ttramsport 传输层
编码后的数据传输(简单socket、http)
5、Tserver
服务的Tserver类型,实现了几种rpc调用(单线程、多线程、非阻塞IO)
六、与protocolbuffer的区别
http://liuchangit.com/development/346.html
http://stackoverflow.com/questions/69316/biggest-differences-of-thrift-vs-protocol-buffers
区别:
1、Another important difference are the languages supported by default. protobuf: Java, C++, Python Thrift: Java, C++, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, Smalltalk, Ocaml
支持语言不同,thrift支持着更多的语言 。
2、Thrift supports ‘exceptions 。
thrift支持服务的异常 。
3、Protocol Buffers much easier to read 。Protobuf API looks cleaner, though the generated classes are all packed as an inner classes which is not so nice.
Protocol Buffers 在文档方面比thrift丰富,而且比thrift简单 。
4、Protobuf serialized objects are about 30% smaller then Thrift.
Protocol Buffers在序列化/反序列化、传输上性能更优 。
5、RPC is another key difference. Thrift generates code to implement RPC clients and servers wheres Protocol Buffers seems mostly designed as a data-interchange format alone.
thrift提供了一套完整的rpc服务实现(多线程socket、非阻塞的socket....)
6、And according to the wiki the Thrift runtime doesn't run on Windows.
thrift 对有些语言在windows上不支持:C++ .....