Pig
ylzhjlinux
这个作者很懒,什么都没留下…
展开
-
Pig: Install and Rebuild
ENV: Hadoop2.3.0 pig0.12Hadoop is runnig and pig grunt works well.but when load data and dump it to screen#actor = load '/test/actor' using PigStorage(',') as (id, name, addr, time);#dump ...原创 2014-03-25 17:17:11 · 112 阅读 · 0 评论 -
Pig: Using Hcat Example
HCatLoader//use default databaseA = LOAD 'tablename' USING org.apache.hcatalog.pig.HCatLoader(); //specify database 'exampledb' and you could create the database and table using//Hs...原创 2014-04-21 23:22:47 · 180 阅读 · 0 评论 -
pig: using hcat in hue
1. When I alter a talbe in a database, I can get the altered table information by hive cli and hwi, but error comes when click the table in Hue Metastore Manager . A: Find no reasons,but fixe...原创 2014-04-16 17:34:40 · 206 阅读 · 0 评论 -
Pig: Introduction to Latin - 4
cogroup cogroup is a generalization of group . Instead of collecting records of one input based on a key, it collects records of n inputs based on a key. The result is a record with a key and on...原创 2014-03-30 21:13:44 · 84 阅读 · 0 评论 -
Pig: Introduction to Latin - 3
flattenplayers = load 'baseball' as (name:chararray, team:chararray,position:bag{t:(p:chararray)}, bat:map[]);pos= foreach players generate name, flatten(position) as position;bypos= group pos b...原创 2014-03-30 21:13:30 · 73 阅读 · 0 评论 -
Pig: Introduction to Latin - 2
Relational Operationsforeachforeach takes a set of expressions and applies them to every record in the data pipeline. A = load 'input' as (user:chararray, id:long, address:chararray, phone...原创 2014-03-27 17:08:09 · 92 阅读 · 0 评论 -
Pig: Introduction to Latin - 1
Relation and FieldPig Latin is a dataflow language. Each processing step results in a new data set, or relation.A = load 'NYSE_dividends' (exchange, symbol, date, dividends);//A is relation ...原创 2014-03-27 15:48:04 · 145 阅读 · 0 评论 -
Pig: Data Model
Data types NullsIn Pig a null data element means the value is unknown.which is completely different from the concept of null in C, Java, Python, etc.Schemasdividends = load '...原创 2014-03-27 15:19:22 · 117 阅读 · 0 评论 -
Pig: Grunt Usage
Grunt* is Pig’s interactive shell. Start#pig -x local //interacte with local file system#pig //interacte with hadoop cluster Exitgrunt>quit;orCTRL+D Not...原创 2014-03-27 13:36:57 · 73 阅读 · 0 评论 -
Pig: Basic Usage
Running Locally#pig -x local average_dividend.pig Runnig on Hadoop Cluster#pig -e fs -mkdir /user/username //username is the name who run pig#pig -e fs -copyFromLocal NYSE_dividends ...原创 2014-03-27 13:18:40 · 124 阅读 · 0 评论 -
Pig: using hive metastore in oozie
When we run a pig job which using hive metastore table through hue. We need to locate all related jars to oozie sharelib Preparea. compile hive-0.12.0 and hive-0.13.0 to against hadoop2.3.0b...原创 2014-04-24 09:24:49 · 100 阅读 · 0 评论