Friday, June 7, 2013
Try Out Pig
--Local machine(local mode)
--creates copy of linux.words in local fs
cp /usr/share/dict/linux.words linux.words
-- places you in Grunt shell (Grunt is Pig's interactive shell)
pig -x local
--enter Pig latin statements from Grunt shell
grunt> A = load 'linux.words' using PigStorage() as (word:chararray);
grunt> B = filter A by SIZE(word) > 19;
grunt> dump B;
grunt> quit;
--place Pig latin statements in script
/* myscript.pig */
A = load 'linux.words' using PigStorage() as (word:chararray);
B = filter A by SIZE(word) > 19;
dump B;
-- runs the script
pig -x local myscript.pig
-- check running queue/cluster should use?
mapred queue -showacls
--Gateway machine(mapreduce mode. Change (myqueue) to (unfunded)
pig -Dmapred.job.queue.name=unfunded myscript.pig
pig -Dmapred.job.queue.name=unfunded myscript2.pig
pig -Dmapred.job.queue.name=unfunded Pig_ABF.pig
Labels:
Hadoop
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment