Python MapReduce library written in Cython.

Last update: Sep 16, 2022

Related tags

Overview

Brandyn White 
  
Andrew Miller 
  
   

Source  
   https://github.com/bwhite/hadoopy/
Issues  
   https://github.com/bwhite/hadoopy/issues
Docs    
   http://bwhite.github.com/hadoopy/

IRC: #hadoopy @ freenode.net

Requirements
python development headers (python-dev), build tools (build-essential)

Optional
cython (>=.13) (without this it falls back to the pregenerated .c files)

Features
- oozie support
- Automated job parallelization 'auto-oozie' available in the hadoopy_flow project (maintained out of branch)
- typedbytes support (very fast)
- Local execution of unmodified MapReduce job with launch_local
- Read/write sequence files of TypedBytes directly to HDFS from python (readtb, writetb)
- Works on OS X
- Allows printing to stdout and stderr in Hadoop tasks without causing problems (uses the 'pipe hopping' technique, both are available in the task's stderr)
- critical path is in Cython
- works on clusters without any extra installation, Python, or any Python libraries (uses Pyinstaller that is included in this source tree)
- Simple HDFS access (readtb and ls) inside Python, even inside running jobs
- Unit test interface
- Reporting using status and counters (and print statements! no need to be scared of them in Hadoopy)
- Supports design patterns in the Lin/Dyer book (
   http://www.umiacs.umd.edu/~jimmylin/book.html)

Limitations
- Hadoop Local currently unsupported due to a bug in Hadoop's handling of the distributed cache in this mode.  Use psuedo-distributed instead for now.  (
   https://github.com/bwhite/hadoopy/issues/40)

Used in
- A Case for Query by Image and Text Content: Searching Computer Help using Screenshots and Keywords (to appear in WWW'11)
- Web-Scale Computer Vision using MapReduce for Multimedia Data Mining (at KDD'10)
- Vitrieve: Visual Search engine
- Picarus: Hadoop computer vision toolbox

Ubuntu Install (others are similar)
sudo apt-get install python-dev build-essential
sudo python setup.py install

Comments

old versions of glibc don't have be64toh

Hey Brian,

This package looks awesome. Thanks for making it available. Unfortunately, I'm stuck on a cluster with an ancient version of glibc. This glibc doesn't have the handy big-endian routines you use in the typed bytes files.

Python 2.6.5 (r265:79063, Jun 4 2010, 21:42:56) [GCC 4.1.2 20080704 (Red Hat 4.1.2-48)] on linux2 Type "help", "copyright", "credits" or "license" for more information.

import hadoopy Traceback (most recent call last): File "", line 1, in File "/home/dfgleic/envs26/hadoopy/lib/python2.6/site-packages/hadoopy/init.py", line 25, in from _typedbytes import TypedBytesFile ImportError: /home/dfgleic/envs26/hadoopy/lib/python2.6/site-packages/_typedbytes.so: undefined symbol: be64toh

I wrote the following quick code to convert them, which I haven't extensively tested yet. (i.e. don't trust it without further testing). Based on the C code generated, this looks much slower. If you have any ideas for "optionally" including these functions as c code themselves, I'd be happy to test it out.

cdef inline int be32toh(int val): cdef unsigned char* c = <unsigned char*>&val return int( (int(c[0] & 255) << 24) + (int(c[1] & 255) << 16) + (int(c[2] & 255) << 8) + (int(c[3] & 255)) )

cdef inline int htobe32(int i): cdef int rval cdef unsigned char _c = &rval c[0] = (i >> 24)&255 c[1] = (i >> 16)&255 c[2] = (i >> 8)&255 c[3] = (i)&255 return rval

cdef inline long be64toh(long val): cdef unsigned char* c = <unsigned char*>&val return long( (long((c[0] & 255)) << 56) + (long(c[1] & 255) << 48) + (long(c[2] & 255) << 40) + (long(c[3] & 255) << 32) + (long(c[4] & 255) << 24) + (long(c[5] & 255) << 16) + (long(c[6] & 255) << 8) + (long(c[7] & 255) ) )

cdef inline long htobe64(long l): cdef long rval cdef unsigned char* c = <unsigned char*>&rval c[0] = (l >> 56) & 255 c[1] = (l >> 48) & 255 c[2] = (l >> 40) & 255 c[3] = (l >> 32) & 255 c[4] = (l >> 24) & 255 c[5] = (l >> 16) & 255 c[6] = (l >> 8) & 255 c[7] = (l ) & 255 return rval

opened by dgleich 11

import sklearn in job crashes task

Hello,

I've found that just 'import sklearn' library in wc.py standard example generates such error:

Traceback (most recent call last):
  File "driver.py", line 15, in <module>
    hadoopy.launch(input_path, output_path, 'wc.py')
  File "/opt/anaconda/lib/python2.7/site-packages/hadoopy-0.6.0-py2.7-linux-            x86_64.egg/hadoopy/_runner.py", line 328, in launch
    raise subprocess.CalledProcessError(process.returncode, ' '.join(cmd))
subprocess.CalledProcessError: Command 'hadoop jar /usr/lib/hadoop-0.20-    mapreduce/contrib/streaming/hadoop-streaming.jar -output hadoopy-test-    data/1416578772.433620/wc-output -input hadoopy-test-data/1416578772.433620/wc-input -    mapper "python wc.py pipe map" -reducer "python wc.py pipe reduce" -combiner "python wc.py pipe     combine" -file wc.py -jobconf "mapred.job.name=wc" -io typedbytes -outputformat     org.apache.hadoop.mapred.SequenceFileOutputFormat -inputformat AutoInputFormat' returned     non-zero exit status 1

No matter we are using launch or launch_frozen. For example 'import of scipy' succeeds and no issues appears.

What might be a problem?

opened by AlexanderKUA 7

Issue with TypedBytesWritable class of Hadoop

I ran the wrodcount program as given in hadoopy tutorial, the output 'part-00000' was in SequecncefileFormat'. so i tried converting it into textfile by using

hadoop -text /path/to/part-00000

but instead, I got following error -

text: java.io.IOException: WritableName can't load class: org.apache.hadoop.typedbytes.TypedBytesWritable

How to get rid of this?

opened by shreelock 7
OOM killer on the Java process can cause the job may complete silently

I have noticed this bug occasionally and it is unacceptable. It will only happen if you don't have enough memory on your machine. Linux has an algorithm for killing tasks when the system is low on memory, if it picks the Java process for hadoop streaming (Hadoopy isn't responsible for it) it may complete without actually finishing the work with no perceptible error. I'm not sure which java process needs to be killed for this to occur. I'll look into this more and try to post a minimum example.

opened by bwhite 6

Permission Denied error triggered by Python subprocess

When trying to get the hadoopy wordcount test to work, I am running into a "OSError: [Errno 13] Permission denied" error during the Python subprocess. Since the subprocess is triggered by hadoopy/_main.c, my normal python debugging process (pdb) doesn't seem to work.

Any suggestions as to how to find out what file/directory hadoopy is trying to access (and as what user)?

I am able to run the Cloudera example grep job (standalone mode) and the hadoopy wordcount command line test, but the hadoopy python wordcount test fails.

Environment:

Ubuntu 10.04
Cloudera Hadoop Distribution CDH3 (stand-alone mode)

The Hadoop output with the Pemission Denied error is listed below.

rm playground/out/ -fr; python -c "import hadoopy; out = hadoopy.launch('playground/wc-input-alice.txt', 'playground/out/', 'wc.py')"
/\----------Hadoop Output----------/\
hadoopy: Running[hadoop jar /usr/lib/hadoop-0.20/contrib/streaming/hadoop-streaming-0.20.2-cdh3u2.jar -output playground/out/ -input playground/wc-input-alice.txt -mapper "python wc.py pipe map" -reducer "python wc.py pipe reduce" -file wc.py -jobconf mapred.job.name=wc -io typedbytes -outputformat org.apache.hadoop.mapred.SequenceFileOutputFormat -inputformat AutoInputFormat]
11/11/16 11:41:08 WARN streaming.StreamJob: -jobconf option is deprecated, please use -D instead.
packageJobJar: [wc.py] [] /tmp/streamjob2130356558435301069.jar tmpDir=null
11/11/16 11:41:08 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
11/11/16 11:41:08 INFO util.NativeCodeLoader: Loaded the native-hadoop library
11/11/16 11:41:09 INFO mapred.FileInputFormat: Total input paths to process : 1
11/11/16 11:41:09 WARN mapred.LocalJobRunner: LocalJobRunner does not support symlinking into current working dir.
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/.job.split.crc <- /app/hadoop/tmp/mapred/local/localRunner/.job.split.crc
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/job.split <- /app/hadoop/tmp/mapred/local/localRunner/job.split
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/job.jar <- /app/hadoop/tmp/mapred/local/localRunner/job.jar
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/.job.xml.crc <- /app/hadoop/tmp/mapred/local/localRunner/.job.xml.crc
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/.job.splitmetainfo.crc <- /app/hadoop/tmp/mapred/local/localRunner/.job.splitmetainfo.crc
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/job.xml <- /app/hadoop/tmp/mapred/local/localRunner/job.xml
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/.job.jar.crc <- /app/hadoop/tmp/mapred/local/localRunner/.job.jar.crc
11/11/16 11:41:09 INFO filecache.TrackerDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/staging/taericks-1131214868/.staging/job_local_0001/job.splitmetainfo <- /app/hadoop/tmp/mapred/local/localRunner/job.splitmetainfo
11/11/16 11:41:09 INFO streaming.StreamJob: getLocalDirs(): [/app/hadoop/tmp/mapred/local]
11/11/16 11:41:09 INFO streaming.StreamJob: Running job: job_local_0001
11/11/16 11:41:09 INFO streaming.StreamJob: Job running in-process (local Hadoop)
11/11/16 11:41:09 WARN snappy.LoadSnappy: Snappy native library is available
11/11/16 11:41:09 INFO snappy.LoadSnappy: Snappy native library loaded
11/11/16 11:41:09 INFO mapred.MapTask: numReduceTasks: 1
11/11/16 11:41:09 INFO mapred.MapTask: io.sort.mb = 100
11/11/16 11:41:09 INFO mapred.MapTask: data buffer = 79691776/99614720
11/11/16 11:41:09 INFO mapred.MapTask: record buffer = 262144/327680
11/11/16 11:41:09 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
11/11/16 11:41:09 INFO streaming.PipeMapRed: PipeMapRed exec [/home/terickson/.virtualenvs/hadoopy/bin/python, wc.py, pipe, map]
11/11/16 11:41:09 INFO streaming.PipeMapRed: R/W/S=1/0/0 in:NA [rec/s] out:NA [rec/s]
11/11/16 11:41:09 INFO streaming.PipeMapRed: R/W/S=10/0/0 in:NA [rec/s] out:NA [rec/s]
11/11/16 11:41:09 INFO streaming.PipeMapRed: R/W/S=100/0/0 in:NA [rec/s] out:NA [rec/s]
Traceback (most recent call last):
  File "wc.py", line 15, in <module>
    hadoopy.run(mapper, reducer, doc=__doc__)
  File "_main.pyx", line 445, in _main.run (hadoopy/_main.c:5554)
  File "/usr/lib/python2.6/subprocess.py", line 480, in call
    return Popen(*popenargs, **kwargs).wait()
  File "/usr/lib/python2.6/subprocess.py", line 633, in __init__
    errread, errwrite)
  File "/usr/lib/python2.6/subprocess.py", line 1138, in _execute_child
    raise child_exception
OSError: [Errno 13] Permission denied
11/11/16 11:41:09 INFO streaming.PipeMapRed: MRErrorThread done
11/11/16 11:41:09 INFO streaming.PipeMapRed: R/W/S=1000/0/0 in:NA [rec/s] out:NA [rec/s]
11/11/16 11:41:09 INFO streaming.PipeMapRed: log:null
R/W/S=2274/0/0 in:NA [rec/s] out:NA [rec/s]
minRecWrittenToEnableSkip_=9223372036854775807 LOGNAME=null
HOST=null
USER=taericks
HADOOP_USER=null
last Hadoop input: |null|
last tool output: |null|
Date: Wed Nov 16 11:41:09 PST 2011
java.io.IOException: Broken pipe
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:297)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
    at java.io.DataOutputStream.write(DataOutputStream.java:107)
    at org.apache.hadoop.io.WritableUtils.writeString(WritableUtils.java:100)
    at org.apache.hadoop.typedbytes.TypedBytesOutput.writeString(TypedBytesOutput.java:223)
    at org.apache.hadoop.typedbytes.TypedBytesWritableOutput.writeText(TypedBytesWritableOutput.java:182)
    at org.apache.hadoop.typedbytes.TypedBytesWritableOutput.write(TypedBytesWritableOutput.java:126)
    at org.apache.hadoop.streaming.io.TypedBytesInputWriter.writeTypedBytes(TypedBytesInputWriter.java:57)
    at org.apache.hadoop.streaming.io.TypedBytesInputWriter.writeValue(TypedBytesInputWriter.java:52)
    at org.apache.hadoop.streaming.PipeMapper.map(PipeMapper.java:110)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)


11/11/16 11:41:09 WARN streaming.PipeMapRed: java.io.IOException: Broken pipe
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:297)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
    at java.io.DataOutputStream.flush(DataOutputStream.java:123)
    at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:569)
    at org.apache.hadoop.streaming.PipeMapper.map(PipeMapper.java:125)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)

11/11/16 11:41:09 INFO streaming.PipeMapRed: mapRedFinished
11/11/16 11:41:09 WARN streaming.PipeMapRed: java.io.IOException: Stream Closed
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:297)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
    at java.io.DataOutputStream.flush(DataOutputStream.java:123)
    at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:569)
    at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:136)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)

11/11/16 11:41:09 INFO streaming.PipeMapRed: mapRedFinished
11/11/16 11:41:09 WARN mapred.LocalJobRunner: job_local_0001
java.io.IOException: log:null
R/W/S=2274/0/0 in:NA [rec/s] out:NA [rec/s]
minRecWrittenToEnableSkip_=9223372036854775807 LOGNAME=null
HOST=null
USER=taericks
HADOOP_USER=null
last Hadoop input: |null|
last tool output: |null|
Date: Wed Nov 16 11:41:09 PST 2011
java.io.IOException: Broken pipe
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:297)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
    at java.io.DataOutputStream.write(DataOutputStream.java:107)
    at org.apache.hadoop.io.WritableUtils.writeString(WritableUtils.java:100)
    at org.apache.hadoop.typedbytes.TypedBytesOutput.writeString(TypedBytesOutput.java:223)
    at org.apache.hadoop.typedbytes.TypedBytesWritableOutput.writeText(TypedBytesWritableOutput.java:182)
    at org.apache.hadoop.typedbytes.TypedBytesWritableOutput.write(TypedBytesWritableOutput.java:126)
    at org.apache.hadoop.streaming.io.TypedBytesInputWriter.writeTypedBytes(TypedBytesInputWriter.java:57)
    at org.apache.hadoop.streaming.io.TypedBytesInputWriter.writeValue(TypedBytesInputWriter.java:52)
    at org.apache.hadoop.streaming.PipeMapper.map(PipeMapper.java:110)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)


    at org.apache.hadoop.streaming.PipeMapper.map(PipeMapper.java:126)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
    at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
11/11/16 11:41:10 INFO streaming.StreamJob:  map 0%  reduce 0%
11/11/16 11:41:10 INFO streaming.StreamJob: Job running in-process (local Hadoop)
11/11/16 11:41:10 ERROR streaming.StreamJob: Job not successful. Error: NA
11/11/16 11:41:10 INFO streaming.StreamJob: killJob...
Streaming Command Failed!
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/terickson/.virtualenvs/hadoopy/lib/python2.6/site-packages/hadoopy/_runner.py", line 214, in launch
    raise subprocess.CalledProcessError(process.returncode, ' '.join(cmd))
subprocess.CalledProcessError: Command 'hadoop jar /usr/lib/hadoop-0.20/contrib/streaming/hadoop-streaming-0.20.2-cdh3u2.jar -output playground/out/ -input playground/wc-input-alice.txt -mapper "python wc.py pipe map" -reducer "python wc.py pipe reduce" -file wc.py -jobconf mapred.job.name=wc -io typedbytes -outputformat org.apache.hadoop.mapred.SequenceFileOutputFormat -inputformat AutoInputFormat' returned non-zero exit status 1

opened by tylere 5

Unicode encoding to ASCII error

When using unicode such as a = u'\xe9' str(a)

it will produce a unicode error. This same error occurs when the unicode is emitted because the default encoding is used to encode the string which is likely ascii. We could 1.) leave it and assume the string has been encoded in a proper way or 2.) force utf-8.

opened by bwhite 3
Testing for Unicode Support requires write access to hadoopy install

I use sudo python setup.py install, which causes a unicode test to fail. IOError: [Errno 13] Permission denied: '/usr/local/lib/python2.6/dist-packages/hadoopy/thirdparty/pyinstaller/support/useUnicode.py'

More context here: https://gist.github.com/800678

opened by amiller 3
Unrecognized option: -io

While running hadoopy with the current stable version of hadoop (hadoop-0.20.203.0rc1) the following error is triggered. What version of hadoop is hadoopy compatible with?

$ python -c "import hadoopy; out = hadoopy.launch('gutenberg/20417.txt.utf8', '/tmp/gutenberg/out/', 'wc.py')" /----------Hadoop Output----------/
hadoopy: Running[hadoop jar /usr/local/hadoop-0.20.203.0/contrib/streaming/hadoop-streaming-0.20.203.0.jar -output /tmp/gutenberg/out/ -input gutenberg/20417.txt.utf8 -mapper "python wc.py pipe map" -reducer "python wc.py pipe reduce" -combiner "python wc.py pipe combine" -file wc.py -jobconf mapred.job.name=wc -io typedbytes -outputformat org.apache.hadoop.mapred.SequenceFileOutputFormat -inputformat AutoInputFormat] log4j:ERROR Could not find value for key log4j.appender.NullAppender log4j:ERROR Could not instantiate appender named "NullAppender". 11/11/13 13:49:43 ERROR streaming.StreamJob: Unrecognized option: -io

opened by tylere 2
Find command needs the directory to search in to end with a / (slash)

On some systems the 'find' command requires the name of the directory to search to end with a / (slash), or the 'find' command will return nothing [1].

Relevant snippet from [1]

Note: On some systems, the name of the starting directory must end with a / (slash), or the find command will return nothing. Thus, the starting directory in the previous example would be designated as /prog/, with a trailing slash. On other systems, a trailing slash does not affect the command. A trailing slash is never needed when searching in / (the root directory), . (the current directory), or .. (the parent directory).

[1] https://kb.iu.edu/d/admm

opened by nikhilketkar 1
Cannot install hadoopy on Mac Os X mavericks
Hi,

When I try to install it on Mac OS X Mavericks , I get the following error

clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future]

Her's the complete message

sudo pip install -e git+https://github.com/bwhite/hadoopy#egg=hadoopy Obtaining hadoopy from git+https://github.com/bwhite/hadoopy#egg=hadoopy Cloning https://github.com/bwhite/hadoopy to ./src/hadoopy Running setup.py (path:/private/tmp/hadoopy/src/hadoopy/setup.py) egg_info for package hadoopy

Installing extra requirements: 'egg' Installing collected packages: hadoopy Running setup.py develop for hadoopy

building '_hadoopy_main' extension cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -mno-fused-madd -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c hadoopy/_main.c -o build/temp.macosx-10.9-intel-2.7/hadoopy/_main.o clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future] clang: note: this will be a hard error (cannot be downgraded to a warning) in the future error: command 'cc' failed with exit status 1 Complete output from command /usr/bin/python -c "import setuptools, tokenize; __file__='/private/tmp/hadoopy/src/hadoopy/setup.py'; exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" develop --no-deps: running develop

running egg_info

writing hadoopy.egg-info/PKG-INFO

writing top-level names to hadoopy.egg-info/top_level.txt

writing dependency_links to hadoopy.egg-info/dependency_links.txt

warning: manifest_maker: standard file '-c' not found

reading manifest file 'hadoopy.egg-info/SOURCES.txt'

writing manifest file 'hadoopy.egg-info/SOURCES.txt'

running build_ext

building '_hadoopy_main' extension

creating build

creating build/temp.macosx-10.9-intel-2.7

creating build/temp.macosx-10.9-intel-2.7/hadoopy

cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -mno-fused-madd -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c hadoopy/_main.c -o build/temp.macosx-10.9-intel-2.7/hadoopy/_main.o

clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future]

clang: note: this will be a hard error (cannot be downgraded to a warning) in the future

error: command 'cc' failed with exit status 1

Cleaning up... Command /usr/bin/python -c "import setuptools, tokenize; file='/private/tmp/hadoopy/src/hadoopy/setup.py'; exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" develop --no-deps failed with error code 1 in /private/tmp/hadoopy/src/hadoopy Storing debug log for failure in /Users/rajpalp/Library/Logs/pip.log

Please help debug this ..

Thanks, Raj
opened by rajpalparyani 1
Add flag to skip launch commands where inputs already exist

This capability was added to hadoopy_flow but would be useful in hadoopy also. The benefit is when developing large workflows, one often has to comment out large portions of code to start working on the current hot spot; however, this is sloppy and can easily be done automatically. One way is to set a global flag that skips all launch commands until the flag is unset.

opened by bwhite 1

IOError : writetb :Hadoop process returned[255]

when I try to write data to hdfs using "hadoopy.writetb",I got error below:

[sxiong@localhost codes]$ ls
sift.py  test2.py  test.py  uploadFilesAsSequence.py
[sxiong@localhost codes]$ python uploadFilesAsSequence.py 
Traceback (most recent call last):
  File "uploadFilesAsSequence.py", line 65, in <module>
    _write2(img_folder,sequenceHdfsPath)
  File "uploadFilesAsSequence.py", line 30, in _write2
    hadoopy.writetb(hdfs_uri,_read_local_dir(local_path))
  File "/home/sxiong/src/hadoopy/hadoopy/_hdfs.py", line 251, in writetb
    raise IOError('writetb: Hadoop process returned [%d]. Hadoop output below...\nstderr\n%s' % (p.returncode, p.stderr.read()))
IOError: writetb: Hadoop process returned [255]. Hadoop output below...
stderr
Not a valid JAR: /home/sxiong/dockerfiles/spark/codes/loadtb

opened by nettyxiong 0

Installation fails on windows

I have followed all the forums for the fix and none have worked, still getting the following error when I try to compile (on windows box)

C:\Python27\PC /Tchadoopy/getdelim.c /Fobuild\temp.win32-2.7\Release\hadoopy/get delim.obj getdelim.c c:\users\atrombley\hadoopy\hadoopy\getdelim.h(6) : error C2061: syntax error : i dentifier 'getdelim' c:\users\atrombley\hadoopy\hadoopy\getdelim.h(6) : error C2059: syntax error : ' ;' c:\users\atrombley\hadoopy\hadoopy\getdelim.h(6) : error C2059: syntax error : ' type' hadoopy/getdelim.c(53) : error C2061: syntax error : identifier 'getdelim' hadoopy/getdelim.c(53) : error C2059: syntax error : ';' hadoopy/getdelim.c(53) : error C2059: syntax error : 'type' error: command 'C:\Users\atrombley\AppData\Local\Programs\Common\Microsof t\Visual C++ for Python\9.0\VC\Bin\cl.exe' failed with exit status 2

opened by austintrombley 1
dus command added - gets the folder size

Added "-dus" command (gets the folder size) https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html#dus

opened by gsvic 0

Installation fails with python3

Currently, installing either from github, or from pip, fails with a TypeError

➤ sudo pip3 install -e git+https://github.com/bwhite/hadoopy#egg=hadoopy
Obtaining hadoopy from git+https://github.com/bwhite/hadoopy#egg=hadoopy
  Cloning https://github.com/bwhite/hadoopy to ./src/hadoopy
  Running setup.py (path:/home/nico/devel/workplace/feed-processing/src/hadoopy/setup.py) egg_info for package hadoopy
    Traceback (most recent call last):
      File "<string>", line 17, in <module>
      File "/home/nico/devel/workplace/feed-processing/src/hadoopy/setup.py", line 72, in <module>
        glibc_version = get_glibc_version()
      File "/home/nico/devel/workplace/feed-processing/src/hadoopy/setup.py", line 51, in get_glibc_version
        match = re.search('([0-9]+)\.([0-9]+)\.?[0-9]*', out)
      File "/usr/lib/python3.4/re.py", line 170, in search
        return _compile(pattern, flags).search(string)
    TypeError: can't use a string pattern on a bytes-like object
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):

  File "<string>", line 17, in <module>

  File "/home/nico/devel/workplace/feed-processing/src/hadoopy/setup.py", line 72, in <module>

    glibc_version = get_glibc_version()

  File "/home/nico/devel/workplace/feed-processing/src/hadoopy/setup.py", line 51, in get_glibc_version

    match = re.search('([0-9]+)\.([0-9]+)\.?[0-9]*', out)

  File "/usr/lib/python3.4/re.py", line 170, in search

    return _compile(pattern, flags).search(string)

TypeError: can't use a string pattern on a bytes-like object

----------------------------------------
Cleaning up...
Command python setup.py egg_info failed with error code 1 in /home/nico/devel/workplace/feed-processing/src/hadoopy
Storing debug log for failure in /home/nico/.pip/pip.log

opened by nicovillanueva 0

pip install hadoopy raised "Failed building wheel for hadoopy"

Hello,

$ pip install hadoopy
Collecting hadoopy
  Using cached hadoopy-0.5.0.tar.gz
Building wheels for collected packages: hadoopy
  Running setup.py bdist_wheel for hadoopy
  Complete output from command //anaconda/bin/python -c "import setuptools;__file__='/private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" bdist_wheel -d /var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/tmp4CxSZYpip-wheel-:
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-10.5-x86_64-2.7
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/_freeze.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/_hdfs.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/_reporter.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/_runner.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  copying hadoopy/_test.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty
  copying hadoopy/thirdparty/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty
  copying hadoopy/thirdparty/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/MANIFEST.in -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/__init__.py~ -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/bindepend.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/bindepend.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/build.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/build.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/compat.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/compat.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/compat.py~ -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/configure.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/configure.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/configure.py~ -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/depend
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/depend/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/depend
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/depend/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/depend
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/depend/dylib.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/depend
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/depend/dylib.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/depend
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/django-import-finder.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/enchant-datafiles-finder.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-_elementtree.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-_mysql.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-_sre.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-_sre.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-anydbm.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-babel.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-carchive.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cElementTree.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-codecs.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-codecs.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cPickle.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cPickle.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cStringIO.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cStringIO.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-cx_Oracle.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-DateTime.mxDateTime.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-DateTime.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-distutils.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.contrib.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.contrib.sessions.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.core.cache.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.core.mail.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.core.management.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.core.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.backends.mysql.base.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.backends.mysql.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.backends.oracle.base.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.backends.oracle.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.backends.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.db.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-django.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-dns.rdata.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-email.message.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-email.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-enchant.checker.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-enchant.checker.wxSpellCheckerDialog.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-enchant.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-encodings.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-encodings.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-gadfly.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-gtk.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-h5py.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-Image.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-Image.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-iu.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-iu.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-kinterbasdb.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-lxml.etree.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-lxml.objectify.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-mako.codegen.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-matplotlib.backends.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-matplotlib.numerix.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-matplotlib.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-OpenGL.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-os.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-os.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-parser.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-paste.exceptions.reporter.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PIL.Image.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PIL.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PIL.SpiderImagePlugin.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-psycopg2.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pyexpat.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pygame.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pygments.lexers.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pygments.styles.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pyodbc.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.phonon.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.Qt.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.Qt3Support.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtAssistant.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtCore.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtGui.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtNetwork.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtOpenGL.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtScript.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtSql.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtSvg.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtTest.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtWebKit.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.QtXml.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.Qwt5.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.uic.port_v2.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.uic.port_v3.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-PyQt4.uic.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pythoncom.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pywinauto.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pywinauto.tests.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-pywintypes.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-qt.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-regex.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-setuptools.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-SpiderImagePlugin.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-sqlalchemy.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-tables.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-time.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-time.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-vtkpython.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-win32com.client.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-win32com.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-win32ui.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-wx.lib.activex.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.domreg.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.ext.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.ext.reader.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.html.HTMLDocument.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.html.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.dom.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.etree.cElementTree.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.sax.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-xml.sax.saxexts.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hook-zmq.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/hookutils.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/shared_PIL_Image.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/hooks/shared_PIL_SpiderImagePlugin.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/hooks
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/__subprocess.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/compat.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/Dot.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/Graph.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/GraphAlgo.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/GraphStat.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/GraphUtil.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph/ObjectGraph.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/altgraph
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/_cmdline.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/_compat.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/dyld.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/dylib.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/framework.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/itergraphreport.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/mach_o.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/MachO.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/macho_dump.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/macho_find.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/macho_standalone.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/MachOGraph.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/MachOStandalone.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/ptypes.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/SymbolTable.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib/util.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib/macholib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/pefile.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/lib/six.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/lib
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/archive.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/archive.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/carchive.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/carchive.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/iu.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/loader/iu.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/loader
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/log.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/log.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/makespec.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/makespec.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/mf.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/mf.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/__init__.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/__init__.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/git.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/hg.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/icon.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/misc.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/svn.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/svn.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/versioninfo.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/winmanifest.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/winresource.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/winutils.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/PyInstaller/utils/winutils.pyc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/PyInstaller/utils
  copying hadoopy/thirdparty/pyinstaller/pyinstaller-gui.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/pyinstaller.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/README.txt -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  copying hadoopy/thirdparty/pyinstaller/setup.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  copying hadoopy/thirdparty/pyinstaller/source/common/launch.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  copying hadoopy/thirdparty/pyinstaller/source/common/launch.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  copying hadoopy/thirdparty/pyinstaller/source/common/main.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  copying hadoopy/thirdparty/pyinstaller/source/common/mkdtemp.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  copying hadoopy/thirdparty/pyinstaller/source/common/utils.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/common
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/crypto
  copying hadoopy/thirdparty/pyinstaller/source/crypto/AES.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/crypto
  copying hadoopy/thirdparty/pyinstaller/source/crypto/block_template.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/crypto
  copying hadoopy/thirdparty/pyinstaller/source/crypto/setup.cfg -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/crypto
  copying hadoopy/thirdparty/pyinstaller/source/crypto/setup.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/crypto
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-console.icns -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-console.ico -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-console.svg -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-windowed.icns -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-windowed.ico -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  copying hadoopy/thirdparty/pyinstaller/source/images/icon-windowed.svg -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/images
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/linux
  copying hadoopy/thirdparty/pyinstaller/source/linux/getpath.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/linux
  copying hadoopy/thirdparty/pyinstaller/source/linux/getpath.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/linux
  copying hadoopy/thirdparty/pyinstaller/source/linux/utils.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/linux
  copying hadoopy/thirdparty/pyinstaller/source/waf -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/dllmain.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/dllmain.def -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/manifest.xml -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/resource.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/run.rc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/runw.rc -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/windows/utils.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/windows
  copying hadoopy/thirdparty/pyinstaller/source/wscript -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/adler32.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/crc32.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/crc32.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/crypt.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inffast.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inffast.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inffixed.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inflate.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inflate.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inftrees.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/inftrees.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/ioapi.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/ioapi.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/README -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/unzip.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/unzip.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/zconf.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/zlib.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/zutil.c -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  copying hadoopy/thirdparty/pyinstaller/source/zlib/zutil.h -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/source/zlib
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  copying hadoopy/thirdparty/pyinstaller/support/_mountzlib.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  copying hadoopy/thirdparty/pyinstaller/support/_pyi_egg_install.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit/run -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit/run_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit/runw -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit/runw_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-32bit
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit/run -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit/run_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit/runw -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit/runw_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Darwin-64bit
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit/run -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit/run_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit/runw -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit/runw_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-32bit
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit/run -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit/run_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit/runw -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit
  copying hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit/runw_d -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/loader/Linux-64bit
  copying hadoopy/thirdparty/pyinstaller/support/removeTK.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_babel.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_django.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_Image.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_mpldata.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_opengl.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_PIL_Image.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/pyi_rth_qt4plugins.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/versioneddll.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks/win32comgenpy.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support/rthooks
  copying hadoopy/thirdparty/pyinstaller/support/rthooks.dat -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  copying hadoopy/thirdparty/pyinstaller/support/unpackTK.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/support
  creating build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/ArchiveViewer.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/BinDepend.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/Build.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/Configure.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/Crypt.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/GrabVersion.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/MakeComServer.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/pyinstaller/utils/Makespec.py -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty/pyinstaller/utils
  copying hadoopy/thirdparty/README.txt -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty
  copying hadoopy/thirdparty/README.txt~ -> build/lib.macosx-10.5-x86_64-2.7/hadoopy/thirdparty
  running build_ext
  cythoning hadoopy/_main.pyx to hadoopy/_main.c
  error: [Errno 2] No such file or directory: '/private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy/hadoopy/_main.pyx'

  ----------------------------------------
  Failed building wheel for hadoopy
Failed to build hadoopy
Installing collected packages: hadoopy
  Running setup.py install for hadoopy
    Complete output from command //anaconda/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-0SRRxK-record/install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    running build_ext
    cythoning hadoopy/_main.pyx to hadoopy/_main.c
    error: [Errno 2] No such file or directory: '/private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy/hadoopy/_main.pyx'

    ----------------------------------------
Command "//anaconda/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-0SRRxK-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/j_/v8b1bst93_94t724ptsswfsr0000gn/T/pip-build-4w0ZPb/hadoopy

I've found a workaround

pc:others scls$ sudo pip install git+git://github.com/bwhite/hadoopy.git
Password:
The directory '/Users/scls/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/Users/scls/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Collecting git+git://github.com/bwhite/hadoopy.git
  Cloning git://github.com/bwhite/hadoopy.git to /tmp/pip-8_dpAc-build
Installing collected packages: hadoopy
  Running setup.py install for hadoopy
Successfully installed hadoopy-0.6.0

I wonder if pip package shouldn't be updated.

Kind regards

opened by scls19fr 0

Python MapReduce library written in Cython.

Related tags

Overview

Comments

Owner

Brandyn White

Msgpack serialization/deserialization library for Python, written in Rust using PyO3 and rust-msgpack. Reboot of orjson. msgpack.org[Python]

Retrying is an Apache 2.0 licensed general-purpose retrying library, written in Python, to simplify the task of adding retry behavior to just about anything.

An Advanced Wordlist Library Written In Python For Acm114

PyDy, short for Python Dynamics, is a tool kit written in the Python

Synthetik Python Mod - A save editor tool for the game Synthetik written in python

JLC2KICAD_lib is a python script that generate a component library for KiCad from the JLCPCB/easyEDA library.

K2HASH Python library - NoSQL Key Value Store(KVS) library

MiniJVM is simple java virtual machine written by python language, it can load class file from file system and run it.

Pygments is a generic syntax highlighter written in Python

A full-featured, hackable tiling window manager written and configured in Python

This is the code of Python enthusiasts collection and written.

Reactjs web app written entirely in python, using transcrypt compiler.

Grail(TM) is a web browser written in Python

A simple 3D rigid body simulation written in python

pyRTOS is a real-time operating system (RTOS), written in Python.

This script is written with Python for selling steam community items automatically.

pyForgeCert is a Python equivalent of the original ForgeCert written in C#.

Experimental Brawl Stars v36.218 server emulator written in Python.

A topology optimization framework written in Taichi programming language, which is embedded in Python.