Inject code into running Python processes

When injecting the reverse_python_shell.py payload on an Ubuntu 11.10 system (after doing the echo 0 to ptrace_scope), the process I am connecting to (a python interpreter sitting at the shell) shows the following error:

[Errno 111] Connection refused

No error is reported from the pyrasite process. Tests with the hello_world.py payload work, though.

(pyrasite)threebean@marat ~/devel/pyrasite (git:develop:0)
 % python setup.py develop
running develop
running egg_info
writing requirements to pyrasite.egg-info/requires.txt
writing pyrasite.egg-info/PKG-INFO
writing top-level names to pyrasite.egg-info/top_level.txt
writing dependency_links to pyrasite.egg-info/dependency_links.txt
writing entry points to pyrasite.egg-info/entry_points.txt
reading manifest file 'pyrasite.egg-info/SOURCES.txt'
writing manifest file 'pyrasite.egg-info/SOURCES.txt'
running build_ext
Creating /home/threebean/.virtualenvs/pyrasite/lib/python2.7/site-packages/pyrasite.egg-link (link to .)
pyrasite 1.1 is already the active version in easy-install.pth
Installing pyrasite-gui script to /home/threebean/.virtualenvs/pyrasite/bin
Installing pyrasite-memory-viewer script to /home/threebean/.virtualenvs/pyrasite/bin
Installing pyrasite script to /home/threebean/.virtualenvs/pyrasite/bin

Installed /home/threebean/devel/pyrasite
Processing dependencies for pyrasite==1.1
Searching for meliae
Reading http://pypi.python.org/simple/meliae/
Reading https://launchpad.net/meliae
Reading https://launchpad.net/meliae/+download
Best match: meliae 0.4.0
Downloading http://launchpad.net/meliae/trunk/0.4/+download/meliae-0.4.0.tar.gz
Processing meliae-0.4.0.tar.gz
Running meliae-0.4.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-IuIszE/meliae-0.4.0/egg-dist-tmp-9LFMD7
We require Cython to be installed.
No eggs found in /tmp/easy_install-IuIszE/meliae-0.4.0/egg-dist-tmp-9LFMD7 (setup script problem?)
error: Could not find required distribution meliae

With a hardcoded 5-second timeout, it's impossible to run commands with pyrasite-shell that take more than 5 seconds. I was bitten by this recently when trying to get heap dumps from a large process, but it can be reproduced easily with time.sleep:

$ pyrasite-shell 11166
Pyrasite Shell 2.0
Connected to 'python'
Python 2.7.6 (default, Jun 22 2015, 17:58:13) 
[GCC 4.8.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
(DistantInteractiveConsole)

>>> import time
>>> time.sleep(10)

Traceback (most recent call last):
  File "/home/jakeschmidt/pyrasite/env/bin/pyrasite-shell", line 9, in <module>
    load_entry_point('pyrasite==2.0', 'console_scripts', 'pyrasite-shell')()
  File "/home/jakeschmidt/pyrasite/env/local/lib/python2.7/site-packages/pyrasite-2.0-py2.7.egg/pyrasite/tools/shell.py", line 70, in shell
    payload = ipc.recv()
  File "/home/jakeschmidt/pyrasite/env/local/lib/python2.7/site-packages/pyrasite-2.0-py2.7.egg/pyrasite/ipc.py", line 190, in recv
    header_data = self.recv_bytes(4)
  File "/home/jakeschmidt/pyrasite/env/local/lib/python2.7/site-packages/pyrasite-2.0-py2.7.egg/pyrasite/ipc.py", line 203, in recv_bytes
    chunk = self.sock.recv(n - len(data))
socket.timeout: timed out

Hey Luke/Pyrasite crew, I'm trying to attach a shell to a twisted process, and all i'm getting is a hung shell. So I SIGINT and rerun with a --verbose, like: pyrasite --verbose 14129 dump_modules.py and I see:

[Thread debugging using libthread_db enabled]
[New Thread 0x7fd91ed28700 (LWP 15516)]
[New Thread 0x7fd91f529700 (LWP 15515)]
[New Thread 0x7fd91fd2a700 (LWP 15514)]
[New Thread 0x7fd924a8b700 (LWP 14332)]
[New Thread 0x7fd92528c700 (LWP 14133)]
[New Thread 0x7fd925a8d700 (LWP 14130)]
0x00007fd92a82a163 in epoll_wait () from /lib/libc.so.6
$1 = PyGILState_UNLOCKED
$2 = 0


warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff075fe000

Waiting at an epoll, as one would expect from a Twisted process running on Debian:

# uname -a
Linux graybles 2.6.32-042stab079.6 #1 SMP Mon Aug 26 19:47:50 MSK 2013 x86_64 GNU/Linux

Also, I'm using the pip-installable versions of all relevant libraries. Let me know if there's anything else I can provide. And of course, thanks for making pyrasite as it is very awesome. :)

I installed in archlinux using the PKGBUILD in the pkgs/arch folder. If I run pyrasite-gui, the gui freezes when I click in any program on the left list. Basically the same thing happens if I run using pyrasite-shell - I get no output at all and I've to kill the process. Using just pyrasite nothing happens.

I cloned master, easy_install'ed it into ~/py-lib, tried pyrasite-memory-viewer somepid and got this:

ImportError: No module named urwid

After easy_installing urwid I re-ran that command and got

Traceback (most recent call last):
  File "/home/mg/bin/pyrasite-memory-viewer", line 9, in <module>
    load_entry_point('pyrasite==2.0beta9', 'console_scripts', 'pyrasite-memory-viewer')()
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 305, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2245, in load_entry_point
    return ep.load()
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 1955, in load
    entry = __import__(self.module_name, globals(),globals(), ['__name__'])
  File "/home/mg/py-lib/pyrasite-2.0beta9-py2.7.egg/pyrasite/tools/memory_viewer.py", line 34, in <module>
    from pyrasite.inspect import ObjectInspector
ImportError: No module named inspect

Hi pyrasite can inject some code anywhere?
like Btrace (https://kenai.com/projects/btrace/pages/UserGuide) for example , I have a function like:

     def index(request):
         for k,v in request.iteritems():
              #inject code there, like: import pdb;pdb.set_trace()
              print(k,v)

when debug done, remove injected code.

Tks

(g)dreampuf@HX:~/hub/fortest/hello$ pyrasite-shell 35548
^CTraceback (most recent call last):
  File "/Users/dreampuf/.virtualenvs/g/bin/pyrasite-shell", line 8, in <module>
    load_entry_point('pyrasite==2.0', 'console_scripts', 'pyrasite-shell')()
  File "/Users/dreampuf/.virtualenvs/g/lib/python2.7/site-packages/pyrasite/tools/shell.py", line 30, in shell
    ipc.connect()
  File "/Users/dreampuf/.virtualenvs/g/lib/python2.7/site-packages/pyrasite/ipc.py", line 95, in connect
    self.wait()
  File "/Users/dreampuf/.virtualenvs/g/lib/python2.7/site-packages/pyrasite/ipc.py", line 151, in wait
    (clientsocket, address) = self.server_sock.accept()
  File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 202, in accept
    sock, addr = self._sock.accept()
KeyboardInterrupt

Did I need the special code insert the remote process? or other version of gdb (I could not find the version 7.2 on homebrew)

(g)dreampuf@HX:~/hub/fortest/hello$ gdb --version
GNU gdb 6.3.50-20050815 (Apple version gdb-1824) (Thu Nov 15 10:42:43 UTC 2012)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "x86_64-apple-darwin".

======================================================================
FAIL: test_multithreaded_injection (tests.test_code_injection.TestCodeInjection)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/lmacken/code/github.com/pyrasite/tests/test_code_injection.py", line 50, in test_multithreaded_injection
    "Multi-threaded code injection failed"
AssertionError: AssertionError: Multi-threaded code injection failed
-------------------- >> begin captured stdout << ---------------------
b'[Thread debugging using libthread_db enabled]\nUsing host libthread_db library "/lib64/libthread_db.so.1".\nPyEval_EvalF
rameEx (f=<optimized out>, throwflag=<optimized out>) at /usr/src/debug/Python-2.7.2/Python/ceval.c:2966\n2966\t
  while (STACK_LEVEL() > b->b_level) {\n$1 = PyGILState_LOCKED\n$2 = -1\n'

As discussed in IRC it would be desirable to have output from the injected python commands to be piped back and printed out on the local terminal. This commit is an attempt at adding that functionality into the pyrasite executable (main.py).

Successful Travis CI run: http://travis-ci.org/#!/msabramo/pyrasite/jobs/1690081

To set up Travis CI for your own repo, see http://about.travis-ci.org/docs/user/getting-started/

Output of tox:

marca@ubuntu:~/dev/git-repos/pyrasite$ sudo tox 2>&1 | tee tox.out
...
___________________________________ summary ____________________________________
  py26: commands succeeded
  py27: commands succeeded
  congratulations :)

when i execute the command in this docker images docker pull yumoshangguan/centos7.7.1908-gcc8.3.0-python3.6-qt5.14.0:v0.0.03-debug-for-python3

pip3 install pyrasite

it can be installed successfully, but i cannot find the pyrasite, pyrasite-shell, pyrasite-memroy-viewer in /usr/bin, so i cannot execute the command pyrasite or pyrasite-shell ...

not all images occur the problem

(new_sdk) [root@host-01 test]# ps -aux|grep 19373
USER        PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
xxxx      19373 61.3 12.9 22286416 17040500 ?   Sl   06:03 441:10 /opt/.pyenv/versions/new_sdk/bin/python controller.py

(new_sdk) [root@host-01 test]# pyrasite-memory-viewer 19373
loaded line 13598, 13599 objs,   1.6 /   1.6 MiB read in 0.2s        
Traceback (most recent call last):sed        0    
  File "/opt/.pyenv/versions/new_sdk/bin/pyrasite-memory-viewer", line 11, in <module>
    load_entry_point('pyrasite==2.0', 'console_scripts', 'pyrasite-memory-viewer')()
  File "/opt/.pyenv/versions/new_sdk/lib/python3.6/site-packages/pyrasite/tools/memory_viewer.py", line 150, in main
    objects = loader.load(filename)
  File "/opt/.pyenv/versions/new_sdk/lib/python3.6/site-packages/meliae/loader.py", line 562, in load
    if not manager.collapse_instance_dicts():
  File "/opt/.pyenv/versions/new_sdk/lib/python3.6/site-packages/meliae/loader.py", line 432, in collapse_instance_dicts
    obj_1, obj_2 = obj
  File "meliae/_loader.pyx", line 481, in meliae._loader._MemObjectProxy.__getitem__
  File "meliae/_loader.pyx", line 477, in meliae._loader._MemObjectProxy.__getitem__
  File "meliae/_loader.pyx", line 767, in meliae._loader.MemObjectCollection.__getitem__
KeyError: 'address 139644515901800 not present'

There is a small typo in pyrasite/tools/memory_viewer.py.

Should read output rather than outpu.

Semi-automated pull request generated by https://github.com/timgates42/meticulous/blob/master/docs/NOTE.md

I tried writing a very simple Python program (using Ubuntu, Python 2.7) and I can apply pyrasite-shell without problem on it. However, when I use pyinstaller (with the -F option for simple file) and then try to apply pyrasite-shell on that process, this produces a segmentation fault - it looks like a GIL issue. Is there any way around this?

Using $pyrasite-shell <PID> in python 3 causes the running process(<PID>) to face a segmentation fault. The only exception is when both the running process andpyrasite-shell are executed with sudo. Any solutions or workaround?