Hi Jordan!

I have been experimenting with your tool - great concept and I can certainly see a lot of great uses for this.

I am planning to write an article about it on my webpage if that is something you would be okay with? You can see the content I write here: https://os2int.com/toolbox

I have encountered some issues when using the tool. When I deployed forwards.py, no net.csv file is created. The edgelist populates quite nicely. Would you be able to clarify whether this is a bug on my side or whether I have missed something out?

Added a functionality to list all users who replied to messages in chats, useful if you want to track who interact with message in channels. It also dump replies of channel messages as your future plan.

• Done some refactoring.
• Updated some libraries
• Added .gitignore to avoid to push sessions..

TODO

• mapping reaction in groups, tracking who placed some reactions.
• add a flag to enable/disable the previous features

Hey Jordan,

Have been still trying to get this running locally. I've tried 3 times starting from scratch and re-cloning and setting up the repo but I consistently get errors when trying to scrape forwarded messages and would love your help figuring out what I am doing wrong.

OS X 11.6.1 + Python 3.9.10

~/Desktop
➜  git clone https://github.com/jordanwildon/Telepathy.git
Cloning into 'Telepathy'...
remote: Enumerating objects: 151, done.
remote: Counting objects: 100% (151/151), done.
remote: Compressing objects: 100% (148/148), done.
remote: Total 151 (delta 86), reused 0 (delta 0), pack-reused 0
Receiving objects: 100% (151/151), 43.00 KiB | 3.58 MiB/s, done.
Resolving deltas: 100% (86/86), done.

~/Desktop
➜  cd Telepathy/

~/Desktop/Telepathy  main via 🐍 v3.9.10
➜  vim requirements.txt                                                                      [git:main] ✔

~/Desktop/Telepathy  main [!] via 🐍 v3.9.10 // 29s
➜  pip install -r requirements.txt                                                          [git:main] ✖
Requirement already satisfied: pandas==1.3.4 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from -r requirements.txt (line 1)) (1.3.4)
Collecting Telethon==1.24.0
  Using cached Telethon-1.24.0-py3-none-any.whl (528 kB)
Requirement already satisfied: pytz>=2017.3 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from pandas==1.3.4->-r requirements.txt (line 1)) (2021.3)
Requirement already satisfied: numpy>=1.17.3 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from pandas==1.3.4->-r requirements.txt (line 1)) (1.22.2)
Requirement already satisfied: python-dateutil>=2.7.3 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from pandas==1.3.4->-r requirements.txt (line 1)) (2.8.2)
Requirement already satisfied: rsa in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from Telethon==1.24.0->-r requirements.txt (line 2)) (4.8)
Requirement already satisfied: pyaes in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from Telethon==1.24.0->-r requirements.txt (line 2)) (1.6.1)
Requirement already satisfied: six>=1.5 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from python-dateutil>=2.7.3->pandas==1.3.4->-r requirements.txt (line 1)) (1.16.0)
Requirement already satisfied: pyasn1>=0.1.3 in /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages (from rsa->Telethon==1.24.0->-r requirements.txt (line 2)) (0.4.8)
Installing collected packages: Telethon
  Attempting uninstall: Telethon
    Found existing installation: Telethon 1.21.1
    Uninstalling Telethon-1.21.1:
      Successfully uninstalled Telethon-1.21.1
Successfully installed Telethon-1.24.0

~/Desktop/Telepathy  main [!] via 🐍 v3.9.10
➜  python3 setup.py                                                                         [git:main] ✖
Welcome to the Telepathy setup.
This file wil save your Telegram login information to allow API access.
Follow the README instructions to get your credentials.
Please enter your API ID:
******
You entered "******"
Is this correct? (y/n)y
Updating...
Please enter your API Hash:
******
You entered "******"
Is this correct? (y/n)y
Updating...
Please enter your phone number:
+******
You entered "+******"
Is this correct? (y/n)y
Updating...
Setup is complete.
Telepathy is now ready and can be used. You may now close the terminal.

~/Desktop/Telepathy  main [!?] via 🐍 v3.9.10 // 55s
➜  python3 telepathy.py                                                                     [git:main] ✖
Welcome to Telepathy
Please select a function:
1. Batch chat archiver
2. Archive within a timeframe
3. Scrape group members
4. Scrape forwarded messages in a chat
5. Lookup a user ID

Pick a number:4
Loading Scrape forwarded messages in a chat ...
Launching channel forward scraper...
Enter the code: ******
Welcome to channel forward scraper.
This tool will scrape a Telegram channel for all forwarded messages and their original sources.
Do you want to print forwards to terminal while Telepathy runs? (y/n)y
Please enter a Telegram channel name:
convoytodc22
You entered "convoytodc22"
Is this correct? (y/n)y
Scraping forwards from convoytodc22 This may take a while...
Traceback (most recent call last):
  File "<string>", line 53, in main
NameError: name 'get_display_name' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/ejfox/Desktop/Telepathy/telepathy.py", line 49, in <module>
    exec(open("forwards.py").read())
  File "<string>", line 97, in <module>
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete
    return future.result()
  File "<string>", line 91, in main
NameError: name 'user_selection_media' is not defined

I tried to use a more recent version of Telethon by updating requirements.txt so that Telethon==1.24.0 but I still get the same error. Any help deeply appreciated!

Hi,

Can you help me please.

So I provide the following: APP api id APP api Hash Mobile number and then the mobile token.

I then provided the following test command: telepathy -t durov

I then received the following: The API access for bot users is restricted. The method you tried cannot be executed as a bot (caused by GetHistoryRequest)

any advice would be grateful

Hi,

thanks for developing this nice tool =)

In the upcoming changes you want to implement the ability to scrape comments in channel posts:

Giving the archiver module the ability to archive comments on channel posts.

This would be a nice feature; do you have an idea when it is ready?

telepathy -t ***** -c

      ______     __                 __  __
     /_  __/__  / /__  ____  ____ _/ /_/ /_  __  __
      / / / _ \/ / _ \/ __ \/ __ `/ __/ __ \/ / / /
     / / /  __/ /  __/ /_/ / /_/ / /_/ / / / /_/ /
    /_/  \___/_/\___/ .___/\__,_/\__/_/ /_/\__, /
                   /_/                    /____/
    -- An OSINT toolkit for investigating Telegram chats.
    -- Developed by @jordanwildon | Version 2.2.62.

[!] Performing comprehensive scan [-] Fetching details for *****... Traceback (most recent call last): File "C:\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Python310\lib\runpy.py", line 86, in run_code exec(code, run_globals) File "C:\Python310\Scripts\telepathy.exe_main.py", line 7, in File "C:\Python310\lib\site-packages\click\core.py", line 829, in call return self.main(*args, **kwargs) File "C:\Python310\lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) File "C:\Python310\lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "C:\Python310\lib\site-packages\click\core.py", line 610, in invoke return callback(*args, **kwargs) File "C:\Python310\lib\site-packages\telepathy\telepathy.py", line 1759, in cli client.loop.run_until_complete(main()) File "C:\Python310\lib\asyncio\base_events.py", line 646, in run_until_complete return future.result() File "C:\Python310\lib\site-packages\telepathy\telepathy.py", line 407, in main name = entity.title AttributeError: 'User' object has no attribute 'title'

csi@csi:~/Desktop/OSINT$ git clone https://github.com/jordanwildon/Telepathy.git Cloning into 'Telepathy'... fatal: unable to access 'https://github.com/jordanwildon/Telepathy.git/': server certificate verification failed. CAfile: none CRLfile: none

can you help?

Great idea but I ran your app 2x and it ran successfully, except it did not grab user list and my entire account is gone. All saved messages, all my chats gone.

I was hunting pedophiles and there was private chats that are now just gone. Absolutely no way for me to restore months of data.

I do not even know what to say at this point........

Traceback (most recent call last): File "/data/data/com.termux/files/home/Telepathy/telepathy.py", line 45, in exec(open("members.py").read()) File "", line 32, in File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/telethon/sync.py", line 39, in syncified return loop.run_until_complete(coro) File "/data/data/com.termux/files/usr/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete return future.result() File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/telethon/client/auth.py", line 368, in sign_in result = await self(request) File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/telethon/client/users.py", line 30, in call return await self._call(self._sender, request, ordered=ordered) File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/telethon/client/users.py", line 79, in _call result = await future telethon.errors.rpcbaseerrors.AuthKeyError: RPCError 406: UPDATE_APP_TO_LOGIN (caused by SignInRequest) Segmentation fault

Please advise how to correct this error

Hello,

I want to report another issue.

First, I scraped all forwards from a channel. That worked flawlessly. There were some expectations, but that was displayed transparently. Then, I tried to scrape all forwards from that forwards. For a while, it worked. At some point, this occured:

Traceback (most recent call last): File "telepathy.py", line 39, in <module> exec(open("archiver.py").read()) File "<string>", line 164, in <module> File "<string>", line 48, in <module> File "<string>", line 166, in <module> File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "<string>", line 114, in new_main File "/home/osint/.local/lib/python3.8/site-packages/telethon/requestiter.py", line 58, in __anext__ if await self._init(**self.kwargs): File "/home/osint/.local/lib/python3.8/site-packages/telethon/client/messages.py", line 26, in _init self.entity = await self.client.get_input_entity(entity) File "/home/osint/.local/lib/python3.8/site-packages/telethon/client/users.py", line 432, in get_input_entity await self._get_entity_from_string(peer)) File "/home/osint/.local/lib/python3.8/site-packages/telethon/client/users.py", line 569, in _get_entity_from_string raise ValueError( ValueError: Cannot find any entity corresponding to "Alternative History 2039"

After that, the scrape stopped. In the generated net.csv are all channels wich were scraped to this point.

Is there a solution?

Thanks in advance,

Best wishes!

Love the suite of tools here, having just come from a role that featured quite a few investigations of Telegram. The scripts seem easy to use, but I bet they could be made even easier with a basically CLI around everything. I didn't see a contributing.md in the repo, so I figured I would ask here: would you be interested in me adding a click CLI wrapper around this? I haven't spec'd anything out, and I'm happy to do so - from what I see, I think it could be done in a weekend project.

Hi guys,

I have installed Telepathy, and it worked the first time. But now every time I wanna use it, Ill get this error:

Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in run_code File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Scripts\telepathy.exe_main.py", line 7, in File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 829, in call return self.main(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 610, in invoke return callback(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\telepathy\telepathy.py", line 226, in cli client = TelegramClient(phone_number, api_id, api_hash) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\telethon\client\telegrambaseclient.py", line 275, in init session = SQLiteSession(session) ^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\telethon\sessions\sqlite.py", line 47, in init c = self._cursor() ^^^^^^^^^^^^^^ File "C:\Users\alien\AppData\Local\Programs\Python\Python311\Lib\site-packages\telethon\sessions\sqlite.py", line 242, in _cursor self._conn = sqlite3.connect(self.filename, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ sqlite3.OperationalError: unable to open database file

Does anyone know why? I am a journalist and have very limited knowledge of Python. I'd be grateful if someone could help me.

Hello. It would be great if there would be a detailed installation guide regarding both ways of installation - via pip or from source from step to step to everyone maybe?

Anyway, I have this issue after installing via pip3:
Traceback (most recent call last):
  File "/usr/local/bin/telepathy", line 11, in <module>
    load_entry_point('telepathy==2.3.2', 'console_scripts', 'telepathy')()
  File "/home/andrejki/.local/lib/python3.8/site-packages/pkg_resources/__init__.py", line 486, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/home/andrejki/.local/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2867, in load_entry_point
    return ep.load()
  File "/home/andrejki/.local/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2471, in load
    return self.resolve()
  File "/home/andrejki/.local/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2477, in resolve
    module = __import__(self.module_name, fromlist=['__name__'], level=0)
ModuleNotFoundError: No module named 'telepathy'

The solution described somewhere to install python panda library, but that was already solved.

I tried to install it from the source and holly cow, I just can t figure it out. I did python3 setup.py build and later python3 setup.py install and basically nothing changed, I haven t figured it out to work. How to fix my issues and how to do the installation properly from step 1 to last step? I am not that a newbie, but for this tool installation I am a newbie.

Best regards

I tried unsuccessfully targeting group chat ID. Currently script works for channels, but not for groups it seem. Is it possible to add support to archive and analyse Group Chats?

telepathy -t ***** -c

  ______     __                 __  __
 /_  __/__  / /__  ____  ____ _/ /_/ /_  __  __
  / / / _ \/ / _ \/ __ \/ __ `/ __/ __ \/ / / /
 / / /  __/ /  __/ /_/ / /_/ / /_/ / / / /_/ /
/_/  \___/_/\___/ .___/\__,_/\__/_/ /_/\__, /
               /_/                    /____/
-- An OSINT toolkit for investigating Telegram chats.
-- Developed by @jordanwildon | Version 2.2.62.

[!] Performing comprehensive scan [-] Fetching details for *****... Traceback (most recent call last): File "C:\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Python310\lib\runpy.py", line 86, in run_code exec(code, run_globals) File "C:\Python310\Scripts\telepathy.exe_main.py", line 7, in File "C:\Python310\lib\site-packages\click\core.py", line 829, in call return self.main(*args, **kwargs) File "C:\Python310\lib\site-packages\click\core.py", line 782, in main rv = self.invoke(ctx) File "C:\Python310\lib\site-packages\click\core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "C:\Python310\lib\site-packages\click\core.py", line 610, in invoke return callback(*args, **kwargs) File "C:\Python310\lib\site-packages\telepathy\telepathy.py", line 1759, in cli client.loop.run_until_complete(main()) File "C:\Python310\lib\asyncio\base_events.py", line 646, in run_until_complete return future.result() File "C:\Python310\lib\site-packages\telepathy\telepathy.py", line 407, in main name = entity.title AttributeError: 'User' object has no attribute 'title'