Hey Hello @sanjit-sinha , i am @AvAkanksh I just wanted to know how you got the idea to write a web scrapping code all by your self. I understood your code, but i wonder how you got to know which parameters are required to make the prefect request. can you please explain the methodology behind it. i know that authentication code is required i got that by checking out the network response. But i am not sure how you came up with the page_token and page_index, so can you please please please please please explain how you got to know they needed to be present.

Thank you in advance.

Also i would like to have conversation in private about other stuff related to web scrapping and other stuff if you have the time to spare. Thank you.

you can also make some modifications to the code so we can directly get the download link of the content present which are there in the subfolders too. That would be too helpful to others .

Thank you once again.

Edited:

I have understood how u got to know why u have used page_token and page_index i have checked the networks tab and checked the post tab so i found the required data to make the post. but i still don't understand how you got the idea to reverse the string and then decode it using the base64. If you just say that it would be helpful for me in future.

Thank you

There is a issue or maybe not but the script doesn't work for one index that i tested this index have username and password field when i want to enter the website but it doesent have any username and password i leave usename and password empty just click signin and it go to the website how to scrape such a index? The script returns user/password combination wrong.