I am getting an exception when I try to process_page on the following PDF: https://www.docketalarm.com/cases/PTAB/IPR2014-00396/Inter_Partes_Review_of_U.S._Pat._7310111/docs/02-20-2014-POR-1773/Power_of_Attorney-5-Power_of_Attorney.pdf

The PDF is digitally signed and I bet that has something to do with it. I don't understand digital signatures or this code well enough to debug it. If you can spot the issue quickly, that would be great.

Stack trace:

 File "..\libs\pdfminer\pdfinterp.py", line 757, in process_page
    self.render_contents(page.resources, page.contents, ctm=ctm)
  File "..\libs\pdfminer\pdfinterp.py", line 770, in render_contents
    self.execute(list_value(streams))
  File "..\libs\pdfminer\pdfinterp.py", line 795, in execute
    func(*args)
  File "..\libs\pdfminer\pdfinterp.py", line 733, in do_Do
    interpreter.render_contents(resources, [xobj], ctm=mult_matrix(matrix, self.ctm))
  File "..\libs\pdfminer\pdfinterp.py", line 768, in render_contents
    self.init_resources(resources)
  File "..\libs\pdfminer\pdfinterp.py", line 339, in init_resources
    self.fontmap[fontid] = self.rsrcmgr.get_font(objid, spec)
  File "..\libs\pdfminer\pdfinterp.py", line 193, in get_font
    font = self.get_font(None, subspec)
  File "..\libs\pdfminer\pdfinterp.py", line 184, in get_font
    font = PDFCIDFont(self, spec)
  File "..\libs\pdfminer\pdffont.py", line 637, in __init__
    CMapParser(self.unicode_map, StringIO(strm.get_data())).run()
  File "..\libs\pdfminer\cmapdb.py", line 292, in run
    self.nextobject()
  File "..\libs\pdfminer\psparser.py", line 584, in nextobject
    self.do_keyword(pos, token)
  File "..\libs\pdfminer\cmapdb.py", line 354, in do_keyword
    self.cmap.add_code2cid(x, cid+i)
AttributeError: 'FileUnicodeMap' object has no attribute 'add_code2cid'

It would be great if this included a license file. According to the MIT license terms, one is suppose to include the license file with the software. However, it is a bit challenging to do that without actually having the license file somewhere. Is it possible we could add it to this repo?

cc @pmlandwehr

Dear sir: I use pdf2txt to get the txt of the pdf file,but it only get some parts of the txt. I don't know how to solve this problem.Could you please give me some advise. Thanks a lot.

Is it possible to just retrieve all the text on the page with each fragment returned with its bounding box, i.e., (x1, y1, x2, y2, text) -- with no layout analysis? Use case: this would be ideal for people who want to do their own layout analysis.

Please check these following files to see the bug. PDF: https://www.dropbox.com/s/arpkkzvi9e7evfc/Untitleddocument2.pdf text: https://www.dropbox.com/s/g4jq9t7taahdgce/googledocs2.txt I used command: pdf2txt.py Untitleddocument2.pdf > googledocs2.txt to convert pdf document (generated by Google Docs service) and the output is the text file which shows bad content.

from pdfminer.pdfinterp import PDFResourceManager, process_pdf Traceback (most recent call last): File "", line 1, in ImportError: cannot import name process_pdf

This worked in the version prior to the one uploaded on 2013-11-13

This repo has been idle for more than a year, despite many community members' interest.

If you're not interested in maintaining the project, transfer it to someone else who is interested.

Python doesn't require return statements at the end of functions and methods, and I noticed pdfminer had many such unnecessary returns. I went through and removed 341 unnecessary statements. Specifically:

• Removed all return statements that were the last statement in a function or method.
• For any return statements that were the only statement in a function, converted them to a pass.

Overall this makes it a simpler, more readable codebase, and it's much more Pythonic.

So i used the pdfminer lib and its functional, but sadly there is one big problem, which makes this lib completly irrelevant for me. It is too slow. I'll give you an example from: http://www.blog.pythonlibrary.org/2018/05/03/exporting-data-from-pdfs-with-python/ using this free PDF: https://web.stanford.edu/~jurafsky/slp3/edbook_oct162019.pdf

import io
 
from pdfminer.converter import TextConverter
from pdfminer.pdfinterp import PDFPageInterpreter
from pdfminer.pdfinterp import PDFResourceManager
from pdfminer.pdfpage import PDFPage
 
def extract_text_by_page(pdf_path):
    with open(pdf_path, 'rb') as fh:
        for page in PDFPage.get_pages(fh, 
                                      caching=True,
                                      check_extractable=True):
            resource_manager = PDFResourceManager()
            fake_file_handle = io.StringIO()
            converter = TextConverter(resource_manager, fake_file_handle)
            page_interpreter = PDFPageInterpreter(resource_manager, converter)
            page_interpreter.process_page(page)
 
            text = fake_file_handle.getvalue()
            yield text
 
            # close open handles
            converter.close()
            fake_file_handle.close()
 
def extract_text(pdf_path):
    for page in extract_text_by_page(pdf_path):
        print(page)
        print()
 
if __name__ == '__main__':
    extract_text('edbook_oct162019.pdf')

This script takes about 54,8s for parsing one document. While the same implementation with PyPDF2 just takes 11,3s.

I am planning to parse 1000 to 10000 PDFs and PyPDF seems to be 5 times faster, so its the obvious choice here.

Can you elaborate on this?

I am getting this error,

ERROR: Could not find a version that satisfies the requirement pycryptdome (from PDFMiner->-r requirements.txt (line 38)) (from versions: none) ERROR: No matching distribution found for pycryptdome (from PDFMiner->-r requirements.txt (line 38))

The PyPDF2 package can read hyperlinks from PDF files.

from PyPDF2 import PdfFileReader
doc = PdfFileReader(open(file, "rb"))
annots = [page.get('/Annots', []) for page in doc.pages]
annots = reduce(lambda x, y: x + y, annots)
links = [note.get('/A', {}).get('/URI') for note in annots]

However, PyPDF2 does not do a good job on extracting text. Ideally, I want to extract the hyperlinks and their corresponding texts.

without fmttype as 6, pdfminer was unable to read the file. Threw an exception as assert False, str(('Unhandled', 6))

Please accept this, to avoid any issues on formats of such values

hi, I am facing this error, but unfortunately i cant modify the pdf file, so i need to handle this programatically, Could you guide me if you have resolved it? My metadata has this as a field value: {'q': PDFObjRef:65, 'Q': PDFObjRef:64} and after i resolve it , it converts to {'q': <PDFStream(65): raw=3, {'Length': 3}>, 'Q': <PDFStream(64): raw=3, {'Length': 3}>} I am not sure how to proceed with this.

python3.7,pip install pdfminer


then 

python tools/pdf2txt -O output input.pdf

File "/usr/local/anaconda3/envs/py37/lib/python3.7/site-packages/pdfminer/image.py", line 74, in export_image
    if len(filters) == 1 and filters[0][0] in LITERALS_DCT_DECODE:
TypeError: object of type 'zip' has no len()

There are 2 different hashes present in attached pdf file but while parsing, PDF Miner separates both a new line and wrapped hash text with ‘\n’ which makes it difficult to handle while extracting hashes from a file.

Hi,

When using pdfminer.six to extract text elements from a pdf file, I found that it doesn't work in some cases.

Pdf files: 2022 Mar quarterly report_ Ali.pdf SIA_AR_2021.pdf

Description:

• File 1: can't extract text, however, it's able to extract text when we convert the original pdf file to a printed pdf.
• File 2: can't extract only part of the text.

Code which is used:

  def get_page_layout(
      filename,
      line_overlap=0.5,
      char_margin=1.0,
      line_margin=0.5,
      word_margin=0.1,
      boxes_flow=0.5,
      detect_vertical=True,
      all_texts=True,
  ):
      """Returns a PDFMiner LTPage object and page dimension of a single
      page pdf. To get the definitions of kwargs, see
      https://pdfminersix.rtfd.io/en/latest/reference/composable.html.
      Parameters
      ----------
      filename : string
          Path to pdf file.
      line_overlap : float
      char_margin : float
      line_margin : float
      word_margin : float
      boxes_flow : float
      detect_vertical : bool
      all_texts : bool
      Returns
      -------
      layout : object
          PDFMiner LTPage object.
      dim : tuple
          Dimension of pdf page in the form (width, height).
      """
      with open(filename, "rb") as f:
          parser = PDFParser(f)
          document = PDFDocument(parser)
          if not document.is_extractable:
              raise PDFTextExtractionNotAllowed(
                  f"Text extraction is not allowed: {filename}"
              )
          laparams = LAParams(
              line_overlap=line_overlap,
              char_margin=char_margin,
              line_margin=line_margin,
              word_margin=word_margin,
              boxes_flow=boxes_flow,
              detect_vertical=detect_vertical,
              all_texts=all_texts,
          )
          rsrcmgr = PDFResourceManager()
          device = PDFPageAggregator(rsrcmgr, laparams=laparams)
          interpreter = PDFPageInterpreter(rsrcmgr, device)
          for page_num, page in enumerate(PDFPage.create_pages(document)):
              interpreter.process_page(page)
              layout = device.get_result()
              width = layout.bbox[2]
              height = layout.bbox[3]
              dim = (width, height)
          return layout, dim
  
  
  def get_text_objects(layout, ltype="char", t=None):
      """Recursively parses pdf layout to get a list of
      PDFMiner text objects.
      Parameters
      ----------
      layout : object
          PDFMiner LTPage object.
      ltype : string
          Specify 'char', 'lh', 'lv' to get LTChar, LTTextLineHorizontal,
          and LTTextLineVertical objects respectively.
      t : list
      Returns
      -------
      t : list
          List of PDFMiner text objects.
      """
      if ltype == "char":
          LTObject = LTChar
      elif ltype == "image":
          LTObject = LTImage
      elif ltype == "horizontal_text":
          LTObject = LTTextLineHorizontal
      elif ltype == "vertical_text":
          LTObject = LTTextLineVertical
      if t is None:
          t = []
      try:
          for obj in layout._objs:
              if isinstance(obj, LTObject):
                  t.append(obj)
              else:
                  t += get_text_objects(obj, ltype=ltype)
      except AttributeError:
          pass
      return t