Geocodes appear to be approximates in a lot of cases. In certain instances, the listing will have the address in the mapaddress div tag and it doesn't seem like this reads that. This is a feature request to include that information.

Example page - https://york.craigslist.org/apa/d/york-room-for-rent/7104679926.html Example return:

{
  'id': '7104679926',
  'repost_of': None,
  'name': 'Room for Rent',
  'url': 'https://york.craigslist.org/apa/d/york-room-for-rent/7104679926.html',
  'datetime': '2020-05-07 08:47',
  'last_updated': '2020-05-07 08:47',
  'price': '$669',
  'where': None,
  'has_image': True,
  'geotag': (39.955682, -76.718121)
}

Page with inspection open:

Add another option to get_results called include_details which also fetches the body of the listing as well as the urls of all the images. The listing is only fetched once and reused for both the geotag logic and the include_details logic.

Hi and thanks again for this great tool.

I am using the search_titles option for a keyword and I have come to realize that it may not be working properly.

As an example, am using the keyword 'Softail' to search for Harley bikes and it does flag the ones with Softail in the title.

Here is a sample of the code I use.

Could you check or tell me what I am doing wrong?

This code allows the following example to work.

cl_h = CraigslistHousing(site='sfbay', area='sfc', category='apa',
                         filters={'min_price': 6000, 'min_bedrooms': 5, 'min_bathrooms': 2})

for result in cl_h.get_results(sort_by='newest', geotagged=True):
    print(result)

In CraigslistForSale, there are several categories (e.g. 'CTA') that have the option to filter listings by dealer or owner on the website.

Adding that as a filter in this would be very useful.

Here is the housing example:

from craigslist import CraigslistHousing

cl_h = CraigslistHousing(site='sfbay', area='sfc', category='roo',
                         filters={'max_price': 1200, 'private_room': True})

for result in cl_h.get_results(sort_by='newest', geotagged=True):
    print result

This was working about a week ago, but as of recently it throws an error (on the line with the for loop). The error is: File "/Library/Python/2.7/site-packages/craigslist/__init__.py", line 160, in get_results p_text = row.find('span', {'class': 'p'}).text AttributeError: 'NoneType' object has no attribute 'text'

Thanks

File "C:\Python34\lib\site-packages\craigslist\__init__.py", line 3, in <module> from Queue import Queue ImportError: No module named 'Queue'

Looks like it's not Python3 compatible after all.

When I tried to use your library with Python 3 it threw several errors, but I changed the import statements to work with both Python 2 and 3. I'd really appreciate it if you could add this functionality! :smile:

There seems to be a 10-15 minute delay from when something is posted on craigslist to when python-craigslist finds it. Is there any way to minimize this time?

When following the basic lines in the README, I get requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://sfbay.craigslist.org/search/sfc/roo?searchNearby=1&sort=date&max_price=1200&private_room=1&s=0.

Is there functionality that allows a user to work-around this? A quick look at the code makes it seem like no.

A potential lede - https://stackoverflow.com/questions/16627227/http-error-403-in-python-3-web-scraping

Hello, I set geotagged = True for housing, but I receive all 'geotag': None. These websites usually have maps and an address underneath. Is this a CL issue?

Hi - I was just wondering if this wrapper is still maintained? I tried a few different endpoints but received a couple different types of errors and wasn't sure if they're caused by a bad local installation on my end or if the wrapper was just not longer supported and there had since been updates to CL. Thanks!

Using requests.Session() allows for keep-alive connections and prevents repeated DNS queries that can cause some caching resolvers to fail transiently. Using urllib3.Retry allows for better, more dynamic handling of request retries.

Sometimes, listings that violate Craigslist's TOS will be removed, but remain searchable. This change stops logging warnings for these non-existent listings. Here's an example from the cars & trucks section which consistently displays in searches but whose listing page returns an HTTP 404.

For whatever reason, CG does not deal with my [large TX] zipcode well. So on CG I always use the "use map" option in my searches. That replaces zipcode with lat and lon params.

But I'm getting:

'lat' is not a valid filter
'lon' is not a valid filter