Free and Open, Distributed, RESTful Search Engine

Overview

Elasticsearch

Elasticsearch is the distributed, RESTful search and analytics engine at the heart of the Elastic Stack. You can use Elasticsearch to store, search, and manage data for:

  • Logs

  • Metrics

  • A search backend

  • Application monitoring

  • Endpoint security

... and more!

To learn more about Elasticsearch’s features and capabilities, see our product page.

Get started

The simplest way to set up Elasticsearch is to create a managed deployment with Elasticsearch Service on Elastic Cloud.

If you prefer to install and manage Elasticsearch yourself, you can download the latest version from elastic.co/downloads/elasticsearch.

For more installation options, see the Elasticsearch installation documentation.

Upgrade

To upgrade from an earlier version of Elasticsearch, see the Elasticsearch upgrade documentation.

Build from source

Elasticsearch uses Gradle for its build system.

To build a distribution for your local OS and print its output location upon completion, run:

./gradlew localDistro

To build a distribution for another platform, run the related command:

./gradlew :distribution:archives:linux-tar:assemble
./gradlew :distribution:archives:darwin-tar:assemble
./gradlew :distribution:archives:windows-zip:assemble

To build distributions for all supported platforms, run:

./gradlew assemble

Distributions are output to distributions/archives.

To run the test suite, see TESTING.

Documentation

For the complete Elasticsearch documentation visit elastic.co.

For information about our documentation processes, see the docs README.

Contribute

For contribution guidelines, see CONTRIBUTING.

Questions? Problems? Suggestions?

  • To report a bug or request a feature, create a GitHub Issue. Please ensure someone else hasn’t created an issue for the same topic.

  • Need help using Elasticsearch? Reach out on the Elastic Forum or Slack. A fellow community member or Elastic engineer will be happy to help you out.

You might also like...
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.

Auto-Complete Google Project In this project there is an implementation for one feature of Google's search engines - AutoComplete. Autocomplete, or wo

Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

Inverted index creation and query search mechanism on Wikipedia pages.

WikiPedia Search Engine Step 1 : Installing Requirements Install "stemming" module for python using pip. Step 2 : Parsing the Data To parse the data,

ForFinder is a search tool for folder and files
ForFinder is a search tool for folder and files

ForFinder is a search tool for folder and files. You can use that when you Source Code Analysis at your project's local files or other projects that you are download. Enter a root path and keyword to ForFinder.

Modular search for Django

Haystack Author: Daniel Lindsley Date: 2013/07/28 Haystack provides modular search for Django. It features a unified, familiar API that allows you to

Full text search for flask.

flask-msearch Installation To install flask-msearch: pip install flask-msearch # when MSEARCH_BACKEND = "whoosh" pip install whoosh blinker # when MSE

Comments
  • Redundant Code at line 73 in the source file MembersInjectorStore.java

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Elasticsearch Version

    master branch

    Installed Plugins

    No response

    Java Version

    bundled

    OS Version

    no

    Problem Description

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Steps to Reproduce

    no

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by liweixiesysu 0
  • Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Elasticsearch Version

    7.17.8

    Installed Plugins

    repository-azure

    Java Version

    bundled

    OS Version

    Linux elasticsearch-master-0 5.4.0-1086-azure #91~18.04.1-Ubuntu SMP Thu Jun 23 20:33:05 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

    Problem Description

    Elasticsearch running on kubernetes, installed via helm.

    Snapshot repo has been added and pointing to azure blob. Around 1/3 of the indices are failing when running the snapshot with the following error:

    INTERNAL_SERVER_ERROR: UncategorizedExecutionException[Failed execution]; nested: ExecutionException[java.io.IOException: Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: IOException[Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: ReactiveException[java.io.IOException: null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: IOException[null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: ClosedChannelException
    

    This smells to me like an azure issue however posting here first to try and get some kind of confirmation or consensus before I reach out to them.

    Steps to Reproduce

    add azure blob snapshot repo, create snapshot policy to capture everything, run policy

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by danfinn 0
  • NodeClient#executeLocally always executes action on the calling thread

    NodeClient#executeLocally always executes action on the calling thread

    Not sure if this is a bug or not but I found it surprising and think it's worthy of discussion. REST actions all run on a transport thread and typically call some method on a Client which ends up calling NodeClient#executeLocally and ultimately running a transport action on the local node. However AFAICT there's nowhere in this call stack which forks onto a different thread, even if the transport action would fork off onto a different thread when handling a transport request received from elsewhere.

    I mean this kinda makes sense, it's the TransportService that tracks which handlers fork where, and calls into the NodeClient bypass the TransportService, but still it seems like a potential source of inappropriate work on transport threads.

    Is that a known thing? Am I wrong to be surprised about this? (or indeed am I wrong about this behaviour?) Not much time to investigate further now so I'm opening this to make sure we discuss it.

    :Distributed/Network team-discuss Team:Distributed 
    opened by DaveCTurner 1
  • Improve scalability of BroadcastReplicationActions

    Improve scalability of BroadcastReplicationActions

    BroadcastReplicationAction derivatives (POST /<indices>/_refresh and POST /<indices>/_flush) are pretty inefficient when targeting high shard counts due to how TransportBroadcastReplicationAction works:

    • It computes the list of all target shards up-front on the calling (transport) thread.

    • It eagerly sends one request for every target shard in a tight loop on the calling (transport) thread.

    • It accumulates responses in a CopyOnWriteArrayList which takes quadratic work to populate, even though nothing reads this list until it's fully populated.

    • It then mostly discards the accumulated responses, keeping only the total number of shards, the number of successful shards, and a list of any failures.

    • Each failure is wrapped up in a ReplicationResponse.ShardInfo.Failure but then unwrapped at the end to be re-wrapped in a DefaultShardOperationFailedException.

    This commit fixes all this:

    • It avoids allocating a list of all target shards, instead iterating over the target indices and generating shard IDs on the fly.

    • ~The computation of the list of shards, and the sending of the per-shard requests, now happens on the relevant threadpool (REFRESH or FLUSH) rather than a transport thread.~ see https://github.com/elastic/elasticsearch/issues/92730

    • The per-shard requests are now throttled, with a meaningful yet fairly generous concurrency limit of #(data nodes) * 10.

    • Rather than accumulating the full responses for later processing we track the counts and failures directly.

    • The failures are tracked in a regular ArrayList, avoiding the accidentally-quadratic complexity.

    • The failures are tracked in their final form, skipping the unwrap-and-rewrap step at the end.

    Relates #77466

    >bug :Distributed/Network v8.7.0 
    opened by DaveCTurner 1
Releases(v8.5.3)
  • v8.5.3(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.3.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.8(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.8.html

    Source code(tar.gz)
    Source code(zip)
  • v8.5.2(Nov 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.2.html

    Source code(tar.gz)
    Source code(zip)
  • v8.5.1(Nov 15, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.1.html

    Source code(tar.gz)
    Source code(zip)
  • v8.5.0(Nov 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.0.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.7(Oct 25, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.7.html

    Source code(tar.gz)
    Source code(zip)
  • v8.4.3(Oct 5, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.3.html

    Source code(tar.gz)
    Source code(zip)
  • v8.4.2(Sep 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.2.html

    Source code(tar.gz)
    Source code(zip)
  • v8.4.1(Aug 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.1.html

    Source code(tar.gz)
    Source code(zip)
  • v8.4.0(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.0.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.6(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.6.html

    Source code(tar.gz)
    Source code(zip)
  • v8.3.3(Jul 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.3.html

    Source code(tar.gz)
    Source code(zip)
  • v8.3.2(Jul 7, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.2.html

    Source code(tar.gz)
    Source code(zip)
  • v8.3.1(Jun 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.1.html

    Source code(tar.gz)
    Source code(zip)
  • v8.3.0(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.0.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.5(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.5.html

    Source code(tar.gz)
    Source code(zip)
  • v8.2.3(Jun 14, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.3.html

    Source code(tar.gz)
    Source code(zip)
  • v8.2.2(May 26, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.2.html

    Source code(tar.gz)
    Source code(zip)
  • v8.2.1(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.1.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.4(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.4.html

    Source code(tar.gz)
    Source code(zip)
  • v8.2.0(May 3, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.0.html

    Source code(tar.gz)
    Source code(zip)
  • v8.1.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.3.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.3.html

    Source code(tar.gz)
    Source code(zip)
  • v8.1.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.2.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.2.html

    Source code(tar.gz)
    Source code(zip)
  • v8.1.1(Mar 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.1.html

    Source code(tar.gz)
    Source code(zip)
  • v8.1.0(Mar 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.0.html

    Source code(tar.gz)
    Source code(zip)
  • v8.0.1(Mar 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.1.html

    Source code(tar.gz)
    Source code(zip)
  • v7.17.1(Feb 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.1.html

    Source code(tar.gz)
    Source code(zip)
  • v8.0.0(Feb 10, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.0.html

    Source code(tar.gz)
    Source code(zip)
Google Search Engine Results Pages (SERP) in locally, no API key, no signup required

Local SERP Google Search Engine Results Pages (SERP) in locally, no API key, no signup required Make sure the chromedriver and required package are in

theblackcat102 4 Jun 29, 2021
Simple algorithm search engine like google in python using function

Mini-Search-Engine-Like-Google I have created the simple algorithm search engine like google in python using function. I am matching every word with w

Sachin Vinayak Dabhade 5 Sep 24, 2021
A sentence search engine that fetches examples from trusted news/media organisations. Great for writing better English.

A sentence search engine that fetches examples from trusted news/media websites. Great for improving writing & speaking better English.

Stephen Appiah 1 Apr 4, 2022
A simple search engine that allow searching for chess games

A simple search engine that allow searching for chess games based on queries about opening names & opening moves. Built with Python 3.10 and python-chess.

Tyler Hoang 1 Jun 17, 2022
A fast, efficiency python package for searching and getting search results with many different search engines

search A fast, efficiency python package for searching and getting search results with many different search engines. Installation To install the pack

Neurs 0 Oct 6, 2022
Search emails from a domain through search engines

EmailFinder - search emails through Search Engines

Josué Encinar 155 Dec 30, 2022
Image search service based on imgsmlr extension of PostgreSQL. Support image search by image.

imgsmlr-server Image search service based on imgsmlr extension of PostgreSQL. Support image search by image. This is a sample application of imgsmlr.

jie 45 Dec 12, 2022
GitScanner is a script to make it easy to search for Exposed Git through an advanced Google search.

GitScanner Legal disclaimer Usage of GitScanner for attacking targets without prior mutual consent is illegal. It is the end user's responsibility to

Kaio Gomes 3 Oct 28, 2022
Reverse-ikea-image-search - A simple image of ikea search using jina.ai

IKEA Reverse Image Search This is a demo project to fetch ikea product images(IK

SOUVIK GHOSH 4 Mar 8, 2022
document organizer with tags and full-text-search, in a simple and clean sqlite3 schema

document organizer with tags and full-text-search, in a simple and clean sqlite3 schema

Manos Pitsidianakis 152 Oct 29, 2022