multithreading - How to config elasticsearch cluster on one server to get the best performace on search -


I'm new to the elasticsearch of about 300,000 items is an elastic search index of any other table with 60 million records For each, I need to do a complex query to this ES index.

Right now, it is very slow (1000 questions will take 200 seconds).

My server: 

  8 core 8 GB RAM SSD hardware   
 I handle 100 concurrent search requests from Ruby I want to configure elasticsearch. (I want to search 1000 items in parallel)  
  I'm trying with default config   
 I think by default, Elastastens only requires 10 -20 concurrent search requests this small CPU and Therefore, I think I can improve it.  
 I can run 100 threads from Ruby to find only 1000 items and it takes 200 seconds. If I increase 1000 threads from Ruby, ES returns the timeout error message.  
  I   
  ES_HEAP_SIZE = 2G index.filedata.cache.size: 1g Threadpool: Search: Type: A master node with fixed size Run: 200 QA_Size: 400 Share: 5 Replicas: 1   
 To carry 100 threads from Ruby still takes 1000 items to 200s.  
  I have 3 new nodes on this server as data nodes.   
 To run 100 threads from Ruby, 1000 items are still 200 or more.  
 People say that making more syndrome will slow the search.  
 How do I improve my search query?  
 Many thanks!   
 
 
 You want to watch this video:  
  
 The default for ES is great for development but not one thing that you really need to do is give JVM 50% of available memory on the server. There are very good suggestions in that video.

Comments

Post a Comment

Popular posts from this blog

Java - Error: no suitable method found for add(int, java.lang.String) -

I'm in the middle of homework work and I'm stuck. At this point in my code, I think that I should have a GUI window that opens and allows me to type "inserted text number". Notice is not going anywhere but at this point, If I pass through the problem then it will be in a linked list. I am getting two of the same error for the lines. Add (index, element); And I can not seem to get past it, there is no suitable method for the error "add (int, java. string string)". Code is below, please advise. To clarify - this will not be a method error because it is a linked list. There should not be any way involved. import java.awt. *; Import java.awt.event. *; Import javax.swing. *; Import java.util. *; Import java.util.Scanner; Import java.util.LinkedList; Public class TopTenList JFrame {Private TopTenList tt; See the Private JTextArea list; Private JTextField cmdTextField; Private JTextField resultsTestfield; // This GUI window is the code for the public toptist...
Read more

java - JPA TypedQuery: Parameter value element did not match expected type -

I am using JPA 2.0 and getting the following code in the DAO layer: Public Zero Test () {string key = "status"; String [] Conditions = {"A", "B"}; & Lt; TestTable & gt; Results = Search (Keys, Conditions); } Public listing & lt; TestTable & gt; Search (string key, object value error) {string sql = "test ndf to testlet and jade nand." + Key + "in:" + key; TypedQuery & LT; TestTable & gt; Query = entityManager.createQuery (SQL, TestTable.class); Query.setParameter (key, Arrays.asList (valueArr)) / *** Error Line *** Return query.getResultList (); } In the above error line, it throws the following exception: java.lang.IllegalArgumentException: parameter value element [[Ljava.lang.String; @ cbe5bc] did not match the expected type [java.lang.String] Why is this expected type string while actually this string []? Please help! Note: This is derived from the normal routine and is a simplified code. I can no...
Read more

c++ - static template member variable has internal linkage but is not defined -

Yes, I know, there is a question with almost the same title, but it refers to a different situation. Error message) In my case, I have a .cpp file with a big named designation name (implementation details). There is a property class template with a static data member in that name space, which I need to access from outside the unknown namespace. I give it a little bit of meat: file.hpp namespace Bar {template & lt; Typename A & gt; Struct foo {static_assert (is_same & lt; a, float & gt; :: value} is_same & lt; a, double>: value, ""); Fixed zero set_static_var (a const & x); // ...}; } and file.cpp namespace {template & lt; Typename A & gt; Struct foo_traits {// supports the implementation of several static code bars: foo & lt; & Gt; Fixed A data; }; The template's & lt; & Gt; Float foo_traits & lt; Float & gt; :: datum; // No change if this is in the global namespace template & lt; & Gt; Doub...
Read more