Database search too slow #161


  • New
  • Enhancment
Open
Assigned to _ForgeUser7076494
  • _ForgeUser254132 created this issue Jan 7, 2012

    Please update the search mechanism so that it narrows down what it is searching for more efficiently, instead of searching the entire database for a single record that matches the parameters given.  If I provide a very specific set of search parameters, it should quickly and efficiently pull records by, say, picking the parameter that would produce the smallest number of records, pulling those records, then narrowing down again, etc.  The way it is now is just too slow for any moderately sized database, and so slow as to timeout on very large databases.

  • _ForgeUser254132 added the tags New Enhancment Jan 7, 2012
  • _ForgeUser254132 posted a comment Jan 7, 2012

    As it is, I may as well be searching from tape.

  • _ForgeUser3962498 posted a comment Jan 7, 2012

    @MKindy: Go

    I think the dev intends it to be this way, at least it would make sense.

    Would you rather:
    1) wait for the query while the server is still lag-free, or
    2) the query be faster, but the server freezes while it runs

    I may be wrong, but I don't mind really. It's just 5-10 seconds really.


    Edited Jan 7, 2012
  • _ForgeUser7076494 posted a comment Jan 7, 2012

    I don't think you really understand how MySQL databases work, LordMarcus. What you are asking me to do is pull all the results into Java and then filter them. That is a silly way to do it because it will take even longer than a MySQL search.

  • _ForgeUser254132 posted a comment Jan 8, 2012

    @oliverw92: Go

    You're right about me not knowing much about MySQL, but why would you need to pull all the results into Java and THEN filter them? Why not filter them, then pull them into Java?


    Edited Jan 8, 2012
  • _ForgeUser254132 posted a comment Jan 8, 2012

    @cembry90: Go

    How big is your database? It takes several minutes for any search in our database; we have over 74 million records. If a rollback involves more than 10,000 blocks or so, the plugin behaves randomly then locks up entirely and changes cannot be undone. If two or more people perform a search at the same time via the website or the in-game functionality, the plugin will lock up and become unresponsive.

  • _ForgeUser6859978 posted a comment Jan 10, 2012

    where are you running mysql? what resources does it have? my db is hulking and results take seconds

    the web interface needs long time outs on php scripts enabled speak to your web host or amend this to help

  • _ForgeUser6859978 posted a comment Jan 10, 2012

    also you could consider cleansing your database for data older than a month?


To post a comment, please login or register a new account.