Giter Site home page Giter Site logo

Comments (5)

centerdevs avatar centerdevs commented on May 8, 2024 1

Updated and it works awesome now! thanks a lot !

from log-viewer.

arukompas avatar arukompas commented on May 8, 2024

Hey @centerdevs , thanks for the kind words!

  1. How big are your log files? Is it possible to get a screenshot of the file list on the left?
  2. It's hard to tell when exactly this memory exception occurs. Can you explain a bit what actions are you taking before this exception occurs? Does it happen when first opening up the log viewer? Does it happen when navigating to a big file? Does it happen when searching? etc etc. Exact steps, so I can reproduce it.

Thanks!

from log-viewer.

centerdevs avatar centerdevs commented on May 8, 2024

Hello @arukompas

  1. I have logs/laravel.log that is always lightweight ( up to 1mb ). And i have larger logs files stored in subfolders, ex. logs/*/big.log - some of big are 150-200mb in size, and my total log folder size is 8 GB.

  2. When i open log-viewer, by default no one file selected, and the error almost instantly occurs by itself, like i see it - it indexing the whole log folder and because of total logs/* size there some problem. What is important, when i open any of "big" 100-200MB logs file - it's absolutelly fine i can explore them without any problem, this happening just with "background" indexing proccess.

  3. BTW, an error occurrs 3-4 times ( 1 error per one log-viewer page refresh in browser ) and after it stops to occurring. It feels like indexing proccess was finished and it will be repated after some time, it's not triggered anymore. After 5 min when i open log-viewer - the error is already triggered :)

from log-viewer.

centerdevs avatar centerdevs commented on May 8, 2024

I've temporary commented out the code in the the following files - IsScanRequiredController, ScanFilesController.

So now i'll have no errors triggered by the files scanner and the most important - i'll have no scanning of 8GB logs, that i don't really need to scan. It's "cold" logs with some important historical information.

  • also, the error is always triggered when i'm trying to clear all indices, so here the problematic action on the screenshot

63fa762e6794e3949fb96416f7461e14

from log-viewer.

arukompas avatar arukompas commented on May 8, 2024

Hey @centerdevs , thanks for helping debug the issue!

I've tagged a new release, v1.8.0 which allows you to disable this eager scanning done at the beginning. I understand not everyone needs this, so this setting makes perfect sense.

Just added some info about it in the docs as well - https://log-viewer.opcodes.io/docs/configuration/managing-indices

Let me know if resolves the issue!

from log-viewer.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.