Slowdown with large files due to locality map

[dyfrgi]

Slowdown with large files due to locality map

[dyfrgi]

#1469 and #1433 have some comments from users who appear to have been experiencing the same issue. In particular, this comment #1469 (comment) has what appears to be the same stack trace, though that's not from the creator.

[Shougo]

Hm... The locality calc is slow if it is too long line.

[chrisands]

Would be possible to add option to disable some of comparators on large files? This also would help to get over with #1681
I did same thing for treesitter and syntax highlighting to disable them on large files

helper just in case

function disable_on_large_files(bufnr)
  local MAX_LINES = 5000
  local MAX_SIZE = 256 * 1024 -- 256KB

  local buf_name = vim.api.nvim_buf_get_name(bufnr)
  local file_size = vim.api.nvim_call_function('getfsize', { buf_name })

  if file_size > MAX_SIZE then
    return true
  end

  for _, line in ipairs(vim.api.nvim_buf_get_lines(0, 0, -1, false)) do
    if #line > MAX_LINES then
      return true
    end
  end

  return false
end