parseablehq/console

Frontend Client for Parseable. Parseable is a cloud native log storage and management for Kubernetes, containerised workloads

console's Issues

Stats Page: Refresh button is not working

Sort log records by time field in reverse order

Right now, Parseable Console queries logs in the form of select * from <stream> order by <time>. Can we sort log records by time field in reverse order, like select * from <stream> order by <time> desc?

Refresh interval for a given data range.

When the time range is set to say Last 10 minutes - we fetch the data at that point in time (range select button click) and display it to the user.

But now as new data comes in user may want to refresh the view automatically. We need a refresh interval button which lets users set a refresh interval of 1s, 2s, 5s, 20s, 1min.

Add a new page with SQL query prompt and time select window

The resulting table should look like

http://demo.parseable.io:3000/d/ojonXSp4z/parseable-demo-data?orgId=1&refresh=1m&from=1677134393046&to=1677134693046&viewPanel=8

Parseable dashboard should be able to handle different log schemas

A log stream can essentially be of any json schema. We need to come up with an approach so that UI can handle different / unknown log schemas.

Replace arrow functions in props

As shown here, we could replace the arrow function to improve performance.

User management

There are five entities in Parseable Access Control model - Action, Privilege, Resource, Role and User. Below section explains each of these entities in detail.

Admin, Editor, Writer and Reader. Below is the list of actions allowed for each Privilege.

Admin: All Actions.
Editor: Ingest, Query, CreateStream, ListStream, GetSchema, GetStats, GetRetention, PutRetention, PutAlert, GetAlert.
Writer: Ingest, Query, GetSchema, GetStats, GetRetention, PutAlert, GetAlert.
Reader: Query, GetSchema, GetStats, GetRetention, GetAlert.

Cursor pointer on logout icon

Allow sorting of a given column

Currently we allow filtering values from inside a single column. We should also allow sorting (increasing & decreasing order) for each column.

Add Export Functionality for CSV and JSON Formats

Slightly different header size in column and field selector

Store columns displayed

It would be useful to keep what columns are shown and restore the same config on page refresh. Maybe session storage or uri query params can be used for that ?

User Button doesn't shows up if there is no streams

UI Feat: Integrate SQL query builder into filters

Paginate stream results page instead of current infinite scrolling

Add settings page

Add a settings page in the console. For now we can start with a readonly page

• Showing all the env vars (that start with P_)
• Redact the fields P_S3_SECRET_KEY and P_PASSWORD.

Ctrl + Enter doesn't run the SQL query in SQL window

Display console version in about section

The About API has console version available now, we need to display that in the About section.

Refer #parseablehq/parseable

Inconsistency in Live Tail Feature Behaviour Between HTTP and HTTPS Environments

The Live Tail feature is functional on Safari but encounters issues on Chrome when accessed via HTTPS. Further investigation and resolution are needed to ensure consistent behavior across browsers and secure connections.

Search query not working properly from console

When console tries to fetch a field like this

'{
    "endTime": "2022-09-01T11:43:00+00:00",
    "query": "select * from frontend order by datetime limit 10  ",
    "startTime": "2022-08-31T11:43:00+00:00"
}'

The query fails with datafusion error, but same query seems to work fine from postman / curl etc

Console doesn't show stream data for large streams

To see this in action, open the Parseable demo site:

https://demo.parseable.io (creds: admin,admin). Select the minioaudit stream and select the time range to two months. You should see an empty page.

But if you query the same stream via curl (with command below), you'll see data present there.

curl --location 'https://demo.parseable.io/api/v1/query' \
--header 'Authorization: Basic YWRtaW46YWRtaW4=' \
--header 'Content-Type: application/json' \
--data '{
    "query":"select COUNT(*) from minioaudit",
    "startTime":"2023-02-14T00:00:00+00:00",
    "endTime":"2023-02-20T23:59:00+00:00"
}'

Filters - Addressing inconsistencies in the query builder behavior.

1. Implement delimiters to enable case sensitivity on column names.
2. The apply button remains disabled for rules with null/not-null operators.
3. Reset the filter context when switching to a different stream.
4. The filter modal should close when clicking outside of it.

Stream selection dropdown move to breadcrumb

UI Minor fixes

• Disable auto refresh on focus. (fixed by #6 )
• Improve the date time picker design
• Date picker should show the time zone (current computer's time zone) and then convert the chosen date time to UTC before making the backend API call.

Browser crashed because of no limits

While using the Query panel, I ran the following query which pulled in millions of logs and caused the browser to crash:

SELECT * FROM vectordemo where status='200';

Ideally, if the user hasn't specified any limit, then a default limit should be applied to prevent this. Metabase defaults to 2000, depending on the UI performance of the Parseable components a similar limit can be applied as well.

Console crashes when a query failed

When a query fails and the response status is not 200, instead 400 or some other failed status. The console goes blank. It should instead show the page and a human / user understandable error message.

Add data download options in query page

Add download as json and csv option in query response view (next to copy and search buttons).

Also add share query results button

add live tail support

we need to add live tail receiver support so users can use Console to hook on to receive all the logs for a given stream

depends on parseablehq/parseable#503

"UI Issue: Modal Displays 'Create User' Instead of 'Create Role', and Role Doesn't Update in 'Create User' Modal"

The modal should show create new role , it show create user

jam link

The role doesn't update in role list in create user modal , page need to refresh to get the new role .

Jam link for role update in create user modal

Add SQL Search Support in 'Explore' Tab and Sunset Separate 'SQL' Tab

Handle no log stream scenario properly

If there is no log stream, the dashboard goes blank - we need to instead load the page and just say - No log streams found on the log stream drop down.

Feature Request: named saved filters in Logs page

It would be great to add ability to save filter set in Logs page. For example, I need to show only error logs with column "status" equals 500. It'd be more convenient to select saved filter in filter list.
And please add filter parameters to the query string - in this case I would add a link with predefined filter to bookmarks in browser.

add cursor pointer in logout

Display empty streams placeholder when no stream is available on homepage

Snackbars - Add appropriate msg for each and remove unwanted triggers

Redirect to the login screen when the session expires.

Update clickable divs to button

Identify clickable divs and replace them with buttons

Fix linter issues

Current linter issues

[eslint]
src/components/SideDialog/index.js
  Line 2:20:   'useEffect' is defined but never used        no-unused-vars
  Line 7:10:   'isJsonString' is defined but never used     no-unused-vars
  Line 24:10:  'log' is assigned a value but never used     no-unused-vars
  Line 24:15:  'setLog' is assigned a value but never used  no-unused-vars

src/page/Dashboard/DateRangeSeletor.js
  Line 4:10:  'SelectorIcon' is defined but never used    no-unused-vars
  Line 5:10:  'CalculatorIcon' is defined but never used  no-unused-vars

src/page/Dashboard/index.js
  Line 2:30:   'useRef' is defined but never used                     no-unused-vars
  Line 2:38:   'useCallback' is defined but never used                no-unused-vars
  Line 83:10:  'timeZone' is assigned a value but never used          no-unused-vars
  Line 87:10:  'labelSelected' is assigned a value but never used     no-unused-vars
  Line 87:25:  'setLabelSelected' is assigned a value but never used  no-unused-vars
  Line 224:9:  'timeZoneChange' is assigned a value but never used    no-unused-vars

Add PropTypes to shared components

pin columns in the right column sidebar

Add an option to pin columns to the right column sidebar

Add about details in the console

With parseablehq/parseable#462, server added support for About API. We need to show these details in the console.

We can change the Help to About and show details from About API and the Help section

Shareable state using query params

add a feature to share autofilled input or filter states using query params

Total records count is not updated after changing the time range

Fix refreshing behaviour: restore context from url

Do not display tags in the log display table

Issues with Table Functionality and Tooltip Display

Description

There are multiple issues observed with the current implementation of table functionality and tooltip display in our project. Below are the details of the issues and a suggestion for improving the tooltip functionality.

1. Filter by Value Scrolling Issue

• Description: The 'Filter by Value' functionality in tables is not scrolling properly. When users attempt to scroll through the list of values, the data vanishes if scrolled too much.
• Expected Behavior: The data should remain visible and scroll smoothly, allowing users to select their desired filter values without any interruption.
• Steps to Reproduce:

  •     Go to the table click on Datetime 
    

  •     Attempt to scroll through the list in  'Filter by Value'
    

  •     Notice that the data disappears or behaves erratically after a certain point.
    

2. Tooltip Border Visibility

• Description: The tooltip displayed over table values lacks a distinct border, causing it to blend in with the table's background. This makes it difficult to read the tooltip's content.
• Expected Behavior: Tooltips should have a clear border or shadow to distinguish them from the table background, enhancing readability.
• Suggestion: Implement a subtle border or shadow around tooltips.
  

3. Tooltip Length Condition

• Suggestion: It is proposed to display tooltips only for table values that exceed a certain length (e.g., more than 20 characters). This will prevent tooltips from cluttering the UI unnecessarily and focus the user's attention on longer values that might be truncated.
• Rationale: This approach will enhance the user experience by providing additional context only when necessary, keeping the interface clean and focused.
  

[Bug] Console doesn't show all data.

When I ask all logs from last 10 minutes, I see correct logs count but I don't see all this logs.

In this screen I see that there is 26 log items in total, but only one log item in the list. The problem probably is in a query (highlited by an arrow in the screenshot) - startTime time equals 07:29:00, but correct time is 07:20:00.

Title: Enhancements to Explore Page Search Functionality

Issue Summary
- Search functionality on the explore page is activated only by pressing the Enter key.
- No clear button available to reset the search input.
- The reset button fails to clear both the search input and the applied filters.
- Suggestion to implement debounce for API calls in the search input to improve performance and minimize unnecessary requests.
Expected Behavior:
- A clear button should be available to reset the search input.
- The reset button should clear both the search input and any applied filters.
- Debounce should be implemented for search input to efficiently manage API calls.

Jam Link

Allow columns ordering

It would be nice to be able change the columns order and have something custom instead of alphabetically.

In my usecase I have logs from an webserver so I would like the columnes to be in that order : datetime, host, uri, qs, status, ua instead of datetime, host, qs, status, ua, uri.

Maybe the oerder could also be restored on refresh like in #58.

Volunteer to improving the UI

I pretty much love Parseable and can't wait to see it hit production ready, but the UI seems Meh.

I also seem to notice preference issues as mentioned in this issue

I would like to work on starting over using this stack,

• React
• Vite
• Typescript
• Mantine UI