jshinonome/vscode-q

vscode kdb+/q extension

Jo Shinonome

Projects

vscode-k-pro

kdb+/q & k9 professional extension for vscode

vscode-q

kdb+/q extension for vscode

jkdb

A zero dependency javascript Node.js package to interface with kdb+/q (v2.6+).

vscode-q's Issues

autoscrolling-on resets to autoscrolling-off when I change focus

Delay showing q Console output after executing query

There seems to be a half a second delay before displaying the result of any query, even to a local q server. For example, the query might take 5ms to execute but it takes much longer to show the result in the q Console. The low responsiveness masks the visual interpretation of the responsiveness of the query, which hurts development.

Do you know if this a VS Code limitation or something that can be fixed inside the extension?

I checked https://github.com/jshinonome/vscode-q/blob/v2.3.6/src/client/modules/query-console.ts#L27 but couldn't find any artificial delay.

Fails to initialize language server if no permission to 'stat' folder

Fails to initialize language server if no permission to 'stat' folder.

mainThreadExtensionService.ts:66 Error: Request initialize failed with message: EPERM: operation not permitted, stat 's:\afolder/hdb'
	at c:\dev\vscode_extensions\extensions\jshinonome.vscode-q-1.7.1\dist\q-ext.js:3:65923
	at c:\dev\vscode_extensions\extensions\jshinonome.vscode-q-1.7.1\dist\q-ext.js:3:66217
	at Immediate.<anonymous> (c:\dev\vscode_extensions\extensions\jshinonome.vscode-q-1.7.1\dist\q-ext.js:3:66576)
	at processImmediate (internal/timers.js:439:21)

<go to Definition (f12)> Unable to open <file>...

steps to reproduce:
create 2 q file:
fist.q
fun:{[a;b] a+b}
second .q
fun[1;2]
go to second.q -> f12 -> all will be ok
rename first.q -> first_renamed.q
go to second.q -> f12 -> Unable to open 'first.q': Unable to read file '........first.q'

server explorer -> improvement -> show first N rows from a table by double click or somehow

subj

Query Grid Cell Copy

Ability to copy a single cell or multiple rows would be great in query Grid view using ag-grid

Query view

I am using VS Code January 2021 (version 1.53) with vscode-q v2.1.1
I added some remote and local sever and created table, I can run query but where is "Query View" mentioned in document? It will be great if you could please mention or am I missing additional extension.

Timestamp of Query View is converted to local time

Query view( by default.) must have the same values and settings as in console

History view

Documentation

• shortcut F1
• signature helps for build-in functions.

Disable output console when i open a q file!

Could I have a setting option to disable output console when I open a q file?
I just edit a q file。😂️

Query View -> wrong view for list of symbols

t2:([]dict:(aa1a2a3a4;b;`c))

expected result:

dict
--------------
`a`a1`a2`a3`a4
`b
`c

Add code formatting

A lot of devs write q code as one unformatted line.. sometimes it's quite hard to parse)).. will be good to have code formatting as in other popular languages like java,c,....

Date/time gets adjusted in query view

There is an issue with

enlist `d`p!(2019.11.24;2019.11.24D)

Server list - Folder Structure

Feature request

It would be great if you could have a folder structure in the server list for better organization.

Timestamps changed to 1969.12.31D18:59:59.999 with timestamps with .999

When querying the timestamp field in table, if the timestamp value has .999 in it.

In the q console:

q)t2:2016.01.13D17:11:29.99900 2016.01.13D17:11:29.9900 2016.01.13D17:11:29

and in VS Code:

([] time: t2)

Also when you save the table to csv the timestamp value is stored as -1

This only appears to impact the query view tab for the table. The console view returns the timestamp correctly.

Feature Request: Ctrl+q enhancements

Would be good to have Ctrl+q automatically advance the cursor to the next line, so that I can execute line by line using only Ctrl+q, without having to move the cursor myself.

A stretch goal (but I think this may be more challenging) is to have the language server recognize the boundaries of an expression, which may exist across multiple lines, and have Ctrl+q execute the expression that the current line is a part of, and then move the cursor to the start of the next expression.

Query view doesn't play will with light theme

server explorer -> improvement -> move tables, functions, variables, dictionaries to the separate places

example:

The query keeps running in vscode but it has already finished in kdb

When using the virtualization and run some query to show the table details, like "select from tb where date=.z.D-5", the query itself is finished in kdb, but the status still shows running in vscode side. In result, neither could I see the results of query, nor could I run other queries.

Is there a way to stop the running in vscode side? What I can do in this case is just close the vscode and restart a new one, which is quite annoying.

Thank you in advance if you can help on this issue!

The column type in the query result is incorrect!

The type of the 'account' column is symbol. But when the values of the 'account' column contains similar to '100001',it will be recognized as a number.

Can we make the @ tag for input/return/para cocnfigurable?

In my project will use auto q tag which have the below pattern instead of @p @r:
@func
@para
@return
@desc

could be more user-friendly if we can define the tag by ourselves

Allow to copy data and graph from q grid

Enhance q grid

• use chart.js, confirm if I can right click and save graphs
• allow to export data
• allow to copy data
• kdb format and general format

Trigger to pick q process if no active q process

Feature request: automatic refresh of server state after Ctrl+q or Ctrl+r

Is it possible to disable server explorer?

Hey just started using this extension. Really helpful, thanks a lot for sharing.

Had one problem that seems to be takes very long time on initial connection to server to recursively build the server explorer table, code for that appears to be defined here:

vscode-q/src/client/items/q-dict.ts

Line 105 in be600e1

const query = `{

Lazy fix would be if someway to have option to disable this server explorer.

Will take a closer look to see what part is taking so long and try and replicate.

Thanks

vscode-q client fails to gracefully reconnect after interruption (e.g. laptop sleep)

Prerequisite:

• Server closed the connection but the extension is unaware yet, e.g. after resuming from sleep
• User wants to execute a query

When the user resumes from sleep, the extension still thinks the q server is connected, and allows you to execute a query. Once doing so, it immediately says "Lost connection to..." but the query remains in executing state on the extension's side. Because of this, even after reconnecting, it says "Still executing last query" and the only solution is to restart VS Code.

Could this be improved so that the busy attribute

vscode-q/src/client/modules/q-conn-manager.ts

Line 147 in 97714fd

if (this.isBusy) {

is cleared if the connection is closed/reopened? I believe that could fix it.

Additionally, the extension should attempt to gracefully reconnect to the server if the connection was lost to make this an even more pleasant developer experience.

Increase decimal digits for Query View

Hi, I think you need to add new tool for data visualization or modify Query View because 50% of data in Query View and console are different ... i understand that it's by design but not expected ....
I can use console but in 30% cases console is not really useful because i have a lot of columns…..

regarding Query View again ...
as an example I can't compare bid ,ask, price ....
t:([]bid:1.443 1.443 1.443; ask: 1.447 1.448 1.446)

Able to choose q server from keyboard

vscode-q is cool.
Would be good to be able to choose a q server from the server list via keyboard. Be able to stay completely in the keyboard without moving the mouse would be nice.

Configurable shortcut for "run selected line(s)"

Hello,

Thank you for creating this wonderful extension! I was wondering if you would consider adding a configurable shortcut for at least the "run selected line(s)" command:

I used qStudio for a long time which uses CTRL+E (CMD+E on macOS), and there is another vscode extension https://github.com/real-xidaozu/vscode-kdb-q that follows this tradition. It would be helpful for any users who prefer to keep using their muscle memory.

If it is already possible to configure shortcuts for these, would you mind pointing me in the right direction to do that? :)

Also, two more related things:

1. I think it might be helpful to clarify that it's actually "run selection" rather than "run selected line(s)" since you can query a part of a line with that command.
2. Users of macOS generally use CMD in place of CTRL. This looks to conflict with some of the current shortcuts (like CTRL+Q), since CMD+Q will quit an application entirely on macOS! If users can eventually choose their own shortcuts they could fix that themselves, however I think it would be useful to choose default mappings that work well cross-platform.

Thanks again for your time.

Time issue with Data View

Connect to a remote box with a different timezone, the time on Data View looks weird...

Query View on 2nd update is moved to column one

The root cause could be with the new version vscode, I will investigate.

add debugger , watcher , breakpoints and ...

will be really useful to add some tools like debugger, breakpoints , watcher...
FYI : You can use open source debugger from Andrey K https://github.com/quintanar401/dbg

Explore to use .Q.bs for breakpoints

.Q.bs[function name; position of characters of function string def]

This can only be triggered after the function is defined.

Failed to find any source warning in every project

I get Failed to find any source files using the glob "**/src/**/*.q,**/qcode*/**/*.q". Some feature will not be available. warning every time I open different folders in vscode. Can this extension be silent on the projects that don't have q code?

Tip: you can set activation point to opening q-lang file instead of traversing entire project.

Can't add non-localhost server

It seems that the newest update which changed the server create UI has a regression.

No matter what address I put in the hostname field, it always ends up creating the entry against 127.0.0.1. For example, if I choose 192.168.1.1 as the hostname and 6000 as the port, it will create it as 127.0.0.1:6000 and the connection will fail.

When I go back to re-edit, it shows a blank hostname with "localhost" as default text. I tried re-entering the hostname and then using create/update, but after submitting the issue persists and upon re-checking, the hostsname field continues to be empty.

Output tab autoscroll & query view location

Hi Jo,

Thanks again for the continuous help. I was wondering if it makes sense to you for the below features (let me know if I missed it and it's already there). Totally open to discussion and np at all if not feasible for this extension. :)

Bob

1. Is this possible to make the output tab autoscrolled to the bottom, which is similar experience with the terminal tab? This way user won't need to scroll down to see the results.
2. Do you think it's sensible and doable to have the query view located beneath the code editor e.g. being part of the tabs widget including output, terminal, ports and debug console? This way user can leverage the width of the screen better than having it on the right of code editor. This is especially useful when the table is wide. I thought about this from my experience with qstudio (http://www.timestored.com/qstudio/ see the picture under "query server").

Unable to connect to connect to q/kdb session on remote server

Hi Jo,

Thanks a lot for the great extension. I installed the 2.2.4 version (the latest version that is compatible with my VS Code ver 1.56.2 Windows PC at work), all features work fine (e.g. ssh to linux box, code highlighting, editing/saving files on the linux box, etc) except for connecting to q/kdb session launched on the same remote linux box.

I specified hostname/port/user/password in the dialogue to add server, and once I hit create, I got below error (actual contents in '[]' are omitted).

error accepting token gss major 589824 invalid token was supplied, gss minor 0 unknown error
gss error authenticating user
a connection failed with following information userhost`handle!([myusername];[myhost];[myhandle])

With another IDE kdbStudio, I verified that the host/port/username/password I put in are correct: if I set auth method to "username and password", I got exactly the same error as above. But if I set auth method to 'Kerberos', it connected to remote q session fine. So I was suspecting if it's the same auth method problem that caused the failure in connecting to q session with your extension.

Could you please kindly shed some light? And if it's indeed the auth method problem, would you be able to add Kerberos as an option for auth method, so user can not only specify host/port/username/password etc but also auth method ('username & pasword' or 'Kerberos')? Many thanks!

Bob

PS: one punch man rocks!

Alternative methods for sending queries

For example in a menu when right-clicking on a server or via toolbar button(s).

For comparison, KDB Studio has 3 different ways to choose what to send to the server using 2 different commands:

• The selected text (even if it cuts a word in half, only the selected part is sent) – Ctrl+E with text selected
• The whole content of the editor – Ctrl+E with no text selected
• The current line, ignoring selection – Ctrl+Enter

All 3 have their uses, e.g. full text to load an entire script into an empty q process, selected text to send a multiline function, and single-line to execute simple statements as it’s easier to put the cursor just somewhere on the line than selecting the line from start to end.

Missing extension ?

I think your recent change for customized auth requires jshinonome.vscode-q to be published to the marketplace.

When I attempt a server connection:
Customized Auth Plug(jshinonome.vscode-q-auth) is not found or not activated yet

server list -> wrong connection

i guess you are using label as unique id in the server list instead of tag + label...
so steps to reproduce:
I have
TAG1 -> myLabel->localhost:1444
TAG2 -> myLabel->remote host:1444

i will always connect to same server
as workaround i can use different labels

Unable to fetch variables

Hello,

recently (maybe since 2 weeks ago?) I just found that I kept getting the error notification saying "Unable to fetch variables from [my q port number]". Besides that, querying and everything else seem working just fine. I'm wondering if this is a known issue or maybe I'm missing something?

I don't have any major changes in q (company managed) or vscode so far as I know.

Is there any further information that I can provide to better diagnose this problem?

Support for .quke files

Would be good to get syntax highlighting and ctrl+* functions to work with .quke files.

Stretch goal would be to integrate the test results into the gui somehow.

Support to analyze loaded files

To analyze files loaded by

\l

system "l ..."

Dashboard mode

• support polling every seconds
  • save conf
  • load conf

Profile(Preview) for a table

aim to make a webview to show data profile like this
https://pandas-profiling.github.io/pandas-profiling/examples/master/features/website_inaccessibility_report.html

• only for a table variable
• all calculations in q

Lower minimum supported vscode version to 1.44

If possible...

Query view is empty

t:([]a:1 2 3 4 5; b:a1a1a3a4`a4)
t -> click Ctrl+Q here -> Query view will be empty

Highlight for attention doesn't work

Hello, thanks so much for your work.

Recently, I tried to highlight "attention" and "todo". I followed all the steps in https://github.com/jshinonome/vscode-q#enable-highlight-for-attention-and-todo-of-comments . But apparently, red attention highlight is not working for me.

Any suggestions? tyvm

Improve documentation

GIFs are not the best choice for presenting the functionality of the plugin in the readme. The best would be a series of screenshots, with (searchable) text in between that explains what is happening. But even an embedded video is better than a GIF because then you at least get to start/stop/rewind etc.