richasy/fantasycopilot

A new-age AI desktop tool

Richard Zhang - @Richasy

Hello, I am a software developer, currently mainly developing Windows applications.

Willing to develop beautiful and practical applications to help you live a happier life 🎉🎉

Application List

🤖 Rodel Agent : A new-age AI desktop tool

⏬ Rodel Downloader : AI model downloader for Hugging face, Model Scope and Civitai

📺 哔哩 : Bilibili's third-party application

📖 Reader Copilot : Desktop reader with support for local and online books, RSS and podcasts

🎮 Warframe Alerting Prime : Information notification application developed for Warframe

🪐 Loopback Manager : Local network loopback manager.

📝 Markdown Lite : Markdown editor.

🎬 Eyepetizer : Eyepetizer (开眼) third-party applications.

⏱ Work Timer : A simple timer.

🛠 Rich Box : Toolbox with some interesting tools.

About me

Get in touch

• E-Mail: [email protected]
• BiliBili: 云之幻

fantasycopilot's Issues

[Bug] 启动时崩溃

Bug description

初次启动时崩溃

Reproduce steps

1. 在微软商店下载小幻助理
2. 打开小幻助理
3. 出现如图所示的情况

Expected behavior

出现正常的画面

Screenshot

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Tablet

Remark

No response

[Feature] Knowledge base supports continuous dialogue

Description

Currently the knowledge base only supports a single round of dialogue, but sometimes we can't ask questions accurately, which may require incremental questions.

Solution

Let the knowledge base support multiple rounds of dialogue (or fake multiple rounds of dialogue)

Plan B

No response

Additional

The biggest difference between knowledge base question answering and general question answering lies in the additional context. The context is often very long. If the context obtained by each question is spliced, it is easy to exceed the token window. This requires a trick

商店页面打不开了，Store里也搜索不到了

RT

[Bug] 在使用bingo作为api时知识库会出现报错

Bug description

在使用[https://github.com/weaigc/bingo/]时报错

Reproduce steps

稳定报错

Expected behavior

applog.2023-11-13.log

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

No response

Remark

No response

[Bug] 阅读助理的翻译功能无法链接小幻助理

Bug description

阅读助理在阅读rss的时候，鼠标选取文段翻译和全篇翻译都无法使用，在小幻助理中百度翻译是正常使用的，还有小环助理在导入导出配置的时候会出现“已取消操作，因为无法验证是本人”的字样

Reproduce steps

1.打开阅读助理 2.打开一篇有英文的rss 3.鼠标选取一段英文右键使用翻译功能 4.server链接不上

Expected behavior

希望能够正常使用翻译功能

Screenshot

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

23H2

Device

Desktop

Remark

No response

[Bug] 修改知识库库名之后不会反显到列表

Bug description

修改知识库库名之后不会反显到列表

Reproduce steps

1. 创建知识库
2. 修改知识库库名

Expected behavior

列表显示更新之后的库名

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

[Feature] Improve openai proxy services

Description

To support the Proxy OpenAI service, a lot of SK's redundant code has been copied. We can use OpenAI proxy services in a more concise way.

Solution

We can use HttpClient's HttpMessageHandler to intercept and override the OpenAI address as the proxy address.

Plan B

No response

Additional

microsoft/semantic-kernel#1445 (comment)

不支持win10 是吗

Bug description

不支持win10 是吗

Reproduce steps

不支持win10 是吗

Expected behavior

不支持win10 是吗

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

需要全局开启VPN吗

Bug description

你好，需要全局开启VPN吗？我使用虚拟机进行安装，能上谷歌，但是小幻用不了

Reproduce steps

1、在虚拟机上安装win11和小幻
2、开启全局代理
3、小幻服务不响应

Expected behavior

成功返回聊天内容

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

No response

Remark

No response

[Feature] Support for exporting cue words and session history

Description

Export configuration can contain custom prompt words and history of sessions

Solution

Write prompt and session history related content in the configuration file

Plan B

No response

Additional

No response

[Bug] 托盘图标是没了吗？

Bug description

勾选关闭时隐藏，关闭后在系统托盘找没到托盘图标

Reproduce steps

1. 勾选关闭时隐藏
2. 关闭面板

Expected behavior

点击托盘图标重新打开面板

Screenshot

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

[Feature] 添加文档翻译功能

Description

增加文档翻译功能

Solution

https://github.com/MicrosoftTranslator/DocumentTranslation

参照这个微软官方仓库，增加文档翻译功能

Plan B

No response

Additional

No response

[Feature] Support Dall-E 2 as image service

Description

I'm not familiar with StableDiffusion, and I don't have the service. But OpenAI's DALL-E 2 seems to provide a similar service, and semantic-kernel has support for it. Can we make DALL-E 2 optional as image service?

Solution

https://github.com/microsoft/semantic-kernel/blob/main/samples/dotnet/kernel-syntax-examples/Example18_DallE.cs

https://github.com/microsoft/semantic-kernel/blob/main/samples/notebooks/dotnet/07-DALL-E-2.ipynb

Plan B

No response

Additional

No response

[Feature] Allow users to choose whether to exit directly after closing the window

Description

Now, when the user closes the window, the application defaults to keeping the instance and minimizing it to the system tray. This may not be an appropriate user experience.

Solution

Provide an option for users to choose to exit the application upon closing the window.

Plan B

No response

Additional

No response

[Feature] Unlimited dialogue

Description

When the chat reaches the token window, the session cannot continue unless the user manually deletes some history records, which is obviously not friendly for long-term conversations

Solution

An ideal solution would be to store earlier histories as vectors and append them as optional context in subsequent conversations, which minimizes the loss of information.

Plan B

Vector conversion requires the support of embedding, and additional costs will be incurred. As an alternative, we could automatically remove older information when the token limit is reached.

Additional

No response

[Feature] Support for portable version of everything

Description

I use scoop to install everything. It is a portable version, not registered in the registry.

Solution

Just like Flow-Launcher, first check if Everything is running. If an exception occurs, it is the service that says "Not available and must be installed or run manually".

https://github.com/Flow-Launcher/Flow.Launcher/blob/936d2b7e3437109c8918004a0776ac8b6baac29a/Plugins/Flow.Launcher.Plugin.Explorer/Search/Everything/EverythingSearchManager.cs#L62

https://github.com/Flow-Launcher/Flow.Launcher/blob/936d2b7e3437109c8918004a0776ac8b6baac29a/Plugins/Flow.Launcher.Plugin.Explorer/Search/Everything/EverythingAPI.cs#L54-L68

Plan B

No response

Additional

No response

[Bug] In the code block, selecting text does not synchronize the scrollbar.

Bug description

When the code returned by ai is long, I want to copy a section of it, but the code is too long to be fully selected

Reproduce steps

1. open the app 
2. ask code related questions and let ai generate the code 
3. mouse to select a single line of longer code

Expected behavior

横向滚动条跟随鼠标选中位置移动

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

No response

Remark

No response

[Feature] 标记创建失败的知识库，释放db文件占用

Description

1. 部分知识库会出现创建失败的情况，希望可以对其进行标记。以便重新导入之类的操作
2. 删除展示库时，如果尝试删除对应的db文件，会提示占用，希望可以在删除知识库时取消占用。

Solution

1. 标记失败知识库
2. 删除知识库时，取消占用对应文件

Plan B

No response

Additional

No response

[Feature] Integrate Voice Service into Prompts and Sessions

Description

This feature request is to consider adding an option to Prompts and Sessions that automatically feeds it to the existing voice service. This would allow users to hear the output from the text AI model.

Solution

The proposed solution is to integrate the existing text-to-speech service into the Prompts and Sessions functionality. The output from the text AI model would be automatically fed into this service, and the resulting audio would be played to the user (assuming they both enable a relevant setting and have a valid TTS token setup)

Plan B

No response

Additional

This feature could potentially be expanded in the future to include voice input as well, allowing users to interact with the AI model using speech in addition to text.

[Bug] Window truncation issues on small screens

Bug description

Windows may extend beyond the screen area on low resolutions or on smaller screens with higher zoom ratios

Reproduce steps

1. 1920*1080 screen
2. Set scale to 200%
3. Launch app and observe result.

Expected behavior

Does not exceed the screen

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop, Tablet

Remark

No response

[Feature] MacOS support pls!

Description

MacOS support pls!

Solution

MacOS support pls!

Plan B

No response

Additional

No response

[Bug] OpenAI 代理无法正常工作

Bug description

在设置了自定义代理后，发现无法使用 openAI 服务。
B 站的介绍视频，对于代理设置这里是一句话带过。
估计可行的是，操作系统设置全局代理，然后软件设置里留空。但这意味着放弃了软件本身的代理设置。

Reproduce steps

1、进入设置界面，设置 openAI 的可选代理
2、切换到对话框界面，输入文字
3、界面返回 400 错误提示
4、再次重试，问题依旧
5、界面也提示下载模型失败

Expected behavior

期待是软件里设置代理后，app 可以正常使用。

经过尝试:
KernelService.cs 里，重载了SendAsync ，如果设置了代理，这里就直接修改了 URL 地址，导致失败。

一种解决方式，对于 KernelService.cs 文件：
1、移除ProxyOpenAIHandler 这个类
2、（可选）AddOpenAIService 这个方法里，判断了 hasCustomEndpoint 如果设置了代理地址，但是格式不对，是不是 UI 给个提示，或者在设置界面里输入时就判断。
3、这里是关键，AddOpenAIService 这个方法里，修改 customHttpClient 的初始化逻辑，同步调整为 var customHttpClient = hasCustomEndpoint ? new HttpClient(new HttpClientHandler { Proxy = new WebProxy(customEndpoint) }) : default;
也就是说，这里简单设置 Proxy 为自定义的代理地址即可，不需要第一步里的类
4、GetSupportModelsAsync()这个方法里尝试去下载模型数据，由于未设置代理，会导致下载失败，可以修改为
client = new HttpClient(new HttpClientHandler{ Proxy = new WebProxy(_settingsToolkit.ReadLocalSetting(SettingNames.OpenAICustomEndpoint, string.Empty)) });
需要说明的是，原始代码里，client 是给 Azure 和 OpenAI 共用的，所以这里要看看怎么搞，对于 OpenAI 从配置里读。

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

No response

Remark

很抱歉以 issue 的方式来描述，实在是水平太次了，无法以 PR 的方式贡献代码。

Unable install and build on Windows 10

Bug description

System.TypeInitializationException
HResult=0x80131534
Message=The type initializer for 'WinRT.ActivationFactory1' threw an exception. Source=Microsoft.Windows.AppLifecycle.Projection StackTrace: at WinRT.ActivationFactory1.As(Guid iid)
at Microsoft.Windows.AppLifecycle.AppInstance.Make___objRef_global__Microsoft_Windows_AppLifecycle_IAppInstanceStatics()
at Microsoft.Windows.AppLifecycle.AppInstance.get__objRef_global__Microsoft_Windows_AppLifecycle_IAppInstanceStatics()
at Microsoft.Windows.AppLifecycle.AppInstance.FindOrRegisterForKey(String key)
at FantasyCopilot.App.Program.Main(String[] args) in C:\Users\Rahul\Source\Repos\FantasyCopilot\src\App\Program.cs:line 22

This exception was originally thrown at this call stack:
System.Runtime.InteropServices.Marshal.ThrowExceptionForHR(int)
WinRT.BaseActivationFactory.BaseActivationFactory(string, string)

Inner Exception 1:
COMException: Class not registered (0x80040154 (REGDB_E_CLASSNOTREG))

Reproduce steps

1. Clone repo and open in visual studio
2. Select Unpackaged build target
3. Run

Expected behavior

1. App should install
2. Souce should build

Screenshot

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

19045

Device

No response

Remark

No response

[Bug] 退出确认窗口反复弹出

Bug description

在确认关闭弹窗中取消勾选“不在询问我”后，弹窗会一直反复弹出，直到我勾选。

Reproduce steps

1. 从winstore全新安装
2. 直接右上角关闭
3. 不勾选“不再询问我”
4. 点击“退出”
5. 弹窗再次出现

Expected behavior

应该可以退出，而下次我再点击时再弹窗。

Screenshot

xiaohuanzhuli.mp4

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

[Feature] Provide support for Open AI proxy

Description

Accessing ChatGPT in restricted areas such as China has a relatively high probability of being blocked, so some proxy services have been created.

These proxy services do not change the data structure of Open AI, but only provide a network proxy.

Supporting this kind of proxy helps to expand the impact of the application.

Solution

Support connection proxy service

Plan B

No response

Additional

No response

[Feature] Support for displaying message responses in typewriter mode

Description

One of the impressive things about using GPT comes from its unique way of generating responses, we call it typewriter mode, supporting this mode allows us to get responses faster.

Solution

Get the response verbatim, and show a gradual completion effect on the UI

Plan B

No response

Additional

No response

Make main window resizable

Description

At the moment the main window of the program have a fixed witdth and height. Depending on the resolution and composition of the users desktop this might not be ideal in all cases.

Solution

It would be nice if the main window was resizable, preferebly by draging the edges of the window, just like most other Windows programs.

Maybe a lower limit have to be set for the width and height of the window so that the UI elements still look ok.

Plan B

I think the above solution probably is easier to implement. But if you for some reason don't want it that way, another option is to set the window size from a config file.

Additional

Thank you :)

[Bug] 解决方案Configuration 错误

Bug description

启动项目后，VS 提示 “Current solution contains incorrect configurations mappings. It may cause projects to not work correctly”

Reproduce steps

1、签出项目
2、VS 2022 打开解决方案
3、VS 提示配置错误
4、配置管理器里，切换 Service.Desktop 为 Any CPU 无效

Expected behavior

1、针对 AnyCPU 架构，所有的项目均配置为 AnyCPU，无论是 Debug，还是 Release
2、针对 x64 架构，所有的项目均配置为 x64，无论是 Debug，还是 Release
3、App 项目的 PublishProfiles 目录下，新增一个win10-AnyCPU.pubxml，以解决 AnyCPU 架构无法发布的问题
4、App 项目的 PublishProfiles 目录下，修改 launchSettings.json 文件，移除里面的 Remote 调试相关信息。这一项猜测似乎是作者的本地调试使用产生。
5、（可选）项目里都使用 .net 7 了，建议是否可以升级项目里的一些 .netcore 的项目，尽量保持技术栈的统一，可以少安装一些 SDK 包。

Service.Desktop 的项目文件似乎有点问题，无法基于 x64 生成 AnyCPU 后切换成功。以前碰到过类似的现象，不知道是不是 VS 的问题。

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

No response

Remark

根据目前掌握的信息看，无论是 win10 还是 win11，除非刻意，普通用户几乎没有机会使用 x86 架构的系统的了，买回来的电脑基本都是64位的系统。看起来作者是时代弄潮儿，所以建议考虑移除x86的配置项，以保持项目简洁，纯建议。

[Feature] 对话支持渲染markdown

Description

现在对话中返回的用```包裹的代码块还是纯文本的方式渲染的，这样效果不怎么好

Solution

https://learn.microsoft.com/en-us/windows/communitytoolkit/controls/markdowntextblock
https://github.com/xoofx/markdig
可能有用的参考资料，

Plan B

No response

Additional

No response

[Feature] Cross-platform application (WEB)

Description

I'm interested in having a web-based version of the Fantasy Copilot. As a potential user, I'd like to access Fantasy Copilot features from any device with an internet connection without needing to install the application on every device. This will increase its accessibility and usability for a broader range of users.

Solution

My ideal solution would be to create a fully responsive web application that replicates the functionality of the current desktop app. This would include integrating the same AI services, maintaining the personal assistant tool and large language model at its core, and ensuring it has the same scalability. This web application should work seamlessly on different devices and screen sizes.

Plan B

A second option could be to create a light version of the web application that contains the most essential features. For example, it could include the chat, prompt management, and session management features. As time and resources allow, the application can then be expanded to include other features.

Additional

No response

[Bug] 生成回答的过程中，如果浏览对话历史后尝试滚动到最底部，会偶现无法滚动到最底部的情况

Bug description

生成回答的过程中，如果浏览对话历史后尝试滚动到最底部，会偶现无法滚动到最底部的情况。
生成回答成功之后，可以正常滚动到最底部。
一般在对话10次以上之后，出现的几率变大

Reproduce steps

1. 进行多次问答之后
2. 发起问题，在等待回答相应时，滚动浏览历史
3. 尝试滚动到底部

Expected behavior

1. 列表可以正常滚动

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

[Feature] 使用本地的Embedding能力

Description

大规模使用OpenAI或者Azure OpenAI的Embedding接口，成本太高。

Solution

可以采用替代的方案
https://github.com/chenrensong/Embedding
https://github.com/chenrensong/SS.SemanticKernel.Extensions

Plan B

No response

Additional

No response

[Feature] Add an option to set the api_version for Azure OpenAI

Description

I'm attempting to use the HKUST's Azure OpenAI service (doc link), which only supports some specific API versions. If other API versions are used, it will result in a 404 error.

2023-05-15

2022-12-01 (although this version is listed in the docs...):

Solution

The KernelBuilder from semantic-kernel accepts a config object containing the API version.

https://github.com/Richasy/FantasyCopilot/blob/491f18a75830dd45d421891a90bdb1c26eb6b5a2/src/Services/Services.Desktop/KernelService/KernelService.cs#L188C27-L188C57

https://github.com/microsoft/semantic-kernel/blob/d70bd6b3aeff651214f036435175449128d68bd3/dotnet/src/Connectors/Connectors.AI.OpenAI/OpenAIKernelBuilderExtensions.cs#L341

Plan B

No response

Additional

No response

[Bug] 工作流中英译中不完整

Bug description

英文问答结果输出后翻译回中文时只会翻译第一句，后面的内容会被吞

Reproduce steps

用的是百度翻译的api，输入先中译英，英文回答后，再英译中

Expected behavior

希望能修复，全部翻译

Screenshot

No response

Application source

• Microsoft Store
• Github
• Others

Other sources

No response

System version

• Windows 11 21H2 (Build 22000)
• Windows 11 22H2 (Build 22621)
• Others

Other system versions

No response

Device

Desktop

Remark

No response

[Feature] 希望可以配置自定义HTTP/HTTPS/SOCKS软件代理

Description

目前软件采用仅openAI API代理的方式，我通过cloudflare和自定义域名进行达到了此访问的目的。
But：提示词库的在线获取仍然无法访问，其他有网络访问困难的服务也无法调用。
PS：不单独提issue了，希望支持自定义Prompt提示词。

Solution

配置自定义HTTP/HTTPS/SOCK软件代理，涉及网络请求的全部使用代理。

Plan B

为每一种服务增加自定义API代理 QWQ

Additional

No response

[Feature] 支持窗口位置记忆功能

Description

当使用这种工具类的软件时，他更多的是一种辅助，我并不想让他影响到我当前视野内的主任务，所以我更习惯以将他放置在屏幕的侧边，或者你觉得你顺手的位置。

Solution

记录上次窗口的位置，可选打开时在屏幕**还是上次的位置

Plan B

No response

Additional

No response

[Feature]能否增加多模型切换的功能

Description

能否增加多模型切换的功能,谢谢开发者

Solution

增加多模型切换的功能

Plan B

No response

Additional

No response