tiendil/feeds.fun

News reader with tags

Development for fun and profit

Old-school indie game developer & hacker. My languages are Russian & English.

Most of my career I develop games:

• For profit: Order of War, World of Tanks, Toy Defense (1, 2, 3), My Cafe.
• For fun: Сказка (github organization).

Interesting stuff about me:

• Have not attached to a single technology, can easily switch to the most appropriate stack for a current project.
• Can do a lot of things besides programming: game design, marketing, support, community development, etc.
• Actually, I operate my own hobby mini-MMO game, where I do almost everything.
• Check my blog for interesting essays: https://tiendil.org/ — someday I will translate it to English :-)

Have a good day. Feel free to contact me by email: [email protected] — I like to exchange letters.

Discord: 427884798099456010

feeds.fun's Issues

Support of mobile browsers

Chose ChatGPT with big or small context size, depending on the size of the analyzed text

Integrate isort

Filter news by feed

Possibly we should create a tag per feed

Remove building duplicated containers in docker-compose configs

Blog or RSS feed with the project news

Refactor the API endpoints

• names
• data structures

How to refactor will become clear when we implement basic functionality.

Type or properties for tags

Some tags may provide advanced functionality for interfaces.

For example:

• Tags with domains like example.com may be links to sites.
• Tags to feeds may lead to feed page.
• Some tags may lead to Wikipedia, a base of song lyrics, a book text, etc.
• There may be different rules to format & normalize tags, depending on their type. For example, domain tags may allow dots.

We should introduce types, properties or both for tags to support this.

Switch to function calls while working with ChatGPT

https://openai.com/blog/function-calling-and-other-api-updates

Add favicon

A beautiful favicon is very important!

Integrate mypy

For each news record, display site favicon or caption of the site/feed

Display errors in frontend GUI

When the frontend fails to login, it started calling `/supertokens/session/refresh` once per second

We should add some kind of progressive delay there.

Do not return secrets (OpenAI key) from settings back to frontend

It is enough to return an obfuscated version like abc***xyz

Interface to change user's email

Sort feeds in the feeds view

For a news entry highlight tags that are used to score it

It is inconvenient to think about new rules when you do not see which tags have already been covered by rules.

Change ChatGPT limits after recent OpenAI API update

https://openai.com/blog/function-calling-and-other-api-updates

Add link to API docs to the main page and to the top panel

OpenAI API key per-user to significantly save costs

Some processors work too long and block service from stopping

Sort rules in the rules view

LiveJournal RSS loading failed with non 200 HTTP status code

Search for unprocessed entries and try to reprocess them periodically

Display in GUI which processor produced which tag

It will be very helpful in evaluating the real effectiveness of fuzzy (ai/statistics) processors.

Tests for OpenAI key rotation functionality

Most of the tests are planned to implement later after the project's API become more stable.

But keys rotation is a critical functionality => we need to control its quality.

Tags filter: search tags by text

Tags that reflect cleanness of news caption

• Do it contain emoji?
• Do it contain a strange sequence of symbols, like #@$#@$?
• etc.

Show news for the past 3 days by default

This should allow more smooth experience.

Tags that reflect size of text

To be helpful, this feature needs:

• load a full article for a news entry
• extract an article body from the loaded page

=> Need to find a ready-to-use library to do so.

Show a column plot diagram about "how many news with each score exists" on the news view

It may be helpful to estimate the amount of interesting news.

Discovery logic does not see feeds from medium.com

Possibly, because we can not detect their format. For example, see: https://ajmmertens.medium.com/feed

Suggest new rules on base of likes/dislikes of news

Upgade supetokens to version 9.0.2

Resend magic link counter allows to send emails before it finished

Should be on the backend?

Currently, the counter has been resetting:

• after the page refresh
• after pressing "enter another email"

Reduce the size of answers from the backend

Add User-Agent header to content load requests

Normalization of feeds URLs and merging of duplicated feeds

Pagination for tags on the side panel

Integrate black

Tag "upper-case-title"

Or something like that.

Often TITLE WITH ONLY UPPER CASE LETTERS is a sign of a bad or not interesting post. It will be good to filter out such posts.

Save filters settings on backend

To migrate them between clients.

Fix pagination rendering of the news list when there are not enough news feeds for one page

Permanent tag synonyms

Some tags may be generated in different forms: plural & singular, different spellings, etc.

Examples:

• game, games
• c++, cplusplus, c-plus-plus

It is very inconvenient for navigation and rules.

For such tags, we should maintain a mapping of forms and apply it before storing tags in the database.

Todo:

• mapping
• command to apply mapping post-factum to existing database records

Note: possibly, there will be one more tags mapping mechanism, more dynamic. This task is only about permanent static mapping.

Styles for fronted GUI

Notes about the early development stage

• in README
• in site

What is possible:

• data loss
• functionality may change a stop working

Load only feeds that are needed at least by one user

Show somewhere information about maximum number of news entries that frontend can receive from backend

Count the number of processed news in addition to spend tokens