muety/anchr

⚓️ Anchr provides you with a toolbox for tiny tasks on the internet, especially bookmark collections

anchr's Issues

Pagination

Chrome/Firefox bookmark import

This would be a lifesaver! I'm been on the look out for a bookmark server so that i can import my chrome bookmarks (I have ~5000). Anchr does just that, except for the bookmark import.

Is chrome/firefox bookmark import on the horizon? This would also entail folder capability for the bookmarks.

• Import netscape compatible bookmarks (chrome/firefox).
• Flatten folder hierarchy to 1 level.
• Tags.

Make the WebExtension work for Chrome

Although the WebExtensions standard itself is compatible with Chrome, there are various issues that still need to be solved. The extension can be loaded in Chrome, but the following problems occur when using it:

• Options be clicked
• Settings can't be saved
• Probably everything else wouldn't work as well, as it seems that the global browser variable is missing in Chrome.

Support for Basic auth

Add ESLint for backend

Webext: Not working with multiple browser windows

With two browser windows open, the plugin will always read URL and title of the tab that is currently active in the first window.

Switch from `crypto-js` to Web Crypto API

Why?

• No extra dependency required anymore
• CryptoJS' used KDF is considered insecure (see comment below)

---

• https://github.com/diafygi/webcrypto-examples/#aes-gcm
• https://bradyjoslin.com/blog/encryption-webcrypto/
• https://github.com/AKASHAorg/easy-web-crypto

Research client-side encryption

Any suggestions on how to get started here?

Make Google and Facebook logins optional

Show loading indicator while fetching link descriptions

Integrate with image proxy

https://gitlab.com/ramiel/caravaggio

Add context menu entry for web extension

Right click on link -> Save Link to Anchr -> Bring up Anchr extension popup

Introduce API keys

Can't upload files if upload directory is on different partition than temp dir

Original issue: #26

req: ***.***.**.*** POST /api/image  5f427aa90a39630017365047 500 EXDEV: cross-device link not permitted, rename '/tmp/5UZfoKaIBM5ZIDvmBLD1t4Yq.jpg' -> '/var/data/anchr/ChxdP.jpg' Error: EXDEV: cross-device link not permitted, rename '/tmp/5UZfoKaIBM5ZIDvmBLD1t4Yq.jpg' -> '/var/data/anchr/ChxdP.jpg'

More details: https://stackoverflow.com/a/43206576/3112139

Expose basic metrics via Prometheus interface

Use prom-client to expose metrics like:

• Total number of users
• Total number of collections
• Total number of links in collections
• Total number of shortlinks
• Total number of uploaded images (plain, encrypted)
• Total disk space volume occupied by images

Properly handle config variables

Currently, configuration variables, including credentials etc., are stored in config/*.js files. Since that's not a good practice at all, configuration needs to be done in another way. My suggestion is to use https://github.com/motdotla/dotenv.

Anchor.io is flagged by Malwarebytes Chrome Extension

Env variable batch script for Windows

I'd like to have a batch script that is equivalent to env.sh to read environment variables from .env and sets them for the current user session. However, I am totally not familiar with batch syntax, so a little help would be great here!

Ability to rename collections

Compact log messages

/remote endpoint logs while error objects when DNS couldn't be resolved (Error: getaddrinfo ENOTFOUND) instead of just a simple info or warning message.

Ability to delete one's account

Account activation

... using e-mail links

Show loading spinner while resolving website title of new link

When typing or pasting a new link for a collection, a call to /api/remote/page is issued to make the backend crawl the website's HTML title attribute. While this request is pending, a small loading spinner should be shown next to the link description input field to give the user clearer feedback.

Mongo 5.x support

Conditionally hide login provider buttons if disabled

Hit counter for shortlinks

Ability to change user password

Make Google Safe Search optional

Image upload error from Google Photos on mobile

Need to investigate

Swagger docs

Integrate Swagger (or OpenAPI) specification to allow API to be consumed by third-party applications.

https://dev.to/acanimal/express-api-with-autogenerated-openapi-doc-through-swagger-7na

Unable to shorten links or upload images

I get errors when I try to shorten links or upload images, I am able to add links to collections though.

This is the error from the server logs when I try to upload an image

req: ***.***.**.*** POST /api/image,
req: ***.***.**.*** POST /api/image  5f427aa90a39630017365047 500 EXDEV: cross-device link not permitted, rename '/tmp/5UZfoKaIBM5ZIDvmBLD1t4Yq.jpg' -> '/var/data/anchr/ChxdP.jpg' Error: EXDEV: cross-device link not permitted, rename '/tmp/5UZfoKaIBM5ZIDvmBLD1t4Yq.jpg' -> '/var/data/anchr/ChxdP.jpg'

and the error when I try to shorten a link

req: ***.***.**.*** POST /api/shortlink,
res:  ***.***.**.*** POST /api/shortlink  5f427aa90a39630017365047 500 Something went wrong.Error: Request failed with status code 403

IP removed for privacy.

Backend code refactoring / cleanup

• Better modularity
  • Currently, most logic is contained inside controllers, which also define the REST interface at the same time. Business logic and presentation logic are strongly interleaved, which makes it super hard to be reused. Some parts methods are outsourced to controllers/utils in a quite hacky way and without following a common interface.
• Refactor to modern ES6-style JavaScript syntax (requires #53)

Prevent `remote` endpoint from running into redirect loops

If /api/page did a call to itself with itself as a lookup URL, it would probably end up in recursion. Simplest solution is to just filter URLs that match that endpoint.

Generalize images uploads to file uploads and allow any kind thereof

Switching to pre-loaded collection shows out-dated data

• Delete a link from a collection
• Switch to a different collection
• Switch back
• -> link is still shown, unless refreshed -> just disable cache when switching collections

Server-side filtering of collections

Show placeholder text or icon in empty collections

Maybe something from undraw.co.

Error while running 'npm run build'

While running 'npm run build', an error occurred. How can I fix this error?

Loading "cdnify.js" tasks...ERROR
>> ReferenceError: primordials is not defined
Warning: Task "cdnify" failed. Use --force to continue.

Aborted due to warnings.


Execution Time (2019-06-11 06:23:33 UTC-7)
loading tasks             224ms  ▇▇▇▇ 9%
wiredep:app               133ms  ▇▇▇ 5%
wiredep:test               30ms  ▇ 1%
loading grunt-usemin       29ms  ▇ 1%
concurrent:dist           694ms  ▇▇▇▇▇▇▇▇▇▇▇▇▇ 27%
loading grunt-postcss      35ms  ▇ 1%
postcss:server            233ms  ▇▇▇▇▇ 9%
postcss:dist               42ms  ▇ 2%
concat:generated           84ms  ▇▇ 3%
loading grunt-google-cdn  987ms  ▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 38%
Total 2.6s

npm ERR! code ELIFECYCLE
npm ERR! errno 3
npm ERR! [email protected] build: `cd public && grunt build && cd ..`
npm ERR! Exit status 3
npm ERR! 
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /srv/anchr/.npm/_logs/2019-06-11T13_23_35_790Z-debug.log

• /srv/anchr/.npm/_logs/2019-06-11T13_23_35_790Z-debug.log

0 info it worked if it ends with ok
1 verbose cli [ '/usr/bin/node', '/usr/bin/npm', 'run', 'build' ]
2 info using [email protected]
3 info using [email protected]
4 verbose config Skipping project config: /srv/anchr/.npmrc. (matches userconfig)
5 verbose run-script [ 'prebuild', 'build', 'postbuild' ]
6 info lifecycle [email protected]~prebuild: [email protected]
7 info lifecycle [email protected]~build: [email protected]
8 verbose lifecycle [email protected]~build: unsafe-perm in lifecycle true
9 verbose lifecycle [email protected]~build: PATH: /usr/lib/node_modules/npm/node_modules/npm-lifecycle/node-gyp-bin:/srv/anchr/node_modules/.bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
10 verbose lifecycle [email protected]~build: CWD: /srv/anchr
11 silly lifecycle [email protected]~build: Args: [ '-c', 'cd public && grunt build && cd ..' ]
12 silly lifecycle [email protected]~build: Returned: code: 3  signal: null
13 info lifecycle [email protected]~build: Failed to exec build script
14 verbose stack Error: [email protected] build: `cd public && grunt build && cd ..`
14 verbose stack Exit status 3
14 verbose stack     at EventEmitter.<anonymous> (/usr/lib/node_modules/npm/node_modules/npm-lifecycle/index.js:301:16)
14 verbose stack     at EventEmitter.emit (events.js:200:13)
14 verbose stack     at ChildProcess.<anonymous> (/usr/lib/node_modules/npm/node_modules/npm-lifecycle/lib/spawn.js:55:14)
14 verbose stack     at ChildProcess.emit (events.js:200:13)
14 verbose stack     at maybeClose (internal/child_process.js:1021:16)
14 verbose stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:283:5)
15 verbose pkgid [email protected]
16 verbose cwd /srv/anchr
17 verbose Linux 4.19.0-5-amd64
18 verbose argv "/usr/bin/node" "/usr/bin/npm" "run" "build"
19 verbose node v12.4.0
20 verbose npm  v6.9.0
21 error code ELIFECYCLE
22 error errno 3
23 error [email protected] build: `cd public && grunt build && cd ..`
23 error Exit status 3
24 error Failed at the [email protected] build script.
24 error This is probably not a problem with npm. There is likely additional logging output above.
25 verbose exit [ 3, true ]

anchr.io blocked because "Malware Domain"

When i try to open anchr.io with ublockOrigin in chrome, it loads only the HTML, all JS and CSS are blocked. When i look it up in ublockOrigin's console, it says "Domain ||anchr.io^ found in https://www.malwaredomains.com/" therefore i can't open it (it works with deactivated ublockOrigin though)

As this is probably not expected behavior, someone has probably hacked your site and distributed (or is distributing) malware within...

Include MongoDB service in Docker compose file

docker-compose.yml should define a Mongo service that is linked to the anchr service. Also, a user and a database should be set up properly.

Telegram bot

Telegram bot as an interface to Anchr, covering all features:

• List collections, e.g. /list
• List links of particular collection, e.g. /list <id> [search|
• Add links to collection e.g. /add <url> [description]
• Shorten links, e.g. /shorten <url>
• Upload images, e.g. just send the bot a picture

Loosely inspired by https://www.producthunt.com/posts/sendtoemail

Global search endpoint

Endpoint to search all collections for a given text. Relates to #19.

Properly clear localStorage on logout

Remove selectedCollectionId key from localStorage when logging out.

Check URLs against additional blocklists

In addition to SafeBrowsing API.

• Phishing Army: https://phishing.army/download/phishing_army_blocklist_extended.txt
• uBlock Badware: https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/badware.txt
• Curben: https://curben.gitlab.io/malware-filter/phishing-filter.txt

Dockerize

Shortlink support for browser extension

Can't edit collection

Dialog to edit collection name, etc. immediately disappears again.

ShareX example configurations

for link shortening and image uploads.

See https://github.com/raftario/filite#link.

Limit number of displayed links and add inifinite scrolling

Only load 50 links by default and keep reloading more as the user scrolls down the list. Client-side filtering will be broken, therefore, this issue depends on #19.

Replace deprecated MongoDB methods

when I treid to add a new link to collection, an error occurred as below:

[2019-06-11 10:03:43.856] [ERROR] defaultLogger - RES: 203.141.134.112 POST /api/collection/Q
5Fga/links 5cffd9e449a8f92230e6fd56 500 Unknown modifier: $pushAll MongoError: Unknown modifi
er: $pushAll
    at Function.MongoError.create (/srv/anchr/node_modules/mongodb-core/lib/error.js:31:11)
    at toError (/srv/anchr/node_modules/mongoose/node_modules/mongodb/lib/utils.js:114:22)
    at /srv/anchr/node_modules/mongoose/node_modules/mongodb/lib/collection.js:985:67
    at /srv/anchr/node_modules/mongodb-core/lib/topologies/server.js:780:13
    at Callbacks.emit (/srv/anchr/node_modules/mongodb-core/lib/topologies/server.js:95:3)
    at Connection.messageHandler (/srv/anchr/node_modules/mongodb-core/lib/topologies/server.js:249:23)
    at Socket.<anonymous> (/srv/anchr/node_modules/mongodb-core/lib/connection/connection.js:265:22)
    at Socket.emit (events.js:198:13)
    at addChunk (_stream_readable.js:288:12)
    at readableAddChunk (_stream_readable.js:269:11)
    at Socket.Readable.push (_stream_readable.js:224:10)
    at TCP.onStreamRead [as onread] (internal/stream_base_commons.js:94:17)

I had the same error on both Mongo 3.6 and Mongo 4.0.10