Comments (13)
Yeah, after checking the contents of the Nitter RSS the links you mentioned for hashtags and user mentions appear just like that on the body of the item.
Perhaps we can process them by applying some regular expressions to replace them for proper mentions and hashtags.
Same thing for <p>
and </p>
, we definitely need to transform those into newlines or something.
Regarding thread management, there's not much we can do on that side.
RSS feeds don't include enough info to know what tweet the original tweet was replying to, so threads are simply a no-go.
I'll change the title of this issue to reflect the Nitter RSS feeds improvements needed.
from pleroma-bot.
Well, fixed with this one : #119
Installing the latest version solved the problem.
Sorry for that duplicate post.
from pleroma-bot.
In fact I do have a problem. So I'm using Nitter as RSS Generator.
Here is the problem :
�[38;21mℹ 2023-02-03 21:02:01,869 - pleroma_bot - INFO - Processing user: 109801607888254816 �[0m �[38;21mℹ 2023-02-03 21:02:03,941 - pleroma_bot - INFO - Gathering tweets...20 �[0m �[38;21mℹ 2023-02-03 21:02:04,288 - pleroma_bot - INFO - tweets gathered: 1 �[0m �[38;21mℹ 2023-02-03 21:02:04,288 - pleroma_bot - INFO - tweets to post: 1 �[0m �[31;21m✖ 2023-02-03 21:02:04,288 - pleroma_bot - ERROR - Exception occurred for user, skipping... (cli.py:721) �[0m Traceback (most recent call last): File "/home/edelzone/virtualenv/python/pleroma/3.10/lib/python3.10/site-packages/pleroma_bot/cli.py", line 699, in main cw=tweet["cw"] KeyError: 'cw'
I have 3 accounts, all 3 accounts has this problem. If I switch to API import, it is working good.
Do you have any idea of what is causing this issue ?
from pleroma-bot.
Hi!
what version are you running now?
You can double-check by running:
pleroma-bot --version
from pleroma-bot.
I am using version 1.2.1rc18.
from pleroma-bot.
I am using version 1.2.1rc18.
Can you try running 1.2.1rc19
(like the issue you mentioned #119) and see if that is the problem?:
pip install -i https://test.pypi.org/simple/ --extra-index-url https://pypi.org/simple pleroma-bot==1.2.1rc19
from pleroma-bot.
Update done. I now have to wait for the next update attempt to see if it solves the problem.
I'll keep you informed.
from pleroma-bot.
So, it is now working but not as good as I wish.
See that toot : https://piaille.fr/@[email protected]/109805144529192489 compared to the original tweet on Twitter : https://twitter.com/Francois_Jobard/status/1621762492614443008
First, when a twitter account is mentionned, it is replaced with the full URL of that account on Nitter. It would be better to keep the full url as a link, but to replace the full url with the twitter format : @account. Same thing for a hashtag, on displaying only #hashtag instead of the full link. Also in both cases, theses links are currently displayed alone on a signe line, though they should not (see the tweet to compare).
Second, it woulb be great to offer a preview when a status of someone else is mentionned. If not possible, at least hide the <p>
and </p>
tag, and that time display the link of the status mentionned on a single line.
And at last, I still have the time offset problem I have using the API, mentionned here : #121
from pleroma-bot.
What value are you using on your config for that user as the rss
mapping?
I'd like to compare what the RSS feed contents are for that tweet.
from pleroma-bot.
I use this :
rss: https://nitter.inpt.fr/Francois_Jobard/rss
from pleroma-bot.
FYI, I changed the RSS source to RSSHub, it is cleaner and at least I don't have problem anymore with hashtag display. I'm still waiting to see what it will look like with mentions.
from pleroma-bot.
I have just switched back to API usage and I think I will remain, while API is working.
RSS Import is less reliable, tweets are not always sent to Mastodon, and thread management is better with the API : a thread in Twitter remains a thread in Mastodon. With RSS import, a thread in Twitter becomes separate toots in Mastodon.
from pleroma-bot.
With the api officially dead can we look at this again? I switched over to nitter rss and having this issue too but my nitter is behind an ip whitelist so the links are broken.
I can of course provide some funding if that helps
from pleroma-bot.
Related Issues (20)
- Pleroma bot is failing to pull tweets from a non-protected account HOT 4
- Just a dummy, maybe, question about upgrading Pleroma-Bot HOT 2
- Only thread replies? HOT 4
- SSLError - Option to skip checking/Max retries? HOT 6
- Failing to process tweets - multiple issues HOT 18
- Add support for GoToSocial HOT 9
- Implement recovering mechanism from network interruption HOT 3
- ERROR: Exception occurred for user HOT 4
- In light of changes to Twitter's API coming Feb 9 HOT 25
- Set custom timezone when using original_date HOT 1
- Original timestamp of tweet not used while importing from Twitter archive HOT 2
- Twitter archive -> Mastodon fails with "KeyError" HOT 2
- Incompability with Misskey v13.5.6+ HOT 3
- RSS Import: Issue with KeyError: 'cw' HOT 5
- error HOT 2
- HTTP 422 error for certain quote tweets HOT 2
- Possible to add media-only flag from mastodon-bot?
- Nitter RSS: Handle over-processed links and metadata HOT 7
- RSSHub RSS: Handle remaining Twitter URLs and metadata/encoding oddities HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pleroma-bot.