More abuse of this post for testing PieFed user mentions (sorry if you seeing this)

@[email protected]

I cry quite easily, so a small sample of films that have made my eyes misty are:

The Remarkable Life of Ibelin
Bridge to Terabithia
A Monster Calls

The 4K Blu-ray remux of Andor Season 1 is 230 GB. This new government might be shutting down the internet, but I doubt that they’re monsters, and so surely wouldn’t expect me to re-watch it in any lower quality. Fortunately, I’ve worked out that the Aldanhi arc and the last 2 episodes are 102 GB, so it should be manageable if some recaps are cut.

The crawler is normally aware of about 30k communities, but this has only listed about 9k for the past few days.

I messaged the maintainer of lemmyverse yesterday - he’s replied that he’s going to investigate what’s happened with the missing communities.

Ah, right - I see now thanks (it didn’t occur to me to click ‘show nsfw’).

As for the ‘oejwfiojwwqpofioqwfiowqiofkwqeifjwefwef’ - I remember them as being spam. It was maybe a year or so ago now, but a LW user tried creating communities with every name imaginable as way to squat on them. They got to about 2000 before they were stopped, and in retaliation they created about 4000 of the ‘wefwef’ ones (I guess that the deletion of them from LW didn’t make it somewhere, and so something out there still thinks they exist).

For movies and shows to a VPS, I’d install a command-line IRC client (like weechat) and get stuff using XDCC.

I used to have a bot that uploaded stuff to Google drive and mega for plebs on Reddit to download, and that what the bot used to get the content in the first place.

Yeah - if you click on the instances there, it shows one figure for communities, but only lists a small subset of that. lemmy.ml for example says 104, but only lists 14:

https://lemmyverse.net/instance/lemmy.ml/communities?order=posts

(the difference is even more extreme for lemmy.world)

I mentioned the other day that requests to walledgarden error (curl says ‘transferred a partial file’). If another instance doesn’t get a good response for these requests, then after 3 days, it’ll mark the other instance as dead, and not federate out to it. Once this happens, it’s a pain, because traffic from walledgarden doesn’t make them realise that it’s actually alive, you have to wait until it tries again and gets a successful response.

If you haven’t done so already, it might be an idea to use curl to query your site, and see what the response in nginx says.

There’s been a recurring federation delay between lemmy.ml and lemmy.world:
https://grafana.lem.rocks/d/cdfzs0dwal3pca/federation-health-time-behind?orgId=1&var-instance=lemmy.ml&var-remote_software=lemmy&from=now-30d&to=now&var-remote_instance=lemmy.world&timezone=browser

The LW admins are aware, but I don’t think they’ve yet nailed down the cause (it fixed itself yesterday, but has started again today). The same thing might be stopping the crawler from getting a full API response from them.

I have a test instance that’s subscribed to a couple of communities, but is quiet enough to be able to monitor federation, and if you do that, you realise that there are activities that are meant to happen, and just flat-out don’t. Other instances can recover (if they receive a reply for a post they don’t know about because LW forgot to Announce it, then they can fetch it instead), but it’s all a bit flaky, yeah.

Boo! the upstream crawler is still borked (up a tiny bit to 9k communities now).

You can’t, no. PieFed and Lemmy are operating in similar spaces, but are completely different architecturally. PieFed doesn’t yet have an API. Unlike Lemmy (and a lot of other modern web platforms), it doesn’t need one to operate, so copying Lemmy’s to the extent that you’d be able to plug in something like Voyager would be overkill. It would probably also be against the TOS for Voyager (Jerboa actively prevents it’s use with anything other than Lemmy, even if the API is the same).

Hmmm. Something hasn’t responded to the crawler (probably lemmy.world) - https://data.lemmyverse.net/ currently shows about 8k communities, when normally it shows 30k.

[email protected] seems interesting, and it only took me 4 months to find out about it. Dunno if the list of communities it covers is being updated anymore though.

The bot gets its data from https://lemmyverse.net - which isn’t aware of https://walledgarden.xyz. I don’t know why, but there’s a problem with the site that might be related - if you do curl -i --header 'accept: application/activity+json' --location https://walledgarden.xyz/ it errors with ‘transferred a partial file’ whereas it works for any other Lemmy server. It must have worked in the past though, 'cos I was able to subscribe and post to a community on there not long ago.

Ah, great, thank you. It’s been added as an Issue for PF now, with a link to this post, so that’ll be handy.

(I was likely misusing the term ‘regex’).

There was a post relating to this the other day: Some explicitly single-user ActivityPub software to check out

How does Piefed handle image attachments, btw?

For comments: not at all. If a Mastodon user tried to do what I did, with the inline image, nothing would show.

We could do what I think you’ve done, and regex the details of the attachment into ! [] () Markdown and add it to the text. There’s also a DB relationship between comments and images that isn’t used, but could be, I suppose.

I’ve never actually seen a Mastodon user try to add an image to something that ended up as a Lemmy comment, tbh, so it’s not something I’ve thought too much about.

I just tried with Masto - maybe there’s different versions, but it didn’t work with the one I tried.

Screenshot:

It’s probably for the best that this PR doesn’t also convert inline Markdown into an attachment to send out for Mastodon’s benefit, because then there would be the danger of apps that understand both showing two images. It’d be better if Mastodon did the translation when receiving stuff, but Mastodon doesn’t seem as good as MBIN when it comes to co-operating with Lemmy.

(edit: how that screenshot shows on MBIN is a bit disappointing though - at least looking at on the web)

Do they work the other way around btw? If someone on Lemmy uses the Markdown for an inline image do they show up on MBIN? I don’t they do on Mastodon.