• 2 Posts
  • 27 Comments
Joined 1 year ago
cake
Cake day: June 14th, 2023

help-circle
  • lol, just made the top level comment to say thank you. You nailed it! I may fool around with Tdarr to optimize my library. I’m working on my backup setup, so I’ll use Tdarr on a limited duplicate, but will also keep a full original. I’ve been slowly saving and getting hardware for two fully redundant systems on fiber. Overkill for plex, but I’ve been working to start archiving different family media, and don’t want to become family historian without offsite backups. I’m almost there and there should be enough space to “test drive” the conversion of the plex library without screwing anything up.




  • Thank you for the walkthrough! I was loosely familiar with how transcoding worked, but wasn’t sure if this specific library (tdarr) was coded in a way it became a “default” tool to replace plexs transcoding. My background is in small embedded systems for the most part, and I’ve gotten burned by tools which by default set themselves up to be the, well, default. I’m just used to dealing with much smaller pipelines/stacks.

    Based on another response it looks like the issue may actually be around some HDR formatting. I could see that as after I transferred the new machine was using a completely different hardware set, including GPU.

    Thanks to you and everyone for walking be through a new tool! If it is an HDR format issue, I imagine I may be able to use Tdarr to address it.


  • batmaniam@lemmy.worldOPtoPlex@lemmy.mlHow to screen a 20TB library for corrupted files?
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    1 month ago

    I certainly am not sure lol. I did try disabling the HDR tone mapping to no affect. It’s possible this is the issue as when I transferred the library, it was to new hardware with a different GPU.

    Is there a way to tell the color format from the file info?

    Thank you!

    Edit: I wanted to add context, as I think this may be the culprit. I initially transferred the files from one machine to another via filezilla. About a week after, we had a power outage, which screwed up the SSD that had the operating system (lesson learned about surge protectors). To get the Plex back and running quickly, I simply pulled the physical hard-drive, and popped it into a 3rd machine. So it does make sense to me that the file itself may be fine.

    edit2: @[email protected] you are definitely onto it! I just downloaded the file to another machine, and it played with no color issues. So my guess is it’s something to do with the GPU on the machine hosting plex?


  • Thanks for explaining, but I still want to make sure I understand the purpose of Tdarr. One thing I’ve noticed about tools like this is the documentation usually gets right into the “how” and skips over the “what and why”. So Tdarr transcodes a library with intention of a new, permanent output library? Is that correct? I’m used to transcoding in the context Plex does it: On the fly to serve to a client, and temporary.

    If my understanding is correct then maybe it’ll help address issues, but still an awesome tool to help optimize my library.

    Thanks for taking the time. Most of my coding background is mostly from monitoring and control, so I’m still learning a lot about the nuts and bolts of the whole stack that makes stuff like plex work.


  • I actually do have the torrent, files for a lot of them, but I’ve moved folders and I’m not really clear how that might affect things.

    By my guess it’s probably about 10% of the library that’s corrupted, so re-downloading them wouldn’t be the worst (I’ve already been doing it piece wise as they come up).

    While I’m not great with system level and IT stuff, I’m OK with coding. I’m debating writing a python script to get the average color of each video file, I’d bet there’s some libraries out there to help with that.







  • OK, I’m going to save you time because I do some controls and totally get how “easy” demand management should be given how simple most devices are.

    But WHAT?! Thats all built into the grid over there??? That’s AWESOME. Let me see if I have this right: there’s essentially a small transient frequency modulation in the 60hz(?) in the grid that allows devices to receive a “off” signal?

    I could be wrong but I’m 90% sure we’ve got nothing like that in the states. MAYBE there’s something like that for communicating with the meter itself but certainly not past the meter.




  • I mean… I don’t know if you’re an NFL fan or not but his stock isntly exactly high right now lol. He played like three snaps all season last season, is old for the game (for anyone not named “Tom Brady” anyway), and is wayyyy to much of a liability (and just to damn weird even if the crap he spouts WASNT dangerous) to do any kind of announcing or commenting.

    Hes crap in the locker room, having barley talked to Zach Wilson, the kid he left to play his whole season on a doomed team (I guess Zach does owe him a bit though, I really disliked the kid now I give him some respect for stepping aside then stepping up best he could). His career won’t be affected because random crap like this IS his career now. The jets have a contract, but there is no way Rodgers plays any meaningful football anymore.



  • Yes, sorry, I did oversimplify to the local network. On your local network everything is always listening, but absolutely your home router/modem in Kansas does NOT excite some wires in Tokyo unless you tell it to lol.

    And it sounds like you know way more about the software than I do, but I can say with confidence that when a router starts putting ossilating high/low on a cable, everything on that cable “sees” it. I’m fairly sure that’s why different address blocks have the limits they do; there’s only so many addresses you can have without needing to ossiclate that voltage stupid fast.

    You should look into some of the serial examples for raspberry pis/ arduinos, with your software background you’d probably really enjoy it! It’s funny to run into things like the fact that you can have issues like the wire not going back to low sometimes, and the myriad physical issues.

    And seriously check out MODBUS. It’s crazy how “simple” it is. With no handshake and a standardized data format, you can trigger all sorts of stuff. That’s the protocol that controls most people industrial things, including GIANT pumps and valves.


  • I wrote up a whole thing that didn’t post. There’s good answers here but I think that, like me, you wanted a more “voltage based” one.

    Short answer is they don’t. Everything on the network is always listening, and security is based solely off of a handshake. Everything is always employing a fancy multimeter that measures voltage high/low as a 1/0 turning it from bits to bytes etc. The router listens to that and decides where to send it upstream, which it isolates from downstream.

    For a realllllly basic example look at the modbus protocol. That’s also why industrial equipment folks get real touchy about network access. For things like computers, theres talk back and forth to verify. Modbus is just “if the byte is the thing I do the thing”. But fundamentally, that’s the physical basis: all devices are always listening, the TCP/IP stack is what tells them what to disregard.