Alt account of poVoq@slrpnk.net here.

Our instance is currently down and I can’t get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can’t work around remotely.

I am still trying a few things, but I am not very optimistic that I can get access.

The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can’t access it physically during the next few weeks and my usual back up that could restart it is not available either.

As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy’s law seems inescapable 😓

I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing 😥

Edit: we might use this “opportunity” to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.

    • Draconic NEO
      link
      fedilink
      English
      11 day ago

      Yeah me too, I’d wanted to for a while but never got around to it. Now I probably never will (unless they get the servers back up at some point in the future).

    • threelonmusketeers
      link
      fedilink
      English
      12
      edit-2
      2 days ago

      communicative about issues

      Aren’t most admins this way?

      *glances at your instance name*

      Ah…

      • @grysbok@lemmy.sdf.org
        link
        fedilink
        English
        9
        edit-2
        2 days ago

        Lol. Yeah, sdf.org feels pretty hands-off. They have longevity going for them–I’ve had an sdf account of some sort since 2009 at the latest. The system started life as a BBS in the 80s. The name comes from the anime “Super Dimension Fortress”, which I’ve never seen.

        • threelonmusketeers
          link
          fedilink
          English
          62 days ago

          pretty hands-off

          Given that the single admin @SDF@lemmy.sdf.org hasn’t been active in two years, yeah, I’d say that counts as “pretty hands-off”. The SDF organization as a whole will probably be around for decades to come, but they don’t seem to care that much about their Lemmy instance.

          • Draconic NEO
            link
            fedilink
            English
            31 day ago

            They have stepped in when a lot of people complained, it took their whole instance complaining to do so while a Nazi troll spammed hate across the local feed.

    • Five
      link
      fedilink
      English
      82 days ago

      You’re very welcome! Kris@feddit.org / @poVoq@slrpnk.net is an incredible admin, and up until now has declined donations, funding the entire instance several years now from his own pocket.

      This current downtime is the exception that proves the rule. I hope he’s not stressing out too much. We’ll all be ready to jump right back into it when he gets back.

      • @Kris@feddit.orgOP
        link
        fedilink
        English
        8
        edit-2
        1 day ago

        Already thinking about how to make the best of it 🤷 Maybe we can use this opportunity to try and migrate to Piefed? I had this in the back of my mind for some time already and Rimu seems optimistic that it is possible.

        • Draconic NEO
          link
          fedilink
          English
          1
          edit-2
          1 day ago

          Wouldn’t that mean the instance would completely restart? I mean I don’t know much about piefed but logically it seems like the DB structure would be incompatible. Thus “Migrating” to piefed means a complete reboot, all posts, all users, all content just bye bye.

          • @Kris@feddit.orgOP
            link
            fedilink
            English
            61 day ago

            Not necessarily, no. We aim to preserve users, communities and posts/comments. Image uploads might get lost though.

            Such an in-place migration will need extensive database operations and likely some support by the Piefed developer (to add support for bcrypt hashed passwords), but we are hopeful to make it happen and maybe this will result in a database migration script other Lemmy instances could also use.

            If this turns out to be infeasible, we will stay with Lemmy rather than reset everything.

            • Draconic NEO
              link
              fedilink
              English
              31 day ago

              Oh awesome, I mean I’ve heard of other platforms like sublinks offering database migration but I didn’t think it would be feasible with piefed since unlike sublinks it’s very different than lemmy.

          • @Kris@feddit.orgOP
            link
            fedilink
            English
            61 day ago

            Lemmy has a lot of individual parts that don’t interact very well with each other, especially the image host part. Futhermore the main UI is quite a mess and we were thinking of switching to an alternative already, but this would further increase the “too many moving parts” issue. Piefed on the otherhand has an integrated and very lightweight UI, which also has some nice additional filtering and moderation features Lemmy currently lacks.

            And I personally feel more at home with the Python codebase, as it allows better troubleshooting and more standartized (Flask) tooling. The Rust codebase of Lemmy has a lot of obscure custom stuff and the error messages are extremely obstruse from a sysadmin perspective.

            And looking at the performance metrics of Lemmy, the main limiting factor seems to be the Postgres database anyways, so the theoretically slower Python codebase of Piefed should not have much impact.

        • @PirateFrog@lemmy.dbzer0.com
          link
          fedilink
          English
          72 days ago

          That’d actually be pretty rad if it’s doable, especially now that the API for piefed was released and mobile apps are already beginning to support it.

    • @glaber@lemm.ee
      link
      fedilink
      English
      32 days ago

      Yeah! It’s definitely worth adding to my list of migration contenders now that lemm.ee is closing and I have to jump ship