While clicking through some random Lemmy instances, I found one that’s due to be shut down in about a week — https://dmv.social. I’m trying to archive what I can onto the Wayback Machine, but I’m not sure what the most efficient way to go about it is.

At the moment, what I’ve been doing is going through each community and archiving each sort type (except the ones under a month, since the instance was locked a month ago) with capture outlinks enabled. But is there a more efficient way to do it? I know of the Internet Archives save from spreadsheet tool, which would probably work well, but I don’t know how I’d go about crawling all the links into a sitemap or csv or something similar. I don’t have the know-how to setup a web crawler/spider.

Any suggestions?

  • grue@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    8 months ago

    I don’t know enough about how ActivityPub works to be sure, but I suspect the right way to archive a Lmy instance would be to create software that acts like another instance, federates with the one you want to archive, and saves the raw stream of ActivityPub packets.

    • Baku@aussie.zoneOP
      link
      fedilink
      English
      arrow-up
      4
      ·
      8 months ago

      Oh, yeah, you’re probably right. Unfortunately I absolutely do not have the knowledge required to do that, but I’ll keep it in mind. Thanks