• rockSlayer@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        5 months ago

        Well that’s part of the thing. Web scraping doesn’t get covered by policies. Like, they could ban your ip or any accounts you have, but web scraping itself will always be acceptable. It’s why projects like NewPipe and Invidious don’t care about YouTube cease and desist letters.

          • folkrav@lemmy.ca
            link
            fedilink
            arrow-up
            1
            ·
            5 months ago

            Parsing absolutely comes with a lot more overhead. Especially since many websites integrate a lot of JS interactivity nowadays, you oftentimes don’t get the full contents you’re looking for straight out of the HTML you’re getting out of your HTTP request, depending on the site.

  • ArugulaZ@kbin.social
    link
    fedilink
    arrow-up
    1
    ·
    5 months ago

    Sure, why not. People gave you all the information on Reddit for free, you might as well sell it to the highest bidder without compensating them. I call it the “Veasey maneuver.”