Arun Shah™@lemmy.world to Technology@lemmy.ml · 2 months agoTop 10 website in the world ( July 2025 )lemmy.mlimagemessage-square31linkfedilinkarrow-up198arrow-down111
arrow-up187arrow-down1imageTop 10 website in the world ( July 2025 )lemmy.mlArun Shah™@lemmy.world to Technology@lemmy.ml · 2 months agomessage-square31linkfedilink
minus-squarePechente@feddit.orglinkfedilinkarrow-up1·2 months agoMy comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
minus-squareclb92@feddit.dklinkfedilinkarrow-up3·2 months agoDumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
My comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
Good pod cast
Dumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.