The Aniwave(9anime) comments currently have a few problems that I will fix later:
currently missing some glitched/merged comment threads
Imgur images didn’t download properly
Some images were downloaded twice(as the scraper was downloading I made changes to how images were named and ran it again)
Most commented pages on each site sorted from most(Aniwave) to least(Anitaku) amount of comments:
Aniwave(9anime): Attack on Titan The Final Season Part 3 Episode 1
Gogoanime Old comments: Yuri on Ice Category page
Anitaku(Gogoanime): Kimetsu no Yaiba Yuukaku Hen Episode 10
Folders were compressed into tarballs with zstd level 9 compression:
Aniwave(9anime): TOTAL GB UNCOMPRESSED: 69.2 GiB TOTAL GB COMPRESSED:17.4 GiB
Gogoanime: TOTAL GB UNCOMPRESSED: 84.8 GiB TOTAL GB COMPRESSED: 48.2 GiB
Anitaku(Gogoanime): TOTAL GB UNCOMPRESSED: 16.6 GiB TOTAL GB COMPRESSED: 1 GiB
Inside each of the anime folders, you will find 3 types of files that end with ‘part X.json,’ ‘full.json,’ and ‘simple.json’:
Part files - downloaded from disqus and unmodified and contain a maximum of 100 comments
Full - concatonated all part files
Simple - Full file with info stripped out to make more readable by human eyes
DOWNLOADS:
Aniwave(9anime) Comments: https://mega.nz/file/RfgliKJR#kV9MXkEYC-5tqS9A4ZenOMoQKKxpj_ujNadzKeu--qs
Anitaku(Gogoanime) March 2024: https://mega.nz/file/FDBngTQB#p3GMrhPpBY893GLBUJfBePwDOYsKFWmpRyarFlGWCZs
Gogoanime Comments Before 2021: Unfortunatly the compressed file size for Gogoanime is 48.2 GiB and I dont know how to share it since I ran out of free storage space. I will make another post when I figure out how to set up a torrent and also add the link here