{"@context":"http://schema.org","@type":"Dataset","@id":"https://doi.org/10.34820/FK2/LSY890","identifier":"https://doi.org/10.34820/FK2/LSY890","name":"Bot AI Crawling Isi Website","creator":[{"name":"Soeltansyah, Hilfan","affiliation":"Telkom University - Direktorat Pusat Teknologi Informasi","@id":"https://orcid.org/0009-0002-6152-8696","identifier":"https://orcid.org/0009-0002-6152-8696"}],"author":[{"name":"Soeltansyah, Hilfan","affiliation":"Telkom University - Direktorat Pusat Teknologi Informasi","@id":"https://orcid.org/0009-0002-6152-8696","identifier":"https://orcid.org/0009-0002-6152-8696"}],"datePublished":"2024-12-05","dateModified":"2024-12-05","version":"2","description":["Semenjak 27 November 2025, di Cloudflare sudah ada Beta laporan AI Audit, dan dari grafik traficnya Bot AI mulai mendominasi untuk melakukan crawling isi website, tentu ini jadi tambahan beban bagi server hosting website."],"keywords":["Computer and Information Science","AI Search, AI Crawler, AI Assistant","Generative Engine Optimization"],"citation":[{"@type":"CreativeWork","text":"https://hilfan.staff.telkomuniversity.ac.id/bot-ai-mulai-mendominasi-untuk-melakukan-crawling-isi-website/"}],"license":{"@type":"Dataset","text":"CC0","url":"https://creativecommons.org/publicdomain/zero/1.0/"},"includedInDataCatalog":{"@type":"DataCatalog","name":"Telkom University Dataverse","url":"https://dataverse.telkomuniversity.ac.id"},"publisher":{"@type":"Organization","name":"Telkom University Dataverse"},"provider":{"@type":"Organization","name":"Telkom University Dataverse"},"distribution":[{"@type":"DataDownload","name":"2024-11-05T06_16_31.456Z__2024-12-05T06_16_31.456Z.tab","fileFormat":"text/tab-separated-values","contentSize":669699,"description":"Tulisan detail Bot AI Mulai mendominasi untuk melakukan Crawling Isi Website \nhttps://hilfan.staff.telkomuniversity.ac.id/bot-ai-mulai-mendominasi-untuk-melakukan-crawling-isi-website/\n\n","@id":"https://doi.org/10.34820/FK2/LSY890/Y0HOIQ","identifier":"https://doi.org/10.34820/FK2/LSY890/Y0HOIQ","contentUrl":"https://dataverse.telkomuniversity.ac.id/api/access/datafile/18472"},{"@type":"DataDownload","name":"agent Bot AI crawling website.jpg","fileFormat":"image/jpeg","contentSize":70441,"description":"Para agent Bot AI crawling website\n\nhttps://hilfan.staff.telkomuniversity.ac.id/bot-ai-mulai-mendominasi-untuk-melakukan-crawling-isi-website/","@id":"https://doi.org/10.34820/FK2/LSY890/FPSQFF","identifier":"https://doi.org/10.34820/FK2/LSY890/FPSQFF","contentUrl":"https://dataverse.telkomuniversity.ac.id/api/access/datafile/18474"},{"@type":"DataDownload","name":"Bot AI crawling website.jpg","fileFormat":"image/jpeg","contentSize":94223,"description":"Semenjak 27 November 2025, di Cloudflare sudah ada Beta laporan AI Audit, dan dari grafik traficnya Bot AI mulai mendominasi untuk melakukan crawling isi website, tentu ini jadi tambahan beban bagi server hosting website.\n\nhttps://hilfan.staff.telkomuniversity.ac.id/bot-ai-mulai-mendominasi-untuk-melakukan-crawling-isi-website/","@id":"https://doi.org/10.34820/FK2/LSY890/FEDANA","identifier":"https://doi.org/10.34820/FK2/LSY890/FEDANA","contentUrl":"https://dataverse.telkomuniversity.ac.id/api/access/datafile/18473"},{"@type":"DataDownload","name":"data yang digali untuk diambil oleh agent Bot AI crawling website.jpg","fileFormat":"image/jpeg","contentSize":130191,"description":"data yang digali untuk diambil oleh agent Bot AI crawling website\nhttps://hilfan.staff.telkomuniversity.ac.id/bot-ai-mulai-mendominasi-untuk-melakukan-crawling-isi-website/","@id":"https://doi.org/10.34820/FK2/LSY890/ALZEKZ","identifier":"https://doi.org/10.34820/FK2/LSY890/ALZEKZ","contentUrl":"https://dataverse.telkomuniversity.ac.id/api/access/datafile/18475"}]}