The Internet is at risk without proper control over web scraping: Cloudflare top exec
The Hindu
Cloudflare Field CTO John Engates speaks about how they want to tackle AI bot crawlers and the need to protect the internet.
Cloud and cybersecurity company, Cloudflare, is waging a war against AI bot crawlers. Web scraping, a phenomenon that began accelerating as the power of AI advanced, has crossed legal lines as AI firms are casually dismissing common online etiquette. Some tech companies have ignored ‘robot.txt’ files, which served as a binding instruction on whether data could or couldn’t be scraped from a website. Cloudflare is looking to fix such unruly behaviour with a permanent solution. They launched a bot management tool that monitors and blocks web scrapers. They also announced a marketplace for websites where they can negotiate payment terms with AI companies for using their data.
This year, the company expanded around its core offering and introduced AI-oriented services like Web Application Firewall and Cloudflare Workers, a serverless platform that allows developers to run their code fast. In an interaction with The Hindu, John Engates, Field CTO, Cloudflare explained how AI scraping can be made fair, the shift from training AI models to inferencing and the need for intelligent automation.
Mercedes-Benz India will increase vehicle prices by up to 2% in January to counter rising costs and currency pressures.
CCI is investigating if IndiGo violated competition norms amid significant flight disruptions and concerns over its dominant market position.
The Coal Controller Organisation is appointed to regulate and register proposed coal exchanges, enhancing market competition and oversight.
The rupee hits a record low amid U.S. trade stalemate and portfolio outflows, prompting potential RBI intervention.
November 2025 sees robust growth in India's auto industry, with record sales in passenger vehicles, two-wheelers, and three-wheelers.
Stock markets soar as Sensex and Nifty extend gains in early trade, driven by positive global trends and U.S. rate cuts.
Petroleum and Natural Gas Rules 2025 amended to enhance business ease, extend lease durations, and strengthen domestic exploration infrastructure.
Tata Hitachi strengthens its focus on India's construction market amid global tariffs and rupee depreciation, leveraging local growth opportunities.
Domestic household savings replace foreign institutional money, giving Indian markets stability but raising concerns about unequal participation and limited returns for new retail investors. Access asymmetry and unequal outcomes emerge as key challenges, making investor protection, lower fees, passive investing, and stronger governance crucial.
The Ministry of Petroleum and Natural Gas (MoPNG) should work closely with the Ministry of External Affairs (MEA), and other concerned government agencies, to strengthen diplomatic engagement with oil-producing countries, secure favourable investment terms and address tax and regulatory hurdles faced by public-sector enterprises (PSEs) abroad, the parliamentary committee on public undertakings (2025-26) stated in their latest report tabled Wednesday.
Why is the rupee falling? Is it falling worse than other currencies? Does the fall hurt or help the Indian economy? And finally, is this a cause for alarm? Here we discuss these questions.
There’s great momentum in India in terms of AI and agentic AI applications getting deployed, observed Satya Nadella, Chairman and Chief Executive Officer, Microsoft.
Prada partners with Indian organizations to create a limited-edition sandal collection inspired by traditional Kolhapuri Chappals.